2024-05-09T04:51:24.234 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T04:51:24.234 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} --verbose --owner scheduled_vshankar@teuthology --name vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558 -- /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/orig.config.yaml 2024-05-09T04:51:24.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T04:51:24.364 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558 branch: wip-63259-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} email: vshankar@redhat.com first_in_suite: false job_id: '7699558' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-63259-3 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 165a15e51d08073b5317c443415b0d8a7141b1ab ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 165a15e51d08073b5317c443415b0d8a7141b1ab kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63259-qa-fix-1 sha1: a2e1088fa282408acd6a8a29f9417b763c0a8663 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9329 sha1: 165a15e51d08073b5317c443415b0d8a7141b1ab sleep_before_teardown: 0 subset: 712/1024 suite: fs suite_branch: wip-63259-qa-fix-1 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: a2e1088fa282408acd6a8a29f9417b763c0a8663 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2nY1XbaiUWzUKpB/U6uPV1zaVAfh3QdGJQo7nK2G0YKUxgW3fGw+4QYsbWAmIiN2oJC2oh5Vubfyp8aaWc3lM= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUOyRCRaWLvY5z92z4HylL0DafRMQSUmHxWbaLbHO2Errnle1q71l67ihC0RTwjECDnxxebQfpHI0P8tNh8VTU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_backtrace teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-09_04:42:47 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T04:51:24.365 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa; will attempt to use it 2024-05-09T04:51:24.365 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks 2024-05-09T04:51:24.366 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T04:51:24.367 INFO:teuthology.task.internal:Checking packages... 2024-05-09T04:51:24.392 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '165a15e51d08073b5317c443415b0d8a7141b1ab' 2024-05-09T04:51:24.392 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T04:51:24.392 INFO:teuthology.packaging:ref: None 2024-05-09T04:51:24.392 INFO:teuthology.packaging:tag: None 2024-05-09T04:51:24.392 INFO:teuthology.packaging:branch: wip-63259-3 2024-05-09T04:51:24.392 INFO:teuthology.packaging:sha1: 165a15e51d08073b5317c443415b0d8a7141b1ab 2024-05-09T04:51:24.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-63259-3 2024-05-09T04:51:24.624 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3568.g165a15e5 2024-05-09T04:51:24.626 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T04:51:24.632 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T04:51:24.633 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T04:51:24.645 INFO:teuthology.task.internal:Saving configuration 2024-05-09T04:51:24.662 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T04:51:24.668 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T04:51:24.695 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 04:46:15.997800', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2nY1XbaiUWzUKpB/U6uPV1zaVAfh3QdGJQo7nK2G0YKUxgW3fGw+4QYsbWAmIiN2oJC2oh5Vubfyp8aaWc3lM='} 2024-05-09T04:51:24.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 04:46:15.999276', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUOyRCRaWLvY5z92z4HylL0DafRMQSUmHxWbaLbHO2Errnle1q71l67ihC0RTwjECDnxxebQfpHI0P8tNh8VTU='} 2024-05-09T04:51:24.716 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T04:51:24.723 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-09T04:51:24.723 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-09T04:51:24.723 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T04:51:24.794 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff2add1ef70>, signals=[15]) 2024-05-09T04:51:24.795 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T04:51:24.801 INFO:teuthology.task.internal:Opening connections... 2024-05-09T04:51:24.801 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T04:51:24.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:51:24.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T04:51:24.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:51:24.956 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T04:51:24.963 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-05-09T04:51:24.981 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-05-09T04:51:24.981 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-05-09T04:51:25.038 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T04:51:25.039 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-05-09T04:51:25.039 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T04:51:25.039 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T04:51:25.039 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T04:51:25.039 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-05-09T04:51:25.062 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-05-09T04:51:25.079 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-05-09T04:51:25.080 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-05-09T04:51:25.137 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-05-09T04:51:25.137 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-05-09T04:51:25.137 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-05-09T04:51:25.137 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-05-09T04:51:25.137 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-05-09T04:51:25.138 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-05-09T04:51:25.138 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T04:51:25.138 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-05-09T04:51:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-05-09T04:51:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T04:51:25.141 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-05-09T04:51:25.142 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T04:51:25.142 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T04:51:25.142 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T04:51:25.142 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-05-09T04:51:25.161 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T04:51:25.171 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T04:51:25.177 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T04:51:25.177 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-05-09T04:51:25.180 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-05-09T04:51:25.196 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T04:51:25.202 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T04:51:25.203 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-05-09T04:51:25.236 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-05-09T04:51:25.328 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T04:51:25.383 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T04:51:25.398 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-09T04:51:25.398 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-09T04:51:25.398 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-09T04:51:25.399 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T04:51:25.399 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T04:51:25.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T04:51:25.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-09T04:51:25.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T04:51:25.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-09T04:51:25.569 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-09T04:51:25.569 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-09T04:51:25.569 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-05-09T04:51:25.570 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-09T04:51:25.571 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-09T04:51:25.571 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-05-09T04:51:25.588 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-437.el9.x86_64 2024-05-09T04:51:25.588 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-09T04:51:25.588 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-09T04:51:25.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2024-05-09T04:51:25.590 INFO:teuthology.orchestra.run.smithi133.stdout:5.14.0-437.el9.x86_64 2024-05-09T04:51:25.590 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-09T04:51:25.590 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-09T04:51:25.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum upgrade -y linux-firmware 2024-05-09T04:51:27.953 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-09T04:51:28.297 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.1 MB 00:01 2024-05-09T04:51:31.296 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 19 MB 00:02 2024-05-09T04:51:36.779 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-09T04:51:38.372 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-05-09T04:51:39.457 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-09T04:51:44.706 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 10 kB/s | 1.7 kB 00:00 2024-05-09T04:51:45.920 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-05-09T04:51:46.792 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-05-09T04:51:46.793 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2024-05-09T04:51:46.793 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-05-09T04:51:46.904 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-09T04:51:46.904 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-09T04:51:47.053 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-09T04:51:47.053 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-09T04:51:47.056 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2024-05-09T04:51:51.704 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-05-09T04:51:53.271 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 16 kB 00:00 2024-05-09T04:51:57.241 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-05-09T04:52:01.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09 04:52:01 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-09T04:52:01.549 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2024-05-09 04:52:01-- 2024-05-09T04:52:01.549 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 14s 2024-05-09T04:52:01.550 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 341M in 14s (24.1 MB/s) 2024-05-09T04:52:01.552 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-09T04:52:01.552 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-09T04:52:02.363 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-09T04:52:03.632 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2024-05-09T04:52:04.005 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2024-05-09T04:52:04.118 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2024-05-09T04:52:04.458 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-05-09T04:52:04.459 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-05-09T04:52:04.459 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-05-09T04:52:04.555 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-09T04:52:04.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-09T04:52:04.788 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-09T04:52:04.788 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-09T04:52:04.790 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi133.front.sepia.ceph.com to complete... 2024-05-09T04:52:12.079 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-09T04:52:26.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09 04:52:26 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-09T04:52:26.893 INFO:teuthology.orchestra.run.smithi133.stderr:FINISHED --2024-05-09 04:52:26-- 2024-05-09T04:52:26.893 INFO:teuthology.orchestra.run.smithi133.stderr:Total wall clock time: 22s 2024-05-09T04:52:26.893 INFO:teuthology.orchestra.run.smithi133.stderr:Downloaded: 1 files, 341M in 22s (15.8 MB/s) 2024-05-09T04:52:26.896 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-09T04:52:26.897 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-09T04:52:29.085 INFO:teuthology.orchestra.run.smithi133.stdout:Verifying... ######################################## 2024-05-09T04:52:29.249 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing... ######################################## 2024-05-09T04:52:29.353 INFO:teuthology.orchestra.run.smithi133.stdout:Updating / installing... 2024-05-09T04:52:37.227 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-09T04:52:52.011 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-09T04:52:52.012 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-09T04:52:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-09T04:52:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-09T04:52:52.094 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-09T04:52:52.095 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-09T04:52:52.096 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-09T04:52:52.097 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-09T04:52:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-09T04:52:52.099 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-09T04:52:52.100 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-09T04:52:52.101 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-09T04:52:52.102 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-09T04:52:52.103 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-09T04:52:52.104 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-09T04:52:52.105 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-09T04:52:52.106 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-09T04:52:52.107 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-09T04:52:52.108 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-09T04:52:52.109 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-09T04:52:52.110 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-09T04:52:52.111 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-09T04:52:52.112 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-09T04:52:52.113 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-09T04:52:52.114 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-09T04:52:52.115 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-09T04:52:52.116 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-09T04:52:52.117 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-09T04:52:52.118 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-09T04:52:52.119 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-09T04:52:52.120 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-09T04:52:52.121 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-09T04:52:52.122 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-09T04:52:52.123 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-09T04:52:52.124 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-09T04:52:52.125 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-09T04:52:52.126 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-09T04:52:52.127 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-09T04:52:52.128 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-09T04:52:52.129 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-09T04:52:52.130 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-09T04:52:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-09T04:52:52.132 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-09T04:52:52.133 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-09T04:52:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-09T04:52:52.135 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-09T04:52:52.136 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-09T04:52:52.137 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-09T04:52:52.138 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-09T04:52:52.139 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-09T04:52:52.140 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-09T04:52:52.141 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-09T04:52:52.142 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-09T04:52:52.143 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-09T04:52:52.144 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-09T04:52:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-09T04:52:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-09T04:52:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-09T04:52:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-09T04:52:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-09T04:52:52.150 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-09T04:52:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-09T04:52:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-09T04:52:52.153 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-09T04:52:52.154 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-09T04:52:52.155 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-09T04:52:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-09T04:52:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-09T04:52:52.158 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-09T04:52:52.159 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-09T04:52:52.160 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-09T04:52:52.161 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-09T04:52:52.162 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-09T04:52:52.163 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-09T04:52:52.164 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-09T04:52:52.165 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-09T04:52:52.166 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-09T04:52:52.167 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-09T04:52:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-09T04:52:52.169 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-09T04:52:52.170 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-09T04:52:52.171 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-09T04:52:52.172 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-09T04:52:52.173 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-09T04:52:52.174 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-09T04:52:52.175 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-09T04:52:52.176 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-09T04:52:52.177 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-09T04:52:52.178 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-09T04:52:52.179 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-09T04:52:52.180 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-09T04:52:52.181 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-09T04:52:52.182 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-09T04:52:52.183 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-09T04:52:52.184 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-09T04:52:52.185 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-09T04:52:52.186 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-09T04:52:52.187 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-09T04:52:52.188 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-09T04:52:52.189 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-09T04:52:52.190 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-09T04:52:52.191 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-09T04:52:52.192 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-09T04:52:52.193 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-09T04:52:52.194 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-09T04:52:52.195 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-09T04:52:52.196 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-09T04:52:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-09T04:52:52.198 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-09T04:52:52.199 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-09T04:52:52.200 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-09T04:52:52.201 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-09T04:52:52.202 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-09T04:52:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-09T04:52:52.204 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-09T04:52:52.205 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-09T04:52:52.206 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-09T04:52:52.207 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-09T04:52:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-09T04:52:52.209 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-09T04:52:52.210 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-09T04:52:52.211 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-09T04:52:52.212 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-09T04:52:52.213 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-09T04:52:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-09T04:52:52.215 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-09T04:52:52.216 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-09T04:52:52.217 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-09T04:52:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-09T04:52:52.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-09T04:52:52.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-09T04:52:52.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-09T04:52:52.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-09T04:52:52.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-09T04:52:52.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-09T04:52:52.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-09T04:52:52.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-09T04:52:52.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-09T04:52:52.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-09T04:52:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-09T04:52:52.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-09T04:52:52.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-09T04:52:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-09T04:52:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-09T04:52:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-09T04:52:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-09T04:52:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-09T04:52:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-09T04:52:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-09T04:52:52.238 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.238 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-09T04:52:52.260 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2024-05-09T04:52:52.260 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-09T04:52:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-09T04:52:52.260 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-05-09T04:52:52.260 INFO:teuthology.orchestra.run.smithi100.stdout:for file in vmlinuz System.map config; do 2024-05-09T04:52:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: fi 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:done 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-09T04:52:52.261 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.262 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-05-09T04:52:52.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-05-09T04:52:52.333 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 68.el9 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8264254 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T04:52:52.334 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T04:52:52.335 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T04:52:52.336 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T04:52:52.336 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:52.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T04:52:52.917 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-05-09T04:52:54.346 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T04:52:54.365 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-05-09T04:52:54.368 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-05-09T04:52:54.393 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.bq88bkrkT7 2024-05-09T04:52:54.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bq88bkrkT7 2024-05-09T04:52:54.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.bq88bkrkT7 2024-05-09T04:52:54.603 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.bq88bkrkT7 is 6KB 2024-05-09T04:52:54.622 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.bq88bkrkT7 2024-05-09T04:52:54.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T04:52:54.697 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T04:52:54.698 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T04:52:54.698 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T04:52:54.698 INFO:teuthology.orchestra.run.smithi100.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-09T04:52:54.699 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-09T04:52:54.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-05-09T04:53:15.822 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-09T04:53:15.822 DEBUG:teuthology.orchestra.run.smithi133:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-09T04:53:15.903 INFO:teuthology.orchestra.run.smithi133.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-09T04:53:15.904 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-09T04:53:15.905 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-09T04:53:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-09T04:53:15.907 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-09T04:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-09T04:53:15.909 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-09T04:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-09T04:53:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-09T04:53:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-09T04:53:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-09T04:53:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-09T04:53:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-09T04:53:15.916 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-09T04:53:15.917 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-09T04:53:15.918 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-09T04:53:15.919 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-09T04:53:15.920 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-09T04:53:15.921 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-09T04:53:15.922 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-09T04:53:15.923 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-09T04:53:15.924 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-09T04:53:15.925 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-09T04:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-09T04:53:15.927 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-09T04:53:15.928 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-09T04:53:15.929 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-09T04:53:15.930 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-09T04:53:15.931 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-09T04:53:15.932 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-09T04:53:15.933 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-09T04:53:15.934 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-09T04:53:15.935 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-09T04:53:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-09T04:53:15.937 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-09T04:53:15.938 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-09T04:53:15.939 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-09T04:53:15.940 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-09T04:53:15.941 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-09T04:53:15.942 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-09T04:53:15.943 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-09T04:53:15.944 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-09T04:53:15.945 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-09T04:53:15.946 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-09T04:53:15.947 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-09T04:53:15.948 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-09T04:53:15.949 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-09T04:53:15.950 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-09T04:53:15.951 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-09T04:53:15.952 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-09T04:53:15.953 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-09T04:53:15.954 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-09T04:53:15.955 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-09T04:53:15.956 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-09T04:53:15.957 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-09T04:53:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-09T04:53:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-09T04:53:15.960 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-09T04:53:15.961 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-09T04:53:15.962 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-09T04:53:15.963 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-09T04:53:15.964 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-09T04:53:15.965 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-09T04:53:15.966 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-09T04:53:15.967 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-09T04:53:15.968 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-09T04:53:15.969 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-09T04:53:15.970 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-09T04:53:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-09T04:53:15.972 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-09T04:53:15.973 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-09T04:53:15.974 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-09T04:53:15.975 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-09T04:53:15.976 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-09T04:53:15.977 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-09T04:53:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-09T04:53:15.979 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-09T04:53:15.980 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-09T04:53:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-09T04:53:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-09T04:53:15.983 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-09T04:53:15.986 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-09T04:53:15.987 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-09T04:53:15.988 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-09T04:53:15.989 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-09T04:53:15.990 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-09T04:53:15.991 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-09T04:53:15.992 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-09T04:53:15.993 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-09T04:53:15.994 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-09T04:53:15.995 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-09T04:53:15.996 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-09T04:53:15.997 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-09T04:53:15.998 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-09T04:53:15.999 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-09T04:53:16.000 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-09T04:53:16.001 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-09T04:53:16.002 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-09T04:53:16.003 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-09T04:53:16.004 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-09T04:53:16.005 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-09T04:53:16.006 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-09T04:53:16.007 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-09T04:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-09T04:53:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-09T04:53:16.010 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-09T04:53:16.011 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-09T04:53:16.012 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-09T04:53:16.013 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-09T04:53:16.014 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-09T04:53:16.015 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-09T04:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-09T04:53:16.017 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-09T04:53:16.018 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-09T04:53:16.019 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-09T04:53:16.020 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-09T04:53:16.021 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-09T04:53:16.022 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-09T04:53:16.023 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-09T04:53:16.024 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-09T04:53:16.025 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-09T04:53:16.026 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-09T04:53:16.027 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-09T04:53:16.028 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-09T04:53:16.029 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-09T04:53:16.030 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-09T04:53:16.031 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-09T04:53:16.032 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-09T04:53:16.033 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-09T04:53:16.034 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-09T04:53:16.035 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-09T04:53:16.036 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-09T04:53:16.037 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-09T04:53:16.038 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-09T04:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-09T04:53:16.040 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-09T04:53:16.041 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-09T04:53:16.042 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-09T04:53:16.043 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-09T04:53:16.044 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-09T04:53:16.045 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-09T04:53:16.046 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-09T04:53:16.047 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-09T04:53:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-09T04:53:16.052 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:16.052 DEBUG:teuthology.orchestra.run.smithi133:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-09T04:53:16.076 INFO:teuthology.orchestra.run.smithi133.stdout:postinstall scriptlet (using /bin/sh): 2024-05-09T04:53:16.076 INFO:teuthology.orchestra.run.smithi133.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-09T04:53:16.076 INFO:teuthology.orchestra.run.smithi133.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-09T04:53:16.076 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-05-09T04:53:16.076 INFO:teuthology.orchestra.run.smithi133.stdout:for file in vmlinuz System.map config; do 2024-05-09T04:53:16.076 INFO:teuthology.orchestra.run.smithi133.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout: fi 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:done 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-09T04:53:16.077 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:16.078 INFO:teuthology.orchestra.run.smithi133.stdout:fi 2024-05-09T04:53:16.079 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2024-05-09T04:53:16.151 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2024-05-09T04:53:16.151 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2024-05-09T04:53:16.151 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.06 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 68.el9 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Group : Unspecified 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 8264254 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : builder@centos.org 2024-05-09T04:53:16.152 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : CentOS 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T04:53:16.153 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T04:53:16.154 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T04:53:16.154 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:16.154 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T04:53:16.711 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-05-09T04:53:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T04:53:18.075 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-05-09T04:53:18.077 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-05-09T04:53:18.096 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.QfDcdrRdA5 2024-05-09T04:53:18.097 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QfDcdrRdA5 2024-05-09T04:53:18.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.QfDcdrRdA5 2024-05-09T04:53:18.295 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.QfDcdrRdA5 is 6KB 2024-05-09T04:53:18.314 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.QfDcdrRdA5 2024-05-09T04:53:18.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T04:53:18.389 INFO:teuthology.orchestra.run.smithi133.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T04:53:18.389 INFO:teuthology.orchestra.run.smithi133.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T04:53:18.389 INFO:teuthology.orchestra.run.smithi133.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T04:53:18.389 INFO:teuthology.orchestra.run.smithi133.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-09T04:53:18.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-09T04:53:18.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-05-09T04:53:24.870 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-09T04:53:24.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T04:53:24.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:53:48.582 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-09T04:53:48.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T04:53:48.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:53:59.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-05-09T04:54:07.138 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-05-09T04:54:08.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T04:54:08.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:54:16.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T04:54:16.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:54:19.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-05-09T04:54:26.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-05-09T04:54:31.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T04:54:31.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:54:38.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T04:54:38.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:54:39.265 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-05-09T04:54:39.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T04:54:39.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-09T04:54:39.891 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-05-09T04:54:39.933 INFO:teuthology.orchestra.run.smithi100.stdout:6.9.0-rc3-g806ec36b2112 2024-05-09T04:54:39.934 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-09T04:54:39.934 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T04:54:39.934 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T04:54:40.935 DEBUG:teuthology.parallel:result is None 2024-05-09T04:54:49.630 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-05-09T04:55:04.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T04:55:04.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T04:55:05.044 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-05-09T04:55:05.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T04:55:05.637 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-05-09T04:55:05.638 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-05-09T04:55:05.679 INFO:teuthology.orchestra.run.smithi133.stdout:6.9.0-rc3-g806ec36b2112 2024-05-09T04:55:05.679 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-09T04:55:05.679 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T04:55:05.679 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T04:55:06.680 DEBUG:teuthology.parallel:result is None 2024-05-09T04:55:06.680 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T04:55:06.692 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T04:55:06.692 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T04:55:06.701 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T04:55:06.753 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T04:55:06.760 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T04:55:06.770 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T04:55:06.770 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T04:55:06.778 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T04:55:06.864 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T04:55:06.870 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T04:55:06.870 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T04:55:06.878 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T04:55:07.009 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T04:55:07.024 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T04:55:07.049 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T04:55:07.086 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T04:55:07.091 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T04:55:07.098 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T04:55:07.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T04:55:07.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T04:55:07.186 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T04:55:07.196 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T04:55:07.196 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T04:55:07.202 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T04:55:07.248 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T04:55:07.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T04:55:07.424 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T04:55:07.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T04:55:07.585 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T04:55:07.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T04:55:07.671 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T04:55:07.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T04:55:07.843 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T04:55:07.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T04:55:07.993 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T04:55:07.993 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T04:55:08.073 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-05-09T04:55:08.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-05-09T04:55:08.199 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T04:55:08.206 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T04:55:08.675 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T04:55:08.683 INFO:teuthology.task.internal:Starting timer... 2024-05-09T04:55:08.683 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T04:55:08.706 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T04:55:08.714 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-09T04:55:08.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-05-09T04:55:08.821 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-05-09T04:55:08.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-05-09T04:55:08.979 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-05-09T04:55:08.986 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T04:55:08.986 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-05-09T04:55:09.041 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-05-09T04:55:09.041 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-05-09T04:55:09.095 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-05-09T04:55:09.095 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2024-05-09T04:55:09.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T04:55:09.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T04:55:09.167 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T04:55:09.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T04:55:09.243 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T04:55:09.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-05-09T04:55:09.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-05-09T04:55:09.394 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T04:55:09.403 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-09T04:55:09.408 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-09T04:55:09.532 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T04:55:09.548 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T04:55:09.549 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T05:00:43.640 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2024-05-09T05:00:43.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T05:00:43.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:00:43.755 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-05-09T05:00:43.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T05:00:43.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T05:00:43.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:00:44.012 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-05-09T05:00:44.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-05-09T05:00:44.169 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T05:00:44.181 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T05:00:44.181 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:00:44.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:00:44.189 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:00:44.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:00:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T05:00:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T05:00:44.320 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T05:00:44.326 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T05:00:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-05-09T05:00:44.397 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-05-09T05:00:44.424 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-05-09T05:00:44.431 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-05-09T05:00:44.465 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T05:00:44.475 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T05:00:44.506 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T05:00:44.515 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T05:00:44.653 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:00:44.657 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:00:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:00:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-05-09T05:00:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.665 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:00:44.666 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-05-09T05:00:44.666 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.666 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.666 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.666 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:00:44.667 INFO:teuthology.run_tasks:Running task install... 2024-05-09T05:00:44.676 DEBUG:teuthology.task.install:project ceph 2024-05-09T05:00:44.676 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab'}} 2024-05-09T05:00:44.676 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab'} 2024-05-09T05:00:44.676 INFO:teuthology.task.install:Using flavor: default 2024-05-09T05:00:44.681 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T05:00:44.682 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T05:00:44.682 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab', 'tag': None, 'wait_for_package': False} 2024-05-09T05:00:44.683 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=165a15e51d08073b5317c443415b0d8a7141b1ab 2024-05-09T05:00:44.685 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab', 'tag': None, 'wait_for_package': False} 2024-05-09T05:00:44.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=165a15e51d08073b5317c443415b0d8a7141b1ab 2024-05-09T05:00:44.921 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/ 2024-05-09T05:00:44.922 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3568.g165a15e5 2024-05-09T05:00:44.927 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/ 2024-05-09T05:00:44.927 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3568.g165a15e5 2024-05-09T05:00:45.096 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T05:00:45.096 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:00:45.096 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T05:00:45.102 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-63259-3/165a15e51d08073b5317c443415b0d8a7141b1ab/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T05:00:45.103 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:00:45.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T05:00:45.189 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T05:00:45.189 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/165a15e51d08073b5317c443415b0d8a7141b1ab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T05:00:45.193 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T05:00:45.194 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/165a15e51d08073b5317c443415b0d8a7141b1ab/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T05:00:45.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T05:00:45.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T05:00:45.421 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T05:00:45.434 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T05:00:45.491 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-05-09T05:00:45.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-05-09T05:00:45.511 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-05-09T05:00:45.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-05-09T05:00:45.816 INFO:teuthology.orchestra.run.smithi133.stdout:54 files removed 2024-05-09T05:00:45.833 INFO:teuthology.orchestra.run.smithi100.stdout:54 files removed 2024-05-09T05:00:45.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T05:00:45.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T05:00:46.778 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 172 kB/s | 84 kB 00:00 2024-05-09T05:00:46.881 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 144 kB/s | 84 kB 00:00 2024-05-09T05:00:47.391 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-05-09T05:00:47.704 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 16 kB/s | 12 kB 00:00 2024-05-09T05:00:48.216 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-05-09T05:00:48.341 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2024-05-09T05:00:48.998 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-09T05:00:49.455 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.1 MB 00:01 2024-05-09T05:00:51.316 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-05-09T05:00:51.366 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-09T05:00:55.792 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-09T05:00:56.224 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.2 MB 00:00 2024-05-09T05:00:57.485 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-05-09T05:00:57.900 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-05-09T05:00:59.553 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-09T05:00:59.565 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-09T05:01:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-05-09T05:01:05.818 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-09T05:01:08.326 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:01:08.328 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:01:08.347 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T05:01:08.349 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T05:01:08.350 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T05:01:08.351 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T05:01:08.354 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T05:01:08.357 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T05:01:08.358 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T05:01:08.386 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:01:08.388 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:01:08.408 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T05:01:08.409 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T05:01:08.410 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T05:01:08.412 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T05:01:08.414 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T05:01:08.417 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T05:01:08.419 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T05:01:08.427 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 6.6 k 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 5.4 M 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 890 k 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 145 k 2024-05-09T05:01:08.470 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 1.5 M 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 142 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 3.5 M 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 7.4 M 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 49 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 11 M 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 49 M 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 273 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 764 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 225 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-shell x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 27 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 18 k 2024-05-09T05:01:08.471 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 32 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 747 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 127 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T05:01:08.472 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 162 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 321 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 299 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 100 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 85 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 3.1 M 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 171 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T05:01:08.473 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 3.4 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 3.1 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 21 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 34 k 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 2.4 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 274 k 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 4.7 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 17 M 2024-05-09T05:01:08.474 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 16 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 25 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 163 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T05:01:08.475 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 500 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 5.4 M 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T05:01:08.476 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 45 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 135 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T05:01:08.477 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T05:01:08.478 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T05:01:08.479 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T05:01:08.480 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T05:01:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T05:01:08.482 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout:======================================================================================= 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout:Install 148 Packages 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 8 Packages 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:01:08.483 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 226 M 2024-05-09T05:01:08.484 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-05-09T05:01:08.488 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 6.6 k 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 5.4 M 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 890 k 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 145 k 2024-05-09T05:01:08.513 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 1.5 M 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 142 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 3.5 M 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 7.4 M 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 49 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 11 M 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 49 M 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 273 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 764 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 225 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 27 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 18 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T05:01:08.514 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 32 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 747 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 127 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 162 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 321 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 299 k 2024-05-09T05:01:08.515 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 100 k 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 85 k 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 3.1 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 171 k 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 3.4 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 3.1 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T05:01:08.516 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 21 M 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 34 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 2.4 M 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 274 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 4.7 M 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 17 M 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3568.g165a15e5.el9 ceph-noarch 16 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 25 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T05:01:08.517 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 163 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 500 k 2024-05-09T05:01:08.518 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 5.4 M 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T05:01:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 45 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-3568.g165a15e5.el9 ceph 135 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T05:01:08.520 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T05:01:08.521 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T05:01:08.522 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T05:01:08.523 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T05:01:08.524 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-05-09T05:01:08.525 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-05-09T05:01:08.526 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:01:08.526 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-05-09T05:01:08.526 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-05-09T05:01:10.646 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.0.0-3568.g165a15e5.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-05-09T05:01:10.779 INFO:teuthology.orchestra.run.smithi133.stdout:(1/156): ceph-19.0.0-3568.g165a15e5.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-09T05:01:10.854 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.0.0-3568.g165a15e5.el9.x8 4.2 MB/s | 890 kB 00:00 2024-05-09T05:01:10.904 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-immutable-object-cache-19.0.0-356 2.9 MB/s | 145 kB 00:00 2024-05-09T05:01:11.004 INFO:teuthology.orchestra.run.smithi133.stdout:(2/156): ceph-fuse-19.0.0-3568.g165a15e5.el9.x8 3.9 MB/s | 890 kB 00:00 2024-05-09T05:01:11.113 INFO:teuthology.orchestra.run.smithi133.stdout:(3/156): ceph-immutable-object-cache-19.0.0-356 1.3 MB/s | 145 kB 00:00 2024-05-09T05:01:11.221 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-mds-19.0.0-3568.g165a15e5.el9.x86 7.5 MB/s | 2.4 MB 00:00 2024-05-09T05:01:11.489 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mgr-19.0.0-3568.g165a15e5.el9.x86 5.7 MB/s | 1.5 MB 00:00 2024-05-09T05:01:11.596 INFO:teuthology.orchestra.run.smithi133.stdout:(4/156): ceph-mds-19.0.0-3568.g165a15e5.el9.x86 4.9 MB/s | 2.4 MB 00:00 2024-05-09T05:01:11.988 INFO:teuthology.orchestra.run.smithi133.stdout:(5/156): ceph-mgr-19.0.0-3568.g165a15e5.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-05-09T05:01:12.189 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mon-19.0.0-3568.g165a15e5.el9.x86 6.7 MB/s | 4.7 MB 00:00 2024-05-09T05:01:12.797 INFO:teuthology.orchestra.run.smithi133.stdout:(6/156): ceph-mon-19.0.0-3568.g165a15e5.el9.x86 5.8 MB/s | 4.7 MB 00:00 2024-05-09T05:01:12.839 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-common-19.0.0-3568.g165a15e5.el9. 8.7 MB/s | 21 MB 00:02 2024-05-09T05:01:12.914 INFO:teuthology.orchestra.run.smithi133.stdout:(7/156): ceph-base-19.0.0-3568.g165a15e5.el9.x8 2.2 MB/s | 5.4 MB 00:02 2024-05-09T05:01:13.864 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-radosgw-19.0.0-3568.g165a15e5.el9 10 MB/s | 11 MB 00:01 2024-05-09T05:01:13.965 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.0.0-3568.g165a15e5.el9 254 kB/s | 25 kB 00:00 2024-05-09T05:01:15.114 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-osd-19.0.0-3568.g165a15e5.el9.x8 5.8 MB/s | 17 MB 00:02 2024-05-09T05:01:15.248 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.0.0-3568.g165a15e5.e 1.7 MB/s | 225 kB 00:00 2024-05-09T05:01:15.357 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.0.0-3568.g165a15e5.el 252 kB/s | 27 kB 00:00 2024-05-09T05:01:15.465 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.0.0-3568.g165a15e5 295 kB/s | 32 kB 00:00 2024-05-09T05:01:15.616 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): ceph-base-19.0.0-3568.g165a15e5.el9.x 1.0 MB/s | 5.4 MB 00:05 2024-05-09T05:01:15.630 INFO:teuthology.orchestra.run.smithi133.stdout:(8/156): ceph-osd-19.0.0-3568.g165a15e5.el9.x86 5.9 MB/s | 17 MB 00:02 2024-05-09T05:01:15.666 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephfs2-19.0.0-3568.g165a15e5.el9. 3.7 MB/s | 747 kB 00:00 2024-05-09T05:01:15.697 INFO:teuthology.orchestra.run.smithi133.stdout:(9/156): ceph-selinux-19.0.0-3568.g165a15e5.el9 384 kB/s | 25 kB 00:00 2024-05-09T05:01:15.741 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.0.0-3568.g165a15e5. 1.7 MB/s | 127 kB 00:00 2024-05-09T05:01:15.766 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): libcephsqlite-19.0.0-3568.g165a15e5.e 1.1 MB/s | 163 kB 00:00 2024-05-09T05:01:15.924 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): libradosstriper1-19.0.0-3568.g165a15e 2.7 MB/s | 500 kB 00:00 2024-05-09T05:01:16.034 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.0.0-3568.g16 414 kB/s | 45 kB 00:00 2024-05-09T05:01:16.126 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-common-19.0.0-3568.g165a 1.5 MB/s | 135 kB 00:00 2024-05-09T05:01:16.226 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-cephfs-19.0.0-3568.g165a15e5. 1.6 MB/s | 162 kB 00:00 2024-05-09T05:01:16.326 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-rados-19.0.0-3568.g165a15e5.e 3.2 MB/s | 321 kB 00:00 2024-05-09T05:01:16.427 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rbd-19.0.0-3568.g165a15e5.el9 3.0 MB/s | 299 kB 00:00 2024-05-09T05:01:16.518 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rgw-19.0.0-3568.g165a15e5.el9 1.1 MB/s | 100 kB 00:00 2024-05-09T05:01:16.869 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): rbd-fuse-19.0.0-3568.g165a15e5.el9.x8 244 kB/s | 85 kB 00:00 2024-05-09T05:01:17.031 INFO:teuthology.orchestra.run.smithi133.stdout:(10/156): ceph-radosgw-19.0.0-3568.g165a15e5.el 2.6 MB/s | 11 MB 00:04 2024-05-09T05:01:17.231 INFO:teuthology.orchestra.run.smithi133.stdout:(11/156): cephfs-mirror-19.0.0-3568.g165a15e5.e 1.1 MB/s | 225 kB 00:00 2024-05-09T05:01:17.331 INFO:teuthology.orchestra.run.smithi133.stdout:(12/156): cephfs-shell-19.0.0-3568.g165a15e5.el 272 kB/s | 27 kB 00:00 2024-05-09T05:01:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:(13/156): libcephfs-devel-19.0.0-3568.g165a15e5 320 kB/s | 32 kB 00:00 2024-05-09T05:01:17.461 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-mirror-19.0.0-3568.g165a15e5.el9. 5.2 MB/s | 3.1 MB 00:00 2024-05-09T05:01:17.657 INFO:teuthology.orchestra.run.smithi133.stdout:(14/156): libcephfs2-19.0.0-3568.g165a15e5.el9. 3.3 MB/s | 747 kB 00:00 2024-05-09T05:01:17.741 INFO:teuthology.orchestra.run.smithi133.stdout:(15/156): libcephsqlite-19.0.0-3568.g165a15e5.e 1.9 MB/s | 163 kB 00:00 2024-05-09T05:01:17.816 INFO:teuthology.orchestra.run.smithi133.stdout:(16/156): librados-devel-19.0.0-3568.g165a15e5. 1.7 MB/s | 127 kB 00:00 2024-05-09T05:01:17.978 INFO:teuthology.orchestra.run.smithi133.stdout:(17/156): libradosstriper1-19.0.0-3568.g165a15e 3.0 MB/s | 500 kB 00:00 2024-05-09T05:01:18.020 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): ceph-test-19.0.0-3568.g165a15e5.el9.x 12 MB/s | 49 MB 00:04 2024-05-09T05:01:18.053 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): rbd-nbd-19.0.0-3568.g165a15e5.el9.x86 289 kB/s | 171 kB 00:00 2024-05-09T05:01:18.104 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3568.g 414 kB/s | 34 kB 00:00 2024-05-09T05:01:18.137 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3568.g165a15e 1.7 MB/s | 142 kB 00:00 2024-05-09T05:01:18.475 INFO:teuthology.orchestra.run.smithi133.stdout:(18/156): ceph-common-19.0.0-3568.g165a15e5.el9 2.7 MB/s | 21 MB 00:07 2024-05-09T05:01:18.550 INFO:teuthology.orchestra.run.smithi133.stdout:(19/156): python3-ceph-argparse-19.0.0-3568.g16 609 kB/s | 45 kB 00:00 2024-05-09T05:01:18.554 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3568.g165a1 7.9 MB/s | 3.5 MB 00:00 2024-05-09T05:01:18.654 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3568.g16 2.7 MB/s | 274 kB 00:00 2024-05-09T05:01:18.692 INFO:teuthology.orchestra.run.smithi133.stdout:(20/156): python3-ceph-common-19.0.0-3568.g165a 963 kB/s | 135 kB 00:00 2024-05-09T05:01:18.755 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-rook-19.0.0-3568.g165a15e5.e 497 kB/s | 49 kB 00:00 2024-05-09T05:01:18.784 INFO:teuthology.orchestra.run.smithi133.stdout:(21/156): python3-cephfs-19.0.0-3568.g165a15e5. 1.7 MB/s | 162 kB 00:00 2024-05-09T05:01:18.847 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3568.g1 181 kB/s | 16 kB 00:00 2024-05-09T05:01:18.926 INFO:teuthology.orchestra.run.smithi133.stdout:(22/156): python3-rados-19.0.0-3568.g165a15e5.e 2.2 MB/s | 321 kB 00:00 2024-05-09T05:01:18.947 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-volume-19.0.0-3568.g165a15e5.el9 2.7 MB/s | 273 kB 00:00 2024-05-09T05:01:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:(23/156): python3-rbd-19.0.0-3568.g165a15e5.el9 2.1 MB/s | 299 kB 00:00 2024-05-09T05:01:19.131 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-05-09T05:01:19.143 INFO:teuthology.orchestra.run.smithi133.stdout:(24/156): python3-rgw-19.0.0-3568.g165a15e5.el9 1.3 MB/s | 100 kB 00:00 2024-05-09T05:01:19.210 INFO:teuthology.orchestra.run.smithi133.stdout:(25/156): rbd-fuse-19.0.0-3568.g165a15e5.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-09T05:01:19.239 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): librgw2-19.0.0-3568.g165a15e5.el9.x86 1.5 MB/s | 5.4 MB 00:03 2024-05-09T05:01:19.281 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephfs-top-19.0.0-3568.g165a15e5.el9. 122 kB/s | 18 kB 00:00 2024-05-09T05:01:19.340 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): cephadm-19.0.0-3568.g165a15e5.el9.noa 1.9 MB/s | 764 kB 00:00 2024-05-09T05:01:19.365 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 643 kB/s | 80 kB 00:00 2024-05-09T05:01:19.427 INFO:teuthology.orchestra.run.smithi133.stdout:(26/156): librgw2-19.0.0-3568.g165a15e5.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-05-09T05:01:19.449 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-05-09T05:01:19.482 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-09T05:01:19.511 INFO:teuthology.orchestra.run.smithi133.stdout:(27/156): rbd-nbd-19.0.0-3568.g165a15e5.el9.x86 2.0 MB/s | 171 kB 00:00 2024-05-09T05:01:19.516 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-05-09T05:01:19.574 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-05-09T05:01:19.586 INFO:teuthology.orchestra.run.smithi133.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3568.g 462 kB/s | 34 kB 00:00 2024-05-09T05:01:19.600 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-09T05:01:19.659 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-05-09T05:01:19.701 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-05-09T05:01:19.734 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-05-09T05:01:19.868 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-05-09T05:01:19.886 INFO:teuthology.orchestra.run.smithi133.stdout:(29/156): rbd-mirror-19.0.0-3568.g165a15e5.el9. 4.6 MB/s | 3.1 MB 00:00 2024-05-09T05:01:19.893 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 678 kB/s | 107 kB 00:00 2024-05-09T05:01:19.918 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 435 kB/s | 21 kB 00:00 2024-05-09T05:01:19.953 INFO:teuthology.orchestra.run.smithi133.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3568.g165a15e 389 kB/s | 142 kB 00:00 2024-05-09T05:01:19.969 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 664 kB/s | 33 kB 00:00 2024-05-09T05:01:20.019 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-05-09T05:01:20.053 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-05-09T05:01:20.078 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 315 kB/s | 18 kB 00:00 2024-05-09T05:01:20.103 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 225 kB/s | 11 kB 00:00 2024-05-09T05:01:20.154 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-09T05:01:20.171 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 686 kB/s | 45 kB 00:00 2024-05-09T05:01:20.238 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-05-09T05:01:20.279 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 582 kB 00:00 2024-05-09T05:01:20.305 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 385 kB/s | 25 kB 00:00 2024-05-09T05:01:20.330 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 954 kB/s | 47 kB 00:00 2024-05-09T05:01:20.364 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-09T05:01:20.397 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-05-09T05:01:20.423 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 609 kB/s | 35 kB 00:00 2024-05-09T05:01:20.506 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.6 MB/s | 3.0 MB 00:00 2024-05-09T05:01:20.615 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-09T05:01:20.732 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-05-09T05:01:20.832 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-09T05:01:20.866 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-09T05:01:20.887 INFO:teuthology.orchestra.run.smithi133.stdout:(31/156): ceph-test-19.0.0-3568.g165a15e5.el9.x 9.5 MB/s | 49 MB 00:05 2024-05-09T05:01:20.916 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 3.0 MB/s | 911 kB 00:00 2024-05-09T05:01:21.000 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-05-09T05:01:21.012 INFO:teuthology.orchestra.run.smithi133.stdout:(32/156): ceph-mgr-dashboard-19.0.0-3568.g165a1 3.1 MB/s | 3.5 MB 00:01 2024-05-09T05:01:21.045 INFO:teuthology.orchestra.run.smithi133.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3568.g16 1.7 MB/s | 274 kB 00:00 2024-05-09T05:01:21.079 INFO:teuthology.orchestra.run.smithi133.stdout:(34/156): ceph-mgr-rook-19.0.0-3568.g165a15e5.e 749 kB/s | 49 kB 00:00 2024-05-09T05:01:21.105 INFO:teuthology.orchestra.run.smithi133.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3568.g1 284 kB/s | 16 kB 00:00 2024-05-09T05:01:21.108 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 457 kB/s | 87 kB 00:00 2024-05-09T05:01:21.167 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-05-09T05:01:21.222 INFO:teuthology.orchestra.run.smithi133.stdout:(36/156): cephadm-19.0.0-3568.g165a15e5.el9.noa 6.4 MB/s | 764 kB 00:00 2024-05-09T05:01:21.247 INFO:teuthology.orchestra.run.smithi133.stdout:(37/156): ceph-volume-19.0.0-3568.g165a15e5.el9 1.6 MB/s | 273 kB 00:00 2024-05-09T05:01:21.259 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-05-09T05:01:21.272 INFO:teuthology.orchestra.run.smithi133.stdout:(38/156): cephfs-top-19.0.0-3568.g165a15e5.el9. 369 kB/s | 18 kB 00:00 2024-05-09T05:01:21.360 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-09T05:01:21.385 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-05-09T05:01:21.410 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 392 kB/s | 19 kB 00:00 2024-05-09T05:01:21.422 INFO:teuthology.orchestra.run.smithi133.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 462 kB/s | 80 kB 00:00 2024-05-09T05:01:21.519 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): postgresql-server-13.14-1.el9.x86_64. 8.4 MB/s | 5.8 MB 00:00 2024-05-09T05:01:21.539 INFO:teuthology.orchestra.run.smithi133.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-05-09T05:01:21.545 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 261 kB/s | 35 kB 00:00 2024-05-09T05:01:21.565 INFO:teuthology.orchestra.run.smithi133.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-05-09T05:01:21.569 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 938 kB/s | 172 kB 00:00 2024-05-09T05:01:21.603 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-09T05:01:21.637 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-09T05:01:21.654 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-09T05:01:21.687 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 856 kB/s | 42 kB 00:00 2024-05-09T05:01:21.698 INFO:teuthology.orchestra.run.smithi133.stdout:(42/156): ceph-mgr-diskprediction-local-19.0.0- 4.2 MB/s | 7.4 MB 00:01 2024-05-09T05:01:21.729 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-05-09T05:01:21.732 INFO:teuthology.orchestra.run.smithi133.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-09T05:01:21.763 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-09T05:01:21.790 INFO:teuthology.orchestra.run.smithi133.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 5.5 MB/s | 1.2 MB 00:00 2024-05-09T05:01:21.816 INFO:teuthology.orchestra.run.smithi133.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-09T05:01:21.830 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-05-09T05:01:21.849 INFO:teuthology.orchestra.run.smithi133.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-09T05:01:21.855 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 559 kB/s | 51 kB 00:00 2024-05-09T05:01:21.874 INFO:teuthology.orchestra.run.smithi133.stdout:(47/156): python3-ply-3.11-14.el9.noarch.rpm 609 kB/s | 106 kB 00:00 2024-05-09T05:01:21.897 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 812 kB/s | 54 kB 00:00 2024-05-09T05:01:21.908 INFO:teuthology.orchestra.run.smithi133.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-05-09T05:01:21.948 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 847 kB/s | 42 kB 00:00 2024-05-09T05:01:22.056 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.5 MB/s | 5.1 MB 00:00 2024-05-09T05:01:22.081 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 333 kB/s | 44 kB 00:00 2024-05-09T05:01:22.115 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-09T05:01:22.140 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 621 kB/s | 36 kB 00:00 2024-05-09T05:01:22.166 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 963 kB/s | 47 kB 00:00 2024-05-09T05:01:22.199 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-05-09T05:01:22.225 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-09T05:01:22.250 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-09T05:01:22.275 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-05-09T05:01:22.300 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-05-09T05:01:22.325 INFO:teuthology.orchestra.run.smithi133.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 257 kB/s | 107 kB 00:00 2024-05-09T05:01:22.442 INFO:teuthology.orchestra.run.smithi133.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 185 kB/s | 21 kB 00:00 2024-05-09T05:01:22.609 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-05-09T05:01:22.634 INFO:teuthology.orchestra.run.smithi133.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 879 kB/s | 689 kB 00:00 2024-05-09T05:01:22.751 INFO:teuthology.orchestra.run.smithi133.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-05-09T05:01:22.776 INFO:teuthology.orchestra.run.smithi133.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-05-09T05:01:22.810 INFO:teuthology.orchestra.run.smithi133.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 855 kB/s | 313 kB 00:00 2024-05-09T05:01:22.885 INFO:teuthology.orchestra.run.smithi133.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-05-09T05:01:22.910 INFO:teuthology.orchestra.run.smithi133.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 11 kB 00:00 2024-05-09T05:01:22.994 INFO:teuthology.orchestra.run.smithi133.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-05-09T05:01:23.019 INFO:teuthology.orchestra.run.smithi133.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 419 kB/s | 45 kB 00:00 2024-05-09T05:01:23.076 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-05-09T05:01:23.118 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 26 kB/s | 22 kB 00:00 2024-05-09T05:01:23.152 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 4.1 MB/s | 309 kB 00:00 2024-05-09T05:01:23.185 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 315 kB/s | 19 kB 00:00 2024-05-09T05:01:23.219 INFO:teuthology.orchestra.run.smithi133.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-05-09T05:01:23.303 INFO:teuthology.orchestra.run.smithi133.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.4 MB/s | 3.0 MB 00:00 2024-05-09T05:01:23.311 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 209 kB/s | 26 kB 00:00 2024-05-09T05:01:23.328 INFO:teuthology.orchestra.run.smithi133.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 236 kB/s | 25 kB 00:00 2024-05-09T05:01:23.370 INFO:teuthology.orchestra.run.smithi133.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 1.6 MB/s | 582 kB 00:00 2024-05-09T05:01:23.412 INFO:teuthology.orchestra.run.smithi133.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 439 kB/s | 47 kB 00:00 2024-05-09T05:01:23.428 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-09T05:01:23.446 INFO:teuthology.orchestra.run.smithi133.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-05-09T05:01:23.475 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 322 kB/s | 49 kB 00:00 2024-05-09T05:01:23.480 INFO:teuthology.orchestra.run.smithi133.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-09T05:01:23.503 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 912 kB/s | 67 kB 00:00 2024-05-09T05:01:23.522 INFO:teuthology.orchestra.run.smithi133.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-05-09T05:01:23.562 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2024-05-09T05:01:23.612 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-05-09T05:01:23.680 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 627 kB/s | 863 kB 00:01 2024-05-09T05:01:23.680 INFO:teuthology.orchestra.run.smithi133.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-09T05:01:23.721 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-05-09T05:01:23.746 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 327 kB/s | 43 kB 00:00 2024-05-09T05:01:23.813 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 355 kB/s | 32 kB 00:00 2024-05-09T05:01:23.838 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 130 kB/s | 15 kB 00:00 2024-05-09T05:01:23.872 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-05-09T05:01:23.914 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.8 MB/s | 358 kB 00:00 2024-05-09T05:01:23.948 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.8 MB/s | 303 kB 00:00 2024-05-09T05:01:23.973 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-05-09T05:01:24.006 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.3 MB/s | 206 kB 00:00 2024-05-09T05:01:24.157 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-09T05:01:24.182 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 703 kB/s | 144 kB 00:00 2024-05-09T05:01:24.207 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 53 kB/s | 11 kB 00:00 2024-05-09T05:01:24.224 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 268 kB/s | 18 kB 00:00 2024-05-09T05:01:24.266 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 404 kB/s | 23 kB 00:00 2024-05-09T05:01:24.316 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 181 kB/s | 19 kB 00:00 2024-05-09T05:01:24.333 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-05-09T05:01:24.392 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-05-09T05:01:24.417 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 641 kB/s | 46 kB 00:00 2024-05-09T05:01:24.442 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 810 kB/s | 79 kB 00:00 2024-05-09T05:01:24.467 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 787 kB/s | 58 kB 00:00 2024-05-09T05:01:24.526 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-09T05:01:24.552 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 153 kB/s | 16 kB 00:00 2024-05-09T05:01:24.577 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 828 kB/s | 90 kB 00:00 2024-05-09T05:01:24.761 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 121 kB/s | 28 kB 00:00 2024-05-09T05:01:24.786 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 148 kB/s | 31 kB 00:00 2024-05-09T05:01:24.819 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 782 kB/s | 188 kB 00:00 2024-05-09T05:01:24.853 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 917 kB/s | 59 kB 00:00 2024-05-09T05:01:24.878 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 399 kB/s | 36 kB 00:00 2024-05-09T05:01:24.903 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 612 kB/s | 51 kB 00:00 2024-05-09T05:01:24.922 INFO:teuthology.orchestra.run.smithi133.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 734 kB/s | 911 kB 00:01 2024-05-09T05:01:24.937 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-09T05:01:24.962 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-09T05:01:24.996 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.7 MB/s | 427 kB 00:00 2024-05-09T05:01:25.021 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2024-05-09T05:01:25.034 INFO:teuthology.orchestra.run.smithi133.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-05-09T05:01:25.055 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.1 MB/s | 192 kB 00:00 2024-05-09T05:01:25.222 INFO:teuthology.orchestra.run.smithi133.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 445 kB/s | 133 kB 00:00 2024-05-09T05:01:25.305 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-05-09T05:01:25.397 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): librados2-19.0.0-3568.g165a15e5.el9. 9.1 MB/s | 3.4 MB 00:00 2024-05-09T05:01:25.564 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 9.0 MB/s | 2.3 MB 00:00 2024-05-09T05:01:25.614 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-libnm-1.47.5-1.el9.x8 8.5 MB/s | 1.8 MB 00:00 2024-05-09T05:01:25.665 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-team-1.47.5-1.el9.x86 420 kB/s | 42 kB 00:00 2024-05-09T05:01:25.715 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.4 MB/s | 248 kB 00:00 2024-05-09T05:01:25.832 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 2024-05-09T05:01:25.915 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-09T05:01:26.324 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): librbd1-19.0.0-3568.g165a15e5.el9.x8 2.5 MB/s | 3.1 MB 00:01 2024-05-09T05:01:26.334 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:01:26.334 INFO:teuthology.orchestra.run.smithi100.stdout:Total 13 MB/s | 226 MB 00:17 2024-05-09T05:01:26.647 INFO:teuthology.orchestra.run.smithi133.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 725 kB/s | 1.0 MB 00:01 2024-05-09T05:01:26.773 INFO:teuthology.orchestra.run.smithi133.stdout:(72/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.4 MB/s | 4.7 MB 00:03 2024-05-09T05:01:26.873 INFO:teuthology.orchestra.run.smithi133.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 390 kB/s | 87 kB 00:00 2024-05-09T05:01:27.465 INFO:teuthology.orchestra.run.smithi133.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 413 kB/s | 244 kB 00:00 2024-05-09T05:01:27.657 INFO:teuthology.orchestra.run.smithi133.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-05-09T05:01:27.766 INFO:teuthology.orchestra.run.smithi133.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-05-09T05:01:27.874 INFO:teuthology.orchestra.run.smithi133.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 178 kB/s | 19 kB 00:00 2024-05-09T05:01:27.983 INFO:teuthology.orchestra.run.smithi133.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-05-09T05:01:28.092 INFO:teuthology.orchestra.run.smithi133.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 323 kB/s | 35 kB 00:00 2024-05-09T05:01:29.141 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-05-09T05:01:29.380 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-05-09T05:01:29.380 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-05-09T05:01:31.991 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-05-09T05:01:31.991 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-05-09T05:01:32.750 INFO:teuthology.orchestra.run.smithi133.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.0 MB/s | 6.0 MB 00:05 2024-05-09T05:01:32.858 INFO:teuthology.orchestra.run.smithi133.stdout:(81/156): postgresql-server-13.14-1.el9.x86_64. 756 kB/s | 5.8 MB 00:07 2024-05-09T05:01:32.958 INFO:teuthology.orchestra.run.smithi133.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:04 2024-05-09T05:01:33.000 INFO:teuthology.orchestra.run.smithi133.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 250 kB 00:00 2024-05-09T05:01:33.109 INFO:teuthology.orchestra.run.smithi133.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 392 kB/s | 42 kB 00:00 2024-05-09T05:01:33.142 INFO:teuthology.orchestra.run.smithi133.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 422 kB/s | 77 kB 00:00 2024-05-09T05:01:33.218 INFO:teuthology.orchestra.run.smithi133.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-05-09T05:01:33.243 INFO:teuthology.orchestra.run.smithi133.stdout:(87/156): python3-oauthlib-3.1.1-5.el9.noarch.r 579 kB/s | 222 kB 00:00 2024-05-09T05:01:33.352 INFO:teuthology.orchestra.run.smithi133.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-05-09T05:01:33.377 INFO:teuthology.orchestra.run.smithi133.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 383 kB/s | 51 kB 00:00 2024-05-09T05:01:33.460 INFO:teuthology.orchestra.run.smithi133.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 500 kB/s | 159 kB 00:00 2024-05-09T05:01:33.486 INFO:teuthology.orchestra.run.smithi133.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 403 kB/s | 54 kB 00:00 2024-05-09T05:01:33.569 INFO:teuthology.orchestra.run.smithi133.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 386 kB/s | 42 kB 00:00 2024-05-09T05:01:33.603 INFO:teuthology.orchestra.run.smithi133.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 379 kB/s | 44 kB 00:00 2024-05-09T05:01:33.712 INFO:teuthology.orchestra.run.smithi133.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 333 kB/s | 36 kB 00:00 2024-05-09T05:01:33.821 INFO:teuthology.orchestra.run.smithi133.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 440 kB/s | 47 kB 00:00 2024-05-09T05:01:33.929 INFO:teuthology.orchestra.run.smithi133.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 615 kB/s | 221 kB 00:00 2024-05-09T05:01:33.963 INFO:teuthology.orchestra.run.smithi133.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-05-09T05:01:34.038 INFO:teuthology.orchestra.run.smithi133.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 536 kB/s | 58 kB 00:00 2024-05-09T05:01:34.072 INFO:teuthology.orchestra.run.smithi133.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 868 kB/s | 94 kB 00:00 2024-05-09T05:01:34.180 INFO:teuthology.orchestra.run.smithi133.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-05-09T05:01:34.222 INFO:teuthology.orchestra.run.smithi133.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 347 kB/s | 64 kB 00:00 2024-05-09T05:01:34.297 INFO:teuthology.orchestra.run.smithi133.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 192 kB/s | 22 kB 00:00 2024-05-09T05:01:34.423 INFO:teuthology.orchestra.run.smithi133.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-05-09T05:01:35.532 INFO:teuthology.orchestra.run.smithi133.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 279 kB/s | 309 kB 00:01 2024-05-09T05:01:35.656 INFO:teuthology.orchestra.run.smithi133.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 157 kB/s | 19 kB 00:00 2024-05-09T05:01:36.082 INFO:teuthology.orchestra.run.smithi133.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 307 kB/s | 548 kB 00:01 2024-05-09T05:01:36.198 INFO:teuthology.orchestra.run.smithi133.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-05-09T05:01:36.417 INFO:teuthology.orchestra.run.smithi133.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 223 kB/s | 49 kB 00:00 2024-05-09T05:01:36.632 INFO:teuthology.orchestra.run.smithi133.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 314 kB/s | 67 kB 00:00 2024-05-09T05:01:37.016 INFO:teuthology.orchestra.run.smithi133.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 395 kB/s | 151 kB 00:00 2024-05-09T05:01:38.386 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-05-09T05:01:38.517 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T05:01:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T05:01:38.741 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T05:01:38.805 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T05:01:38.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T05:01:38.849 INFO:teuthology.orchestra.run.smithi133.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 458 kB/s | 839 kB 00:01 2024-05-09T05:01:38.938 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T05:01:39.362 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T05:01:39.472 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 8/164 2024-05-09T05:01:39.650 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 8/164 2024-05-09T05:01:39.682 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 9/164 2024-05-09T05:01:39.809 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 9/164 2024-05-09T05:01:39.847 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-3568.g165a15e5.el9.x86_64 10/164 2024-05-09T05:01:39.974 INFO:teuthology.orchestra.run.smithi133.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 488 kB/s | 548 kB 00:01 2024-05-09T05:01:40.108 INFO:teuthology.orchestra.run.smithi133.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 327 kB/s | 43 kB 00:00 2024-05-09T05:01:40.142 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T05:01:40.220 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T05:01:40.225 INFO:teuthology.orchestra.run.smithi133.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 277 kB/s | 32 kB 00:00 2024-05-09T05:01:40.244 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 13/164 2024-05-09T05:01:40.342 INFO:teuthology.orchestra.run.smithi133.stdout:(115/156): python3-certifi-2021.10.8-2.el9.noar 129 kB/s | 15 kB 00:00 2024-05-09T05:01:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 13/164 2024-05-09T05:01:40.429 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86 14/164 2024-05-09T05:01:40.515 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86 14/164 2024-05-09T05:01:40.538 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:01:40.612 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:01:40.734 INFO:teuthology.orchestra.run.smithi133.stdout:(116/156): python3-cheroot-8.6.0-4.el9.noarch.r 439 kB/s | 172 kB 00:00 2024-05-09T05:01:40.916 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:01:41.279 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:01:41.445 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:01:41.484 INFO:teuthology.orchestra.run.smithi133.stdout:(117/156): python3-cherrypy-18.6.1-2.el9.noarch 478 kB/s | 358 kB 00:00 2024-05-09T05:01:41.533 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:01:41.727 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:01:41.857 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:01:42.059 INFO:teuthology.orchestra.run.smithi133.stdout:(118/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 528 kB/s | 303 kB 00:00 2024-05-09T05:01:42.176 INFO:teuthology.orchestra.run.smithi133.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 304 kB/s | 35 kB 00:00 2024-05-09T05:01:42.193 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:01:42.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T05:01:42.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T05:01:42.495 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T05:01:42.569 INFO:teuthology.orchestra.run.smithi133.stdout:(120/156): python3-google-auth-2.29.0-1.el9.noa 525 kB/s | 206 kB 00:00 2024-05-09T05:01:42.634 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T05:01:42.685 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T05:01:42.759 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T05:01:42.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T05:01:42.836 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T05:01:42.950 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T05:01:43.014 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T05:01:43.054 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T05:01:43.107 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T05:01:43.220 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T05:01:43.258 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-3568.g165a15e5.el9. 32/164 2024-05-09T05:01:43.303 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-3568.g165a15e5.el 33/164 2024-05-09T05:01:43.331 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-3568.g165a15e5.el9.x86_6 34/164 2024-05-09T05:01:43.436 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T05:01:43.493 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T05:01:43.594 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T05:01:43.776 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T05:01:43.839 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T05:01:43.953 INFO:teuthology.orchestra.run.smithi133.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 545 kB/s | 4.4 MB 00:08 2024-05-09T05:01:44.261 INFO:teuthology.orchestra.run.smithi133.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 470 kB/s | 144 kB 00:00 2024-05-09T05:01:44.378 INFO:teuthology.orchestra.run.smithi133.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-05-09T05:01:44.494 INFO:teuthology.orchestra.run.smithi133.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-05-09T05:01:44.546 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T05:01:44.611 INFO:teuthology.orchestra.run.smithi133.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-05-09T05:01:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T05:01:44.680 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T05:01:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T05:01:44.728 INFO:teuthology.orchestra.run.smithi133.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2024-05-09T05:01:44.766 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-3568.g165a15e5.el9.x86_6 44/164 2024-05-09T05:01:44.833 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T05:01:44.845 INFO:teuthology.orchestra.run.smithi133.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-05-09T05:01:45.044 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T05:01:45.136 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T05:01:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T05:01:45.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T05:01:45.412 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T05:01:45.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T05:01:45.497 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T05:01:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T05:01:45.606 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T05:01:45.667 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T05:01:45.727 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T05:01:45.924 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T05:01:45.929 INFO:teuthology.orchestra.run.smithi133.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 621 kB/s | 2.0 MB 00:03 2024-05-09T05:01:45.979 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T05:01:46.034 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T05:01:46.046 INFO:teuthology.orchestra.run.smithi133.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 400 kB/s | 46 kB 00:00 2024-05-09T05:01:46.086 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T05:01:46.232 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T05:01:46.255 INFO:teuthology.orchestra.run.smithi133.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 379 kB/s | 79 kB 00:00 2024-05-09T05:01:46.284 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T05:01:46.332 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T05:01:46.338 INFO:teuthology.orchestra.run.smithi133.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 701 kB/s | 1.0 MB 00:01 2024-05-09T05:01:46.366 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T05:01:46.372 INFO:teuthology.orchestra.run.smithi133.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 497 kB/s | 58 kB 00:00 2024-05-09T05:01:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T05:01:46.489 INFO:teuthology.orchestra.run.smithi133.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-05-09T05:01:46.573 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T05:01:46.706 INFO:teuthology.orchestra.run.smithi133.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 416 kB/s | 90 kB 00:00 2024-05-09T05:01:46.739 INFO:teuthology.orchestra.run.smithi133.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 681 kB/s | 272 kB 00:00 2024-05-09T05:01:46.751 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T05:01:46.796 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T05:01:46.823 INFO:teuthology.orchestra.run.smithi133.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 243 kB/s | 28 kB 00:00 2024-05-09T05:01:46.834 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T05:01:46.857 INFO:teuthology.orchestra.run.smithi133.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 265 kB/s | 31 kB 00:00 2024-05-09T05:01:46.880 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T05:01:46.947 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T05:01:46.973 INFO:teuthology.orchestra.run.smithi133.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 509 kB/s | 59 kB 00:00 2024-05-09T05:01:47.000 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T05:01:47.041 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T05:01:47.087 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T05:01:47.090 INFO:teuthology.orchestra.run.smithi133.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2024-05-09T05:01:47.136 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T05:01:47.140 INFO:teuthology.orchestra.run.smithi133.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 595 kB/s | 188 kB 00:00 2024-05-09T05:01:47.203 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T05:01:47.208 INFO:teuthology.orchestra.run.smithi133.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 438 kB/s | 51 kB 00:00 2024-05-09T05:01:47.244 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T05:01:47.386 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T05:01:47.425 INFO:teuthology.orchestra.run.smithi133.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 415 kB/s | 90 kB 00:00 2024-05-09T05:01:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T05:01:47.501 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T05:01:47.550 INFO:teuthology.orchestra.run.smithi133.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 562 kB/s | 230 kB 00:00 2024-05-09T05:01:47.572 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T05:01:47.700 INFO:teuthology.orchestra.run.smithi133.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 134 kB/s | 20 kB 00:00 2024-05-09T05:01:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T05:01:48.025 INFO:teuthology.orchestra.run.smithi133.stdout:(145/156): re2-20211101-3.el9.x86_64.rpm 591 kB/s | 192 kB 00:00 2024-05-09T05:01:48.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T05:01:48.134 INFO:teuthology.orchestra.run.smithi133.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 603 kB/s | 427 kB 00:00 2024-05-09T05:01:48.476 INFO:teuthology.orchestra.run.smithi133.stdout:(147/156): librados2-19.0.0-3568.g165a15e5.el9. 10 MB/s | 3.4 MB 00:00 2024-05-09T05:01:48.727 INFO:teuthology.orchestra.run.smithi133.stdout:(148/156): librbd1-19.0.0-3568.g165a15e5.el9.x8 13 MB/s | 3.1 MB 00:00 2024-05-09T05:01:49.037 INFO:teuthology.orchestra.run.smithi133.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 7.5 MB/s | 2.3 MB 00:00 2024-05-09T05:01:49.050 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T05:01:49.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T05:01:49.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T05:01:49.252 INFO:teuthology.orchestra.run.smithi133.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 8.5 MB/s | 1.8 MB 00:00 2024-05-09T05:01:49.262 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T05:01:49.311 INFO:teuthology.orchestra.run.smithi133.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 727 kB/s | 42 kB 00:00 2024-05-09T05:01:49.325 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T05:01:49.369 INFO:teuthology.orchestra.run.smithi133.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-09T05:01:49.422 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T05:01:49.457 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T05:01:49.470 INFO:teuthology.orchestra.run.smithi133.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 14 MB/s | 1.3 MB 00:00 2024-05-09T05:01:49.688 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T05:01:49.713 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T05:01:49.821 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T05:01:50.666 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T05:01:50.819 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T05:01:51.712 INFO:teuthology.orchestra.run.smithi133.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.1 MB/s | 2.4 MB 00:02 2024-05-09T05:01:52.465 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T05:01:52.595 INFO:teuthology.orchestra.run.smithi133.stdout:(155/156): thrift-0.15.0-2.el9.x86_64.rpm 355 kB/s | 1.6 MB 00:04 2024-05-09T05:01:52.607 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T05:01:52.649 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T05:01:52.694 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T05:01:53.068 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T05:01:53.107 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 101/164 2024-05-09T05:01:53.220 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 101/164 2024-05-09T05:01:53.255 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-3568.g165a15e5.el9.x86_64 102/164 2024-05-09T05:01:53.319 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T05:01:53.882 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T05:01:53.918 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 105/164 2024-05-09T05:01:54.011 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 105/164 2024-05-09T05:01:54.037 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-3568.g165a15e5.el9.x86_64 106/164 2024-05-09T05:01:55.478 INFO:teuthology.orchestra.run.smithi133.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 753 kB/s | 16 MB 00:22 2024-05-09T05:01:55.483 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:01:55.483 INFO:teuthology.orchestra.run.smithi133.stdout:Total 4.8 MB/s | 226 MB 00:47 2024-05-09T05:01:56.663 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 107/164 2024-05-09T05:01:56.708 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 107/164 2024-05-09T05:01:57.336 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 107/164 2024-05-09T05:01:57.387 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 108/164 2024-05-09T05:01:57.533 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 108/164 2024-05-09T05:01:57.533 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T05:01:57.533 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T05:01:57.533 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:01:57.597 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 109/164 2024-05-09T05:01:58.598 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-05-09T05:01:58.840 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-05-09T05:01:58.841 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-05-09T05:02:01.492 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-05-09T05:02:01.493 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-05-09T05:02:07.888 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-05-09T05:02:07.978 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T05:02:08.041 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T05:02:08.138 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T05:02:08.194 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T05:02:08.247 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T05:02:08.358 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T05:02:08.792 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T05:02:08.900 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 8/164 2024-05-09T05:02:09.080 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 8/164 2024-05-09T05:02:09.110 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 9/164 2024-05-09T05:02:09.255 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 9/164 2024-05-09T05:02:09.292 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:19.0.0-3568.g165a15e5.el9.x86_64 10/164 2024-05-09T05:02:09.598 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T05:02:09.664 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T05:02:09.689 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 13/164 2024-05-09T05:02:09.836 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 13/164 2024-05-09T05:02:09.865 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86 14/164 2024-05-09T05:02:09.951 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86 14/164 2024-05-09T05:02:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:02:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:02:10.323 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 109/164 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-05-09T05:02:10.324 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:10.438 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:02:10.590 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 110/164 2024-05-09T05:02:10.638 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 110/164 2024-05-09T05:02:10.638 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:10.638 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T05:02:10.638 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:10.777 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:02:10.947 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:02:11.068 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:02:11.258 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:02:11.367 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:02:11.711 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:02:11.896 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T05:02:11.931 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T05:02:11.983 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T05:02:12.097 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T05:02:12.152 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T05:02:12.216 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T05:02:12.258 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 111/164 2024-05-09T05:02:12.264 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T05:02:12.304 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T05:02:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 111/164 2024-05-09T05:02:12.347 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:12.347 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T05:02:12.347 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:02:12.347 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:02:12.347 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:12.419 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T05:02:12.492 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T05:02:12.531 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T05:02:12.587 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T05:02:12.600 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 112/164 2024-05-09T05:02:12.675 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 112/164 2024-05-09T05:02:12.675 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:12.675 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T05:02:12.675 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:02:12.675 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:02:12.675 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:12.694 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T05:02:12.735 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:19.0.0-3568.g165a15e5.el9. 32/164 2024-05-09T05:02:12.785 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:19.0.0-3568.g165a15e5.el 33/164 2024-05-09T05:02:12.814 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:19.0.0-3568.g165a15e5.el9.x86_6 34/164 2024-05-09T05:02:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T05:02:12.986 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T05:02:13.110 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T05:02:13.167 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 113/164 2024-05-09T05:02:13.243 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 113/164 2024-05-09T05:02:13.243 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:13.243 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T05:02:13.243 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:02:13.243 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:02:13.243 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:13.297 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T05:02:13.373 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T05:02:13.376 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T05:02:13.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T05:02:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T05:02:13.766 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T05:02:13.850 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T05:02:13.945 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T05:02:14.043 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T05:02:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T05:02:14.144 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T05:02:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T05:02:14.233 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T05:02:14.244 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T05:02:14.284 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:19.0.0-3568.g165a15e5.el9.x86_6 44/164 2024-05-09T05:02:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T05:02:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T05:02:14.344 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T05:02:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T05:02:14.549 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T05:02:14.616 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T05:02:14.729 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T05:02:14.810 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T05:02:14.894 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T05:02:14.942 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T05:02:14.997 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T05:02:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 125/164 2024-05-09T05:02:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 125/164 2024-05-09T05:02:15.066 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T05:02:15.107 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T05:02:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3568.g165a15e5.e 126/164 2024-05-09T05:02:15.168 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T05:02:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3568.g165a15e5. 127/164 2024-05-09T05:02:15.226 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T05:02:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noa 128/164 2024-05-09T05:02:15.422 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T05:02:15.471 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T05:02:15.508 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T05:02:15.556 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T05:02:15.683 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T05:02:15.725 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T05:02:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T05:02:15.806 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T05:02:15.851 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T05:02:16.041 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T05:02:16.219 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T05:02:16.263 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T05:02:16.301 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T05:02:16.348 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T05:02:16.414 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T05:02:16.466 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T05:02:16.508 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T05:02:16.553 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T05:02:16.557 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noa 128/164 2024-05-09T05:02:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.n 129/164 2024-05-09T05:02:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T05:02:16.670 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T05:02:16.719 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T05:02:16.859 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T05:02:16.922 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T05:02:16.975 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T05:02:17.053 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T05:02:17.201 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T05:02:17.263 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T05:02:17.694 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.n 129/164 2024-05-09T05:02:17.727 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3568.g165 130/164 2024-05-09T05:02:17.882 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3568.g165 130/164 2024-05-09T05:02:18.056 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3568.g165a15e5.el 131/164 2024-05-09T05:02:18.087 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 132/164 2024-05-09T05:02:18.162 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 132/164 2024-05-09T05:02:18.162 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:18.162 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T05:02:18.163 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:02:18.163 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:02:18.163 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:18.200 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T05:02:18.221 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 133/164 2024-05-09T05:02:18.254 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T05:02:18.257 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 133/164 2024-05-09T05:02:18.287 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T05:02:18.373 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-3568.g165a15e5.el9.x86_64 134/164 2024-05-09T05:02:18.408 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T05:02:18.442 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 135/164 2024-05-09T05:02:18.473 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T05:02:18.567 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T05:02:18.614 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T05:02:18.847 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T05:02:18.877 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T05:02:18.981 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T05:02:19.442 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T05:02:19.474 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 137/164 2024-05-09T05:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 137/164 2024-05-09T05:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T05:02:19.534 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:02:19.535 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:02:19.535 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:19.607 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3568.g165a1 138/164 2024-05-09T05:02:19.693 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3568.g165a1 138/164 2024-05-09T05:02:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:19.693 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T05:02:19.693 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:19.775 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 139/164 2024-05-09T05:02:19.801 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T05:02:19.873 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 139/164 2024-05-09T05:02:19.874 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:19.874 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T05:02:19.874 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:02:19.874 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:02:19.874 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:19.949 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T05:02:20.250 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 140/164 2024-05-09T05:02:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 140/164 2024-05-09T05:02:20.339 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:20.339 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T05:02:20.339 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:02:20.339 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:02:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:21.556 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T05:02:21.689 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T05:02:21.727 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T05:02:21.762 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T05:02:22.131 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T05:02:22.171 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 101/164 2024-05-09T05:02:22.325 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 101/164 2024-05-09T05:02:22.360 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:19.0.0-3568.g165a15e5.el9.x86_64 102/164 2024-05-09T05:02:22.418 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T05:02:22.957 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T05:02:22.991 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 105/164 2024-05-09T05:02:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 105/164 2024-05-09T05:02:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:19.0.0-3568.g165a15e5.el9.x86_64 106/164 2024-05-09T05:02:25.359 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-3568.g165a15e5.el9.x86_64 141/164 2024-05-09T05:02:25.416 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 142/164 2024-05-09T05:02:25.478 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-3568.g165a15e5.el9.x86_64 143/164 2024-05-09T05:02:25.525 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T05:02:25.590 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T05:02:25.865 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 107/164 2024-05-09T05:02:25.906 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 107/164 2024-05-09T05:02:25.907 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.0.0-3568.g165a15e5.el9.x86_64 146/164 2024-05-09T05:02:25.963 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T05:02:25.995 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-3568.g165a15e5.el9.x86_ 148/164 2024-05-09T05:02:26.041 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T05:02:26.094 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T05:02:26.540 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 107/164 2024-05-09T05:02:26.585 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 108/164 2024-05-09T05:02:26.741 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 108/164 2024-05-09T05:02:26.741 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T05:02:26.742 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T05:02:26.742 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:26.777 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 109/164 2024-05-09T05:02:26.934 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:02:26.990 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:02:27.055 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:02:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-3568.g165a15e5.el9.noarch 152/164 2024-05-09T05:02:28.530 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T05:02:28.605 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T05:02:28.757 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T05:02:28.826 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T05:02:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T05:02:28.870 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:02:28.997 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:02:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T05:02:29.044 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:02:29.181 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:02:29.219 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T05:02:29.252 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:02:29.253 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:02:29.565 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:02:29.566 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:02:29.737 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:02:29.876 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:02:30.143 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:02:30.143 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-09T05:02:30.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-3568.g165a15e5.el9.x86_64 1/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 2/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 3/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 4/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3568.g165a1 5/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 6/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 7/164 2024-05-09T05:02:35.922 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 8/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 9/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 10/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 11/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-3568.g165a15e5.el9.x86_64 12/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 13/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.0.0-3568.g165a15e5.el9.x86_64 14/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-3568.g165a15e5.el9.x86_ 15/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 16/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 17/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-3568.g165a15e5.el9.x86_6 18/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86 19/164 2024-05-09T05:02:35.923 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 20/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3568.g165a15e5.el 21/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-3568.g165a15e5.el9. 22/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-3568.g165a15e5.el9.x86_6 23/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-3568.g165a15e5.el9.x86_64 24/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-3568.g165a15e5.el9.x86_64 25/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-3568.g165a15e5.el9.x86_64 26/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 27/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 28/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-3568.g165a15e5.el9.x86_64 29/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3568.g165a15e5. 30/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noa 31/164 2024-05-09T05:02:35.924 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.n 32/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3568.g165 33/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3568.g165a15e5.el 34/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 35/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3568.g165a15e5.e 36/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 37/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 38/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-3568.g165a15e5.el9.noarch 39/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T05:02:35.925 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T05:02:35.926 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T05:02:35.927 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T05:02:35.928 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T05:02:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T05:02:35.930 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T05:02:35.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T05:02:35.932 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T05:02:35.933 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T05:02:35.934 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T05:02:35.935 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 149/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 151/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T05:02:35.936 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T05:02:35.937 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T05:02:35.937 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T05:02:35.937 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T05:02:35.937 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T05:02:38.135 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:02:38.135 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:38.135 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-05-09T05:02:38.135 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T05:02:38.135 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.136 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.137 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T05:02:38.138 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T05:02:38.139 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T05:02:38.140 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T05:02:38.141 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T05:02:38.142 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T05:02:38.143 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T05:02:38.144 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.145 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T05:02:38.146 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T05:02:38.147 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T05:02:38.148 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T05:02:38.148 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:02:38.148 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-05-09T05:02:38.732 DEBUG:teuthology.parallel:result is None 2024-05-09T05:02:39.679 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 109/164 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /root 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-05-09T05:02:39.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:39.945 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 110/164 2024-05-09T05:02:39.994 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 110/164 2024-05-09T05:02:39.994 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:39.994 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T05:02:39.994 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:41.612 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 111/164 2024-05-09T05:02:41.690 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 111/164 2024-05-09T05:02:41.691 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:41.691 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T05:02:41.691 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:02:41.691 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:02:41.691 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:41.953 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 112/164 2024-05-09T05:02:42.021 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 112/164 2024-05-09T05:02:42.021 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:42.021 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T05:02:42.022 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:02:42.022 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:02:42.022 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:42.512 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 113/164 2024-05-09T05:02:42.580 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 113/164 2024-05-09T05:02:42.580 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:42.580 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T05:02:42.580 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:02:42.580 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:02:42.580 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:42.704 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T05:02:42.764 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T05:02:42.858 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T05:02:43.104 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T05:02:43.158 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T05:02:43.244 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T05:02:43.352 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T05:02:43.529 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T05:02:43.576 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T05:02:43.615 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T05:02:43.656 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T05:02:44.325 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 125/164 2024-05-09T05:02:44.359 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 125/164 2024-05-09T05:02:44.413 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3568.g165a15e5.e 126/164 2024-05-09T05:02:44.521 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3568.g165a15e5. 127/164 2024-05-09T05:02:44.561 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noa 128/164 2024-05-09T05:02:45.877 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noa 128/164 2024-05-09T05:02:45.921 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.n 129/164 2024-05-09T05:02:47.021 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.n 129/164 2024-05-09T05:02:47.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3568.g165 130/164 2024-05-09T05:02:47.232 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3568.g165 130/164 2024-05-09T05:02:47.404 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3568.g165a15e5.el 131/164 2024-05-09T05:02:47.432 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 132/164 2024-05-09T05:02:47.505 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 132/164 2024-05-09T05:02:47.505 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:47.505 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T05:02:47.505 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:02:47.505 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:02:47.505 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:47.558 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 133/164 2024-05-09T05:02:47.595 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 133/164 2024-05-09T05:02:47.715 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:19.0.0-3568.g165a15e5.el9.x86_64 134/164 2024-05-09T05:02:47.777 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 135/164 2024-05-09T05:02:48.788 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T05:02:48.835 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 137/164 2024-05-09T05:02:48.904 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 137/164 2024-05-09T05:02:48.904 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:48.904 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T05:02:48.904 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:02:48.904 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:02:48.904 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:48.952 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3568.g165a1 138/164 2024-05-09T05:02:49.018 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3568.g165a1 138/164 2024-05-09T05:02:49.019 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:49.019 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T05:02:49.019 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:49.086 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 139/164 2024-05-09T05:02:49.158 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 139/164 2024-05-09T05:02:49.158 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:49.159 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T05:02:49.159 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:02:49.159 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:02:49.159 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:49.537 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 140/164 2024-05-09T05:02:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 140/164 2024-05-09T05:02:49.605 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:02:49.605 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T05:02:49.605 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:02:49.605 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:02:49.605 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:02:54.635 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:19.0.0-3568.g165a15e5.el9.x86_64 141/164 2024-05-09T05:02:54.691 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 142/164 2024-05-09T05:02:54.745 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:19.0.0-3568.g165a15e5.el9.x86_64 143/164 2024-05-09T05:02:54.784 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T05:02:54.822 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T05:02:55.127 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-shell-2:19.0.0-3568.g165a15e5.el9.x86_64 146/164 2024-05-09T05:02:55.181 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T05:02:55.209 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:19.0.0-3568.g165a15e5.el9.x86_ 148/164 2024-05-09T05:02:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T05:02:55.318 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T05:02:56.226 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:02:56.275 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:02:56.329 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:02:57.699 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:19.0.0-3568.g165a15e5.el9.noarch 152/164 2024-05-09T05:02:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T05:02:57.862 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T05:02:57.990 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T05:02:58.032 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T05:02:58.069 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T05:02:58.070 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:02:58.222 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:02:58.270 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T05:02:58.270 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:02:58.407 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:02:58.437 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T05:02:58.471 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:02:58.471 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:02:58.808 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:02:58.808 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:02:58.963 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:02:59.091 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:02:59.355 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:02:59.356 INFO:teuthology.orchestra.run.smithi133.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-09T05:02:59.356 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:04.967 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:19.0.0-3568.g165a15e5.el9.x86_64 1/164 2024-05-09T05:03:04.967 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 2/164 2024-05-09T05:03:04.967 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 3/164 2024-05-09T05:03:04.967 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 4/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3568.g165a1 5/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 6/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 7/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 8/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 9/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 10/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 11/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:19.0.0-3568.g165a15e5.el9.x86_64 12/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 13/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-shell-2:19.0.0-3568.g165a15e5.el9.x86_64 14/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:19.0.0-3568.g165a15e5.el9.x86_ 15/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 16/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 17/164 2024-05-09T05:03:04.968 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:19.0.0-3568.g165a15e5.el9.x86_6 18/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86 19/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 20/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3568.g165a15e5.el 21/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:19.0.0-3568.g165a15e5.el9. 22/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:19.0.0-3568.g165a15e5.el9.x86_6 23/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:19.0.0-3568.g165a15e5.el9.x86_64 24/164 2024-05-09T05:03:04.969 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:19.0.0-3568.g165a15e5.el9.x86_64 25/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:19.0.0-3568.g165a15e5.el9.x86_64 26/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 27/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 28/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:19.0.0-3568.g165a15e5.el9.x86_64 29/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3568.g165a15e5. 30/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noa 31/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.n 32/164 2024-05-09T05:03:04.982 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3568.g165 33/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3568.g165a15e5.el 34/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 35/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3568.g165a15e5.e 36/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 37/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 38/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:19.0.0-3568.g165a15e5.el9.noarch 39/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T05:03:04.983 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T05:03:04.984 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T05:03:04.985 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T05:03:04.986 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T05:03:04.987 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T05:03:04.988 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T05:03:04.989 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T05:03:04.990 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T05:03:04.991 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 149/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 151/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T05:03:04.992 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T05:03:07.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T05:03:07.163 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.164 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-shell-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.165 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:19.0.0-3568.g165a15e5.el9.noarch 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T05:03:07.167 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T05:03:07.168 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T05:03:07.169 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T05:03:07.170 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T05:03:07.171 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.172 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T05:03:07.173 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:19.0.0-3568.g165a15e5.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T05:03:07.174 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T05:03:07.175 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T05:03:07.175 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:07.175 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-05-09T05:03:07.816 DEBUG:teuthology.parallel:result is None 2024-05-09T05:03:07.816 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=165a15e51d08073b5317c443415b0d8a7141b1ab 2024-05-09T05:03:08.104 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T05:03:08.176 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-3568.g165a15e5.el9 2024-05-09T05:03:08.177 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3568.g165a15e5.el9 2024-05-09T05:03:08.177 INFO:teuthology.task.install:The correct ceph version 19.0.0-3568.g165a15e5 is installed. 2024-05-09T05:03:08.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=165a15e51d08073b5317c443415b0d8a7141b1ab 2024-05-09T05:03:08.329 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T05:03:08.381 INFO:teuthology.orchestra.run.smithi133.stdout:19.0.0-3568.g165a15e5.el9 2024-05-09T05:03:08.381 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3568.g165a15e5.el9 2024-05-09T05:03:08.381 INFO:teuthology.task.install:The correct ceph version 19.0.0-3568.g165a15e5 is installed. 2024-05-09T05:03:08.383 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T05:03:08.384 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:08.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:03:08.475 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:08.475 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:03:08.538 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T05:03:08.538 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:08.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:03:08.629 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:03:08.711 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:08.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:03:08.772 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:03:08.874 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T05:03:08.874 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:08.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:03:08.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:03:09.091 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:09.091 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:03:09.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:03:09.255 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T05:03:09.256 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:09.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:03:09.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:03:09.430 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:09.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:03:09.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:03:09.598 INFO:teuthology.run_tasks:Running task ceph... 2024-05-09T05:03:09.703 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-09T05:03:09.703 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-05-09T05:03:09.711 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-05-09T05:03:09.792 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-09T05:03:09.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T05:03:09.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-09T05:03:09.876 INFO:tasks.ceph:Creating extra log directories... 2024-05-09T05:03:09.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T05:03:09.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-09T05:03:09.968 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-09T05:03:09.969 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-09T05:03:09.969 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-09T05:03:09.969 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:09.969 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T05:03:10.022 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T05:03:10.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T05:03:10.345 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:10.346 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-09T05:03:10.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-09T05:03:10.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-09T05:03:10.665 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-09T05:03:10.665 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-09T05:03:10.665 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558', 'branch': 'wip-63259-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7699558', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-63259-3'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63259-qa-fix-1', 'sha1': 'a2e1088fa282408acd6a8a29f9417b763c0a8663'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9329, 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab', 'sleep_before_teardown': 0, 'subset': '712/1024', 'suite': 'fs', 'suite_branch': 'wip-63259-qa-fix-1', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'a2e1088fa282408acd6a8a29f9417b763c0a8663', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2nY1XbaiUWzUKpB/U6uPV1zaVAfh3QdGJQo7nK2G0YKUxgW3fGw+4QYsbWAmIiN2oJC2oh5Vubfyp8aaWc3lM=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUOyRCRaWLvY5z92z4HylL0DafRMQSUmHxWbaLbHO2Errnle1q71l67ihC0RTwjECDnxxebQfpHI0P8tNh8VTU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '165a15e51d08073b5317c443415b0d8a7141b1ab', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_backtrace']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-09_04:42:47', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-09T05:03:10.666 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T05:03:10.674 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-09T05:03:10.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T05:03:10.724 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-05-09T05:03:10.823 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:10.823 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:03:10.878 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:03:10.879 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-05-09T05:03:10.929 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:03:10.929 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:02:30.590241340 +0000 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:00:15.251303705 +0000 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:00:15.251303705 +0000 2024-05-09T05:03:10.930 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:00:15.251303705 +0000 2024-05-09T05:03:10.931 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:03:11.002 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:03:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:03:11.003 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000332268 s, 1.5 MB/s 2024-05-09T05:03:11.005 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:03:11.059 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:02:30.591241315 +0000 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:00:15.843287969 +0000 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:00:15.843287969 +0000 2024-05-09T05:03:11.109 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:00:15.843287969 +0000 2024-05-09T05:03:11.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:03:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:03:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:03:11.174 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000317426 s, 1.6 MB/s 2024-05-09T05:03:11.177 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:03:11.226 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 673 Links: 1 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:02:30.591241315 +0000 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:00:16.444271993 +0000 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:00:16.444271993 +0000 2024-05-09T05:03:11.276 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:00:16.444271993 +0000 2024-05-09T05:03:11.277 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:03:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:03:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:03:11.346 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000333244 s, 1.5 MB/s 2024-05-09T05:03:11.349 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:03:11.404 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:02:30.592241290 +0000 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:00:17.029256443 +0000 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:00:17.029256443 +0000 2024-05-09T05:03:11.454 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:00:17.029256443 +0000 2024-05-09T05:03:11.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:03:11.529 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:03:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:03:11.530 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000307474 s, 1.7 MB/s 2024-05-09T05:03:11.533 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:03:11.587 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:11.587 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:11.588 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:03:11.634 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:03:11.634 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-05-09T05:03:11.727 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:03:11.727 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:11.727 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-09T05:03:11.727 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:11.727 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:11.728 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-05-09 05:02:59.775534852 +0000 2024-05-09T05:03:11.728 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-05-09 05:00:15.756155961 +0000 2024-05-09T05:03:11.728 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-05-09 05:00:15.756155961 +0000 2024-05-09T05:03:11.728 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-05-09 05:00:15.756155961 +0000 2024-05-09T05:03:11.728 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:03:11.799 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-05-09T05:03:11.799 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-05-09T05:03:11.799 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000471218 s, 1.1 MB/s 2024-05-09T05:03:11.802 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:03:11.854 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-05-09T05:03:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:03:11.902 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-05-09 05:02:59.776534834 +0000 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-05-09 05:00:16.305146024 +0000 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-05-09 05:00:16.305146024 +0000 2024-05-09T05:03:11.903 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-05-09 05:00:16.305146024 +0000 2024-05-09T05:03:11.903 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:03:11.974 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-05-09T05:03:11.974 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-05-09T05:03:11.974 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000348245 s, 1.5 MB/s 2024-05-09T05:03:11.978 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:03:12.032 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-05-09T05:03:12.079 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-05-09 05:02:59.777534816 +0000 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-05-09 05:00:16.884135545 +0000 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-05-09 05:00:16.884135545 +0000 2024-05-09T05:03:12.080 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-05-09 05:00:16.884135545 +0000 2024-05-09T05:03:12.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:03:12.147 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-05-09T05:03:12.148 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-05-09T05:03:12.148 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000318699 s, 1.6 MB/s 2024-05-09T05:03:12.151 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:03:12.200 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-05-09T05:03:12.246 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:03:12.246 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:03:12.246 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-09T05:03:12.246 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:03:12.247 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:03:12.247 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-05-09 05:02:59.777534816 +0000 2024-05-09T05:03:12.247 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-05-09 05:00:17.499124415 +0000 2024-05-09T05:03:12.247 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-05-09 05:00:17.499124415 +0000 2024-05-09T05:03:12.247 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-05-09 05:00:17.499124415 +0000 2024-05-09T05:03:12.247 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:03:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-05-09T05:03:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-05-09T05:03:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000353811 s, 1.4 MB/s 2024-05-09T05:03:12.368 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:03:12.422 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:12.422 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T05:03:12.422 INFO:tasks.ceph:Generating config... 2024-05-09T05:03:12.424 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-09T05:03:12.424 INFO:tasks.ceph:[client] debug client = 20 2024-05-09T05:03:12.424 INFO:tasks.ceph:[client] debug ms = 1 2024-05-09T05:03:12.424 INFO:tasks.ceph:[client] pid file = 2024-05-09T05:03:12.424 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-09T05:03:12.424 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-09T05:03:12.424 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-09T05:03:12.424 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-09T05:03:12.424 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-09T05:03:12.424 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-09T05:03:12.424 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-09T05:03:12.424 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-09T05:03:12.425 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-09T05:03:12.426 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-09T05:03:12.426 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-09T05:03:12.426 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-09T05:03:12.426 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-09T05:03:12.427 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-09T05:03:12.427 INFO:tasks.ceph:Setting up mon.a... 2024-05-09T05:03:12.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-09T05:03:12.561 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-05-09T05:03:12.570 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-09T05:03:12.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T05:03:12.782 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.133'), ('mon.c', '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]')] 2024-05-09T05:03:12.782 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-09T05:03:12.783 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:12.783 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T05:03:12.837 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.133 --addv c '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:12.991 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 11e43d29-3063-46a7-bef1-2ecadce2fdc5 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 11e43d29-3063-46a7-bef1-2ecadce2fdc5 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-05-09T05:03:12.991998+0000 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-05-09T05:03:12.991998+0000 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 17 (quincy) 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-05-09T05:03:12.992 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-09T05:03:12.995 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-09T05:03:13.040 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 11e43d29-3063-46a7-bef1-2ecadce2fdc5... 2024-05-09T05:03:13.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T05:03:13.088 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-09T05:03:13.219 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-05-09T05:03:13.219 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-05-09T05:03:13.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-05-09T05:03:13.221 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.222 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on skipped message = False 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 11e43d29-3063-46a7-bef1-2ecadce2fdc5 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-05-09T05:03:13.223 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-05-09T05:03:13.224 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2024-05-09T05:03:13.225 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-05-09T05:03:13.226 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-05-09T05:03:13.228 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-05-09T05:03:13.228 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-05-09T05:03:13.229 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-05-09T05:03:13.233 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T05:03:13.234 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon down mkfs grace = 300 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:03:13.235 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-05-09T05:03:13.236 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-05-09T05:03:13.237 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-05-09T05:03:13.238 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-05-09T05:03:13.238 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-05-09T05:03:13.238 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-05-09T05:03:13.238 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-05-09T05:03:13.238 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.239 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-05-09T05:03:13.240 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-05-09T05:03:13.241 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.100,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on skipped message = False 2024-05-09T05:03:13.242 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 11e43d29-3063-46a7-bef1-2ecadce2fdc5 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.243 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug trim objects = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-05-09T05:03:13.244 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-05-09T05:03:13.245 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-05-09T05:03:13.246 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-05-09T05:03:13.247 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-05-09T05:03:13.248 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon down mkfs grace = 300 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-05-09T05:03:13.249 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2024-05-09T05:03:13.250 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2024-05-09T05:03:13.251 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2024-05-09T05:03:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-05-09T05:03:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-05-09T05:03:13.252 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-05-09T05:03:13.259 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-09T05:03:13.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-09T05:03:13.397 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-09T05:03:13.397 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:13.397 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-09T05:03:13.448 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:13.448 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-09T05:03:13.545 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:03:13.545 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:13.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T05:03:13.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T05:03:13.672 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:13.672 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:13.769 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:03:13.769 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:13.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-09T05:03:13.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-09T05:03:13.892 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:13.892 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:13.989 INFO:tasks.ceph:Setting up mon nodes... 2024-05-09T05:03:13.990 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-09T05:03:13.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T05:03:14.161 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-09T05:03:14.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T05:03:14.373 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-09T05:03:14.385 INFO:tasks.ceph:Setting up mds nodes... 2024-05-09T05:03:14.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T05:03:14.532 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-09T05:03:14.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-09T05:03:14.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T05:03:14.723 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-09T05:03:14.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-09T05:03:14.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T05:03:14.961 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-09T05:03:14.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-09T05:03:15.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T05:03:15.208 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-09T05:03:15.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-09T05:03:15.294 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-09T05:03:15.295 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T05:03:15.405 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-09T05:03:15.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-09T05:03:15.543 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-09T05:03:15.591 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-09T05:03:15.713 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-09T05:03:15.751 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-09T05:03:15.861 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-09T05:03:15.900 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-09T05:03:15.901 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-09T05:03:15.901 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-09T05:03:15.990 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:15.990 INFO:tasks.ceph:role: osd.0 2024-05-09T05:03:15.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:03:15.990 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T05:03:16.078 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:16.078 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:16.079 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:16.079 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:16.079 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:16.489 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-05-09T05:03:16.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-05-09T05:03:16.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-09T05:03:16.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-09T05:03:16.730 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-09T05:03:16.807 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:16.807 INFO:tasks.ceph:role: osd.1 2024-05-09T05:03:16.807 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:03:16.807 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T05:03:16.890 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:17.246 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-05-09T05:03:17.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-05-09T05:03:17.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-09T05:03:17.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-09T05:03:17.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-09T05:03:17.528 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:17.528 INFO:tasks.ceph:role: osd.2 2024-05-09T05:03:17.528 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:03:17.528 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T05:03:17.614 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:17.615 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:17.998 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-05-09T05:03:18.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-05-09T05:03:18.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-09T05:03:18.125 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-09T05:03:18.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-09T05:03:18.296 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:18.296 INFO:tasks.ceph:role: osd.3 2024-05-09T05:03:18.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:03:18.296 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T05:03:18.385 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:18.385 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:18.385 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:18.385 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:18.385 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:18.386 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:18.386 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:18.386 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:18.386 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:18.386 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:18.779 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-05-09T05:03:18.787 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-05-09T05:03:18.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-09T05:03:18.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-09T05:03:19.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:19.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:19.149+0000 7f465009d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-09T05:03:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:19.150+0000 7f465009d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-09T05:03:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:19.150+0000 7f465009d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T05:03:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:19.150+0000 7f465009d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T05:03:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:19.150+0000 7f465009d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-09T05:03:19.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:19.154+0000 7f465009d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-09T05:03:22.106 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-09T05:03:22.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:22.314+0000 7fb1b1a32640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-09T05:03:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:22.314+0000 7fb1b1a32640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-09T05:03:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:22.315+0000 7fb1b1a32640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T05:03:22.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:22.315+0000 7fb1b1a32640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T05:03:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:22.315+0000 7fb1b1a32640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-09T05:03:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:22.317+0000 7fb1b1a32640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-09T05:03:25.531 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-09T05:03:25.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:25.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:25.747+0000 7efcb06e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-09T05:03:25.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:25.747+0000 7efcb06e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-09T05:03:25.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:25.747+0000 7efcb06e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T05:03:25.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:25.747+0000 7efcb06e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T05:03:25.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:25.747+0000 7efcb06e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-09T05:03:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:25.750+0000 7efcb06e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-09T05:03:28.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-09T05:03:29.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:29.172+0000 7f624dd57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-09T05:03:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:29.173+0000 7f624dd57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-09T05:03:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:29.173+0000 7f624dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T05:03:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:29.173+0000 7f624dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T05:03:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:29.173+0000 7f624dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-09T05:03:29.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:29.175+0000 7f624dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-09T05:03:32.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-09T05:03:32.220 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-09T05:03:32.308 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:32.308 INFO:tasks.ceph:role: osd.4 2024-05-09T05:03:32.308 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:03:32.309 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:32.397 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:32.398 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:32.796 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-05-09T05:03:32.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-05-09T05:03:32.804 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-09T05:03:32.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-09T05:03:33.023 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-09T05:03:33.086 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:33.086 INFO:tasks.ceph:role: osd.5 2024-05-09T05:03:33.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:03:33.087 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:33.162 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:33.517 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-05-09T05:03:33.524 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-05-09T05:03:33.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-09T05:03:33.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-09T05:03:33.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-09T05:03:33.758 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:33.758 INFO:tasks.ceph:role: osd.6 2024-05-09T05:03:33.758 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:03:33.758 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-09T05:03:33.825 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:33.826 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:34.206 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-05-09T05:03:34.211 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-05-09T05:03:34.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-09T05:03:34.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-09T05:03:34.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-09T05:03:34.455 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-09T05:03:34.455 INFO:tasks.ceph:role: osd.7 2024-05-09T05:03:34.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:03:34.455 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-09T05:03:34.530 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-09T05:03:34.947 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-05-09T05:03:34.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-05-09T05:03:34.954 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-09T05:03:35.117 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-09T05:03:35.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:35.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:35.350+0000 7f5049a25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-09T05:03:35.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:35.352+0000 7f5049a25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-09T05:03:35.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:35.352+0000 7f5049a25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T05:03:35.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:35.352+0000 7f5049a25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T05:03:35.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:35.352+0000 7f5049a25640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-09T05:03:35.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:35.355+0000 7f5049a25640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-09T05:03:38.331 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-09T05:03:38.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:38.544+0000 7f1c083b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-09T05:03:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:38.545+0000 7f1c083b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-09T05:03:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:38.545+0000 7f1c083b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T05:03:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:38.545+0000 7f1c083b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T05:03:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:38.545+0000 7f1c083b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-09T05:03:38.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:38.547+0000 7f1c083b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-09T05:03:40.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:03:40.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:03:41.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-09T05:03:41.866 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:41.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:41.993+0000 7fe2a860d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-09T05:03:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:41.993+0000 7fe2a860d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-09T05:03:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:41.994+0000 7fe2a860d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T05:03:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:41.994+0000 7fe2a860d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T05:03:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:41.994+0000 7fe2a860d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-09T05:03:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:41.996+0000 7fe2a860d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-09T05:03:45.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-09T05:03:45.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:45.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:45.422+0000 7f91c4a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-09T05:03:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:45.422+0000 7f91c4a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-09T05:03:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:45.422+0000 7f91c4a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T05:03:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:45.422+0000 7f91c4a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T05:03:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:45.422+0000 7f91c4a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-09T05:03:45.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:45.425+0000 7f91c4a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-09T05:03:48.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-09T05:03:48.462 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-09T05:03:48.462 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-09T05:03:48.544 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-09T05:03:48.627 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-09T05:03:48.752 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-09T05:03:48.830 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-09T05:03:48.905 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-09T05:03:48.985 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:48.985 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-09T05:03:49.111 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-09T05:03:49.196 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-09T05:03:49.277 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-09T05:03:49.353 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.353 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-09T05:03:49.426 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-09T05:03:49.502 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.502 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-09T05:03:49.631 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-09T05:03:49.714 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:49.714 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-09T05:03:49.771 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:49.771 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-09T05:03:49.825 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.825 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-09T05:03:49.881 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:49.882 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-09T05:03:49.931 INFO:tasks.ceph:Adding keys to all mons... 2024-05-09T05:03:49.931 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T05:03:49.939 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-09T05:03:50.014 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-05-09T05:03:50.014 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQASWTxmfaioCRAAdB5Xwrdnd0j8A49mrNnLCQ== 2024-05-09T05:03:50.014 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-05-09T05:03:50.014 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQASWTxmMGu+HxAAedx72Hw1h9YzVwqVN60b1w== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQASWTxmKnItKxAALO+XiqBeH/9/6zteDWPGvA== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAXWTxm0tb7CBAAaCbjNh5SvUxktzWNn9dbug== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAaWTxmkkDbEhAAJD6Rjo599OgRt2FGwLdI5A== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAdWTxmbNqXLBAAvsCZhY6/iZuQndkG/lAAvQ== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAhWTxmEAZWChAAlkyLgMXWyX4K7ql8FP9dVw== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQASWTxmNJpBFhAAeSuOIiSNCPrByF3tsiJC5A== 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-05-09T05:03:50.015 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQASWTxmuj9cORAAmW56LGvbz1Lu7FgQssQ4Wg== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxmWFd0DBAA0BXHQlyp/O6oFwlY3+Snwg== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAnWTxmU1kFFRAAwIv6t79b7s3WdbYXgMRjjA== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAqWTxm3ziSIBAAjewlIROEUUbScj5tEban/A== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAtWTxmcVhQOxAAfIu8Qjzh1QSQwuRdZMQZKQ== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAxWTxmAGdBGRAAwKNCvC+t3oaZVQyu9qvwzQ== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxm/8wxGBAA16AyM9b+UYE5joYlLTmgZA== 2024-05-09T05:03:50.016 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2024-05-09T05:03:50.017 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxmjSJlIBAA7FhCpTR8GjN+HUc6mGhUGA== 2024-05-09T05:03:50.017 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-05-09T05:03:50.017 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxmw+GCKhAAPue97EzI+2Ht+SQeUd/IiA== 2024-05-09T05:03:50.017 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2024-05-09T05:03:50.017 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxmfeNaMxAAp3g4lQmtsN3qZhpR9lFAIw== 2024-05-09T05:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2024-05-09T05:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQASWTxmfaioCRAAdB5Xwrdnd0j8A49mrNnLCQ== 2024-05-09T05:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-05-09T05:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQASWTxmMGu+HxAAedx72Hw1h9YzVwqVN60b1w== 2024-05-09T05:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQASWTxmKnItKxAALO+XiqBeH/9/6zteDWPGvA== 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAXWTxm0tb7CBAAaCbjNh5SvUxktzWNn9dbug== 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAaWTxmkkDbEhAAJD6Rjo599OgRt2FGwLdI5A== 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAdWTxmbNqXLBAAvsCZhY6/iZuQndkG/lAAvQ== 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAhWTxmEAZWChAAlkyLgMXWyX4K7ql8FP9dVw== 2024-05-09T05:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQASWTxmNJpBFhAAeSuOIiSNCPrByF3tsiJC5A== 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQASWTxmuj9cORAAmW56LGvbz1Lu7FgQssQ4Wg== 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQATWTxmWFd0DBAA0BXHQlyp/O6oFwlY3+Snwg== 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAnWTxmU1kFFRAAwIv6t79b7s3WdbYXgMRjjA== 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAqWTxm3ziSIBAAjewlIROEUUbScj5tEban/A== 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2024-05-09T05:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAtWTxmcVhQOxAAfIu8Qjzh1QSQwuRdZMQZKQ== 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAxWTxmAGdBGRAAwKNCvC+t3oaZVQyu9qvwzQ== 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQATWTxm/8wxGBAA16AyM9b+UYE5joYlLTmgZA== 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQATWTxmjSJlIBAA7FhCpTR8GjN+HUc6mGhUGA== 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQATWTxmw+GCKhAAPue97EzI+2Ht+SQeUd/IiA== 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2024-05-09T05:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQATWTxmfeNaMxAAp3g4lQmtsN3qZhpR9lFAIw== 2024-05-09T05:03:50.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:03:50.066 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:03:50.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:50.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:50.341 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:50.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:50.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.621 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:50.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:03:51.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-09T05:03:51.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:51.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:51.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:51.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-09T05:03:51.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.442 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.582 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.720 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.855 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.862 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-09T05:03:51.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:51.999 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.142 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.412 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-09T05:03:52.545 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-09T05:03:52.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-09T05:03:52.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T05:03:52.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-09T05:03:52.843 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-09T05:03:52.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T05:03:53.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-09T05:03:53.142 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-09T05:03:53.218 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-09T05:03:53.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-09T05:03:53.443 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:53.451 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-09T05:03:53.504 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-09T05:03:53.504 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-09T05:03:53.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-09T05:03:53.509 INFO:tasks.ceph.mon.a:Started 2024-05-09T05:03:53.509 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-09T05:03:53.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-09T05:03:53.514 INFO:tasks.ceph.mon.b:Started 2024-05-09T05:03:53.514 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-09T05:03:53.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-09T05:03:53.519 INFO:tasks.ceph.mon.c:Started 2024-05-09T05:03:53.519 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-09T05:03:53.519 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-09T05:03:53.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-09T05:03:53.524 INFO:tasks.ceph.mgr.y:Started 2024-05-09T05:03:53.524 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-09T05:03:53.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-09T05:03:53.527 INFO:tasks.ceph.mgr.x:Started 2024-05-09T05:03:53.528 INFO:tasks.ceph:Setting crush tunables to default 2024-05-09T05:03:53.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-05-09T05:03:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.696+0000 7f200e600640 1 Processor -- start 2024-05-09T05:03:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.696+0000 7f200e600640 1 -- start start 2024-05-09T05:03:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.697+0000 7f200e600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.697+0000 7f200e600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.697+0000 7f200e600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200806e520 con 0x7f20080cff40 2024-05-09T05:03:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f200e600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f200815d980 con 0x7f2008074490 2024-05-09T05:03:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f200e600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f20080cf440 con 0x7f200815d5a0 2024-05-09T05:03:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:56150/0 (socket says 172.21.15.100:56150) 2024-05-09T05:03:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 learned_addr learned my addr 172.21.15.100:0/2374452005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:03:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:53.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:03:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T05:03:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:53.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.698+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:03:53.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.899+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.899+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:53.900+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:03:54.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.301+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.301+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:54.302+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T05:03:55.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.103+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T05:03:55.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:55.104+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 msgr2=0x7f2008073f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200815d5a0 0x7f2008073f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 msgr2=0x7f20080cfa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.100:3300/0 conn(0x7f2008074490 0x7f20080cfa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 -- 172.21.15.100:0/2374452005 >> v1:172.21.15.100:6789/0 conn(0x7f20080cff40 legacy=0x7f2008161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 -- 172.21.15.100:0/2374452005 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20080cf720 con 0x7f1fe80036a0 2024-05-09T05:03:56.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.698+0000 7f2004c00640 1 -- 172.21.15.100:0/2374452005 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f200815d980 con 0x7f1fe8007350 2024-05-09T05:03:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.699+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.699+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.699+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.699+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:56.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.699+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:03:56.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.901+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.901+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.901+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.901+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:56.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:56.901+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:03:57.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:57.302+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:57.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:57.303+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:57.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:57.303+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:57.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:57.303+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:57.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:57.303+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T05:03:58.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.105+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:58.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.105+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-09T05:03:58.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.105+0000 7f2006a00640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-09T05:03:58.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.105+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:03:58.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.105+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T05:03:58.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.759+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625315558 0 0) 0x7f20080cf720 con 0x7f1fe80036a0 2024-05-09T05:03:58.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.759+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fec003520 con 0x7f1fe80036a0 2024-05-09T05:03:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.765+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1627267994 0 0) 0x7f1fec003520 con 0x7f1fe80036a0 2024-05-09T05:03:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.765+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 msgr2=0x7f1fe8009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:03:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.765+0000 7f2006000640 1 --2- 172.21.15.100:0/2374452005 >> v2:172.21.15.133:3300/0 conn(0x7f1fe8007350 0x7f1fe8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.765+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe800aee0 con 0x7f1fe80036a0 2024-05-09T05:03:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.765+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f1ff800f040 con 0x7f1fe80036a0 2024-05-09T05:03:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 >> v1:172.21.15.133:6789/0 conn(0x7f1fe80036a0 legacy=0x7f1fe8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2007e00640 1 -- 172.21.15.100:0/2374452005 reap_dead start 2024-05-09T05:03:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f1fec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f1fec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f1fec00ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f200815d980 con 0x7f1fec003aa0 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec00c320 con 0x7f1fec004800 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec00c520 con 0x7f1fec005410 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.766+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f1fec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.767+0000 7f2006a00640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f1fec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.767+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 msgr2=0x7f1fec00ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.767+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f1fec00ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.767+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 msgr2=0x7f1fec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:03:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.767+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f1fec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.767+0000 7f2007400640 1 -- 172.21.15.100:0/2374452005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec003520 con 0x7f1fec003aa0 2024-05-09T05:03:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.769+0000 7f2007400640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f1fec003ea0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800cf80 tx=0x7f1fec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1efa341efd36f52 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:03:58.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.770+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8031070 con 0x7f1fec003aa0 2024-05-09T05:03:58.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.770+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff8035400 con 0x7f1fec003aa0 2024-05-09T05:03:58.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.770+0000 7f2006000640 1 -- 172.21.15.100:0/2374452005 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800cbd0 con 0x7f1fec003aa0 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 -- 172.21.15.100:0/2374452005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 msgr2=0x7f1fec003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f1fec003ea0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800cf80 tx=0x7f1fec005830 comp rx=0 tx=0).stop 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 -- 172.21.15.100:0/2374452005 shutdown_connections 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f1fec00ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f1fec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 --2- 172.21.15.100:0/2374452005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f1fec003ea0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 -- 172.21.15.100:0/2374452005 >> 172.21.15.100:0/2374452005 conn(0x7f20080b2c90 msgr2=0x7f20080b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:03:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 -- 172.21.15.100:0/2374452005 shutdown_connections 2024-05-09T05:03:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.771+0000 7f200e600640 1 -- 172.21.15.100:0/2374452005 wait complete. 2024-05-09T05:03:58.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.777+0000 7f200e600640 1 Processor -- start 2024-05-09T05:03:58.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.777+0000 7f200e600640 1 -- start start 2024-05-09T05:03:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.780+0000 7f200e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f2008150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:58.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.780+0000 7f200e600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f200809dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f200e600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f200815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f200e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f200809ef60 con 0x7f1fec003aa0 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f200e600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f200809ede0 con 0x7f1fec004800 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f200e600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f20080d03d0 con 0x7f1fec005410 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f2008150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f2008150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37796/0 (socket says 172.21.15.100:37796) 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 -- 172.21.15.100:0/445396237 learned_addr learned my addr 172.21.15.100:0/445396237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:03:58.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2006a00640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f200809dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007e00640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f200815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 -- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 msgr2=0x7f200815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f200815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 -- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 msgr2=0x7f200809dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f200809dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.781+0000 7f2007400640 1 -- 172.21.15.100:0/445396237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2008151080 con 0x7f1fec003aa0 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.782+0000 7f2007e00640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f200815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:03:58.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.782+0000 7f2007400640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f2008150b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ff802b9a0 tx=0x7f1ff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:03:58.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8043020 con 0x7f1fec003aa0 2024-05-09T05:03:58.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff80357c0 con 0x7f1fec003aa0 2024-05-09T05:03:58.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8035b70 con 0x7f1fec003aa0 2024-05-09T05:03:58.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200809e660 con 0x7f1fec003aa0 2024-05-09T05:03:58.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200815de80 con 0x7f1fec003aa0 2024-05-09T05:03:58.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ff8046020 con 0x7f1fec003aa0 2024-05-09T05:03:58.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.784+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1ff8005e90 con 0x7f1fec003aa0 2024-05-09T05:03:58.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.786+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200806a630 con 0x7f1fec003aa0 2024-05-09T05:03:58.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.791+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1ff804d030 con 0x7f1fec003aa0 2024-05-09T05:03:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.865+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f200806ff60 con 0x7f1fec003aa0 2024-05-09T05:03:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.869+0000 7f1fff400640 1 -- 172.21.15.100:0/445396237 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1ff803e960 con 0x7f1fec003aa0 2024-05-09T05:03:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 msgr2=0x7f2008150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f2008150b40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1ff802b9a0 tx=0x7f1ff80046c0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 shutdown_connections 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1fec005410 0x7f200815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fec004800 0x7f200809dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 --2- 172.21.15.100:0/445396237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fec003aa0 0x7f2008150b40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 >> 172.21.15.100:0/445396237 conn(0x7f20080b2c90 msgr2=0x7f2008072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 shutdown_connections 2024-05-09T05:03:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:03:58.870+0000 7f200e600640 1 -- 172.21.15.100:0/445396237 wait complete. 2024-05-09T05:03:58.889 INFO:tasks.ceph:check_enable_crimson: False 2024-05-09T05:03:58.889 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-09T05:03:58.889 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:58.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-09T05:03:58.927 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:03:58.925+0000 7f2400d1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:03:58.935 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:03:58.935+0000 7f2efc130040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:03:58.956 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:58.956 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-09T05:03:59.077 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:59.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-09T05:03:59.116 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:03:59.114+0000 7f2400d1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:03:59.145 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:03:59.144+0000 7f2efc130040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:03:59.182 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:03:59.180+0000 7f2400d1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:03:59.191 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:03:59.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-09T05:03:59.211 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:03:59.210+0000 7f2efc130040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:03:59.302 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:59.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-09T05:03:59.379 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:59.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-09T05:03:59.452 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:59.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-09T05:03:59.475 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:03:59.473+0000 7f2400d1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:03:59.528 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:03:59.527+0000 7f2400d1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:03:59.529 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:03:59.528+0000 7f2efc130040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:03:59.574 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:03:59.574 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-09T05:03:59.589 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:03:59.588+0000 7f2efc130040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:03:59.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 76d083c1-ce47-4b39-9e16-daf00a71f1dd 0 2024-05-09T05:03:59.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.882+0000 7fd3c2e00640 1 Processor -- start 2024-05-09T05:03:59.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.882+0000 7fd3c2e00640 1 -- start start 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.883+0000 7fd3c2e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc162cf0 0x7fd3bc0d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.883+0000 7fd3c2e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3bc1630d0 con 0x7fd3bc0d22c0 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.883+0000 7fd3c2e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3bc0d41e0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.883+0000 7fd3c2e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc0d0fb0 con 0x7fd3bc162cf0 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3c1000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd3bc0d5cc0 0x7fd3bc0d1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48422/0 (socket says 172.21.15.133:48422) 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3c1000640 1 -- 172.21.15.133:0/2729142880 learned_addr learned my addr 172.21.15.133:0/2729142880 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-05-09T05:03:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3c1a00640 1 --2- 172.21.15.133:0/2729142880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc162cf0 0x7fd3bc0d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3c1a00640 1 -- 172.21.15.133:0/2729142880 >> v1:172.21.15.133:6789/0 conn(0x7fd3bc0d5cc0 legacy=0x7fd3bc0d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3c1a00640 1 -- 172.21.15.133:0/2729142880 >> v1:172.21.15.100:6789/0 conn(0x7fd3bc0d22c0 legacy=0x7fd3bc0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3c1a00640 1 -- 172.21.15.133:0/2729142880 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc0d0c40 con 0x7fd3bc162cf0 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.884+0000 7fd3bbe00640 1 -- 172.21.15.133:0/2729142880 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788009045 0 0) 0x7fd3bc0d41e0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.885+0000 7fd3c1a00640 1 --2- 172.21.15.133:0/2729142880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc162cf0 0x7fd3bc0d1440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097d0 tx=0x7fd3b002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9162f511adbfa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.885+0000 7fd3bbe00640 1 -- 172.21.15.133:0/2729142880 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0037070 con 0x7fd3bc162cf0 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.885+0000 7fd3bbe00640 1 -- 172.21.15.133:0/2729142880 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b0032440 con 0x7fd3bc162cf0 2024-05-09T05:03:59.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.885+0000 7fd3bbe00640 1 -- 172.21.15.133:0/2729142880 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0032810 con 0x7fd3bc162cf0 2024-05-09T05:03:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 -- 172.21.15.133:0/2729142880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc162cf0 msgr2=0x7fd3bc0d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 --2- 172.21.15.133:0/2729142880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc162cf0 0x7fd3bc0d1440 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097d0 tx=0x7fd3b002a160 comp rx=0 tx=0).stop 2024-05-09T05:03:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 -- 172.21.15.133:0/2729142880 shutdown_connections 2024-05-09T05:03:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 --2- 172.21.15.133:0/2729142880 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc162cf0 0x7fd3bc0d1440 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 -- 172.21.15.133:0/2729142880 >> 172.21.15.133:0/2729142880 conn(0x7fd3bc0d51a0 msgr2=0x7fd3bc0d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:03:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 -- 172.21.15.133:0/2729142880 shutdown_connections 2024-05-09T05:03:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.886+0000 7fd3c2e00640 1 -- 172.21.15.133:0/2729142880 wait complete. 2024-05-09T05:03:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.888+0000 7fd3c2e00640 1 Processor -- start 2024-05-09T05:03:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.888+0000 7fd3c2e00640 1 -- start start 2024-05-09T05:03:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.889+0000 7fd3c2e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3bc0d22c0 0x7fd3bc0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.889+0000 7fd3c2e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 0x7fd3bc0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.889+0000 7fd3c2e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc162cf0 0x7fd3bc160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.889+0000 7fd3c2e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc0d3f90 con 0x7fd3bc0d22c0 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.889+0000 7fd3c2e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc0d44c0 con 0x7fd3bc162cf0 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.889+0000 7fd3c2e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc0b5d30 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 0x7fd3bc0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c2400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc162cf0 0x7fd3bc160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 0x7fd3bc0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:41970/0 (socket says 172.21.15.133:41970) 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 -- 172.21.15.133:0/1390431803 learned_addr learned my addr 172.21.15.133:0/1390431803 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1a00640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3bc0d22c0 0x7fd3bc0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 -- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc162cf0 msgr2=0x7fd3bc160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc162cf0 0x7fd3bc160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 -- 172.21.15.133:0/1390431803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3bc0d22c0 msgr2=0x7fd3bc0ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3bc0d22c0 0x7fd3bc0ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.890+0000 7fd3c1000640 1 -- 172.21.15.133:0/1390431803 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc0cd380 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3c1000640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 0x7fd3bc0cee20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c450 tx=0x7fd3a800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80074e0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a80047e0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8004bd0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc0cd660 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc0cdc20 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3a8011070 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.891+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fd3a8013700 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.892+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc0699e0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.895+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd3a8004dc0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.973+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "76d083c1-ce47-4b39-9e16-daf00a71f1dd", "id": 0} v 0) -- 0x7fd3bc06a550 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.981+0000 7fd3b9600640 1 -- 172.21.15.133:0/1390431803 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76d083c1-ce47-4b39-9e16-daf00a71f1dd", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fd3a80139d0 con 0x7fd3bc0d5cc0 2024-05-09T05:03:59.982 INFO:teuthology.orchestra.run.smithi133.stdout:0 2024-05-09T05:03:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 msgr2=0x7fd3bc0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:03:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 0x7fd3bc0cee20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c450 tx=0x7fd3a800c910 comp rx=0 tx=0).stop 2024-05-09T05:03:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 shutdown_connections 2024-05-09T05:03:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc162cf0 0x7fd3bc160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3bc0d5cc0 0x7fd3bc0cee20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 --2- 172.21.15.133:0/1390431803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3bc0d22c0 0x7fd3bc0ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:03:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 >> 172.21.15.133:0/1390431803 conn(0x7fd3bc0d51a0 msgr2=0x7fd3bc161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:03:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 shutdown_connections 2024-05-09T05:03:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:03:59.983+0000 7fd3c2e00640 1 -- 172.21.15.133:0/1390431803 wait complete. 2024-05-09T05:04:00.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 874ccff6-39df-4f07-a1d8-b7318906c024 1 2024-05-09T05:04:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.176+0000 7fa72ea00640 1 Processor -- start 2024-05-09T05:04:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.176+0000 7fa72ea00640 1 -- start start 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.177+0000 7fa72ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa7280d3700 0x7fa7280d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.177+0000 7fa72ea00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 0x7fa7280d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.177+0000 7fa72ea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7280d4020 con 0x7fa7280d5c40 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72ea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa72815fdc0 con 0x7fa7280d3700 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72ea00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa7281600a0 con 0x7fa72815f860 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 0x7fa7280d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 0x7fa7280d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:41986/0 (socket says 172.21.15.133:41986) 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 -- 172.21.15.133:0/3086976728 learned_addr learned my addr 172.21.15.133:0/3086976728 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72d600640 1 --2- 172.21.15.133:0/3086976728 >> v2:172.21.15.100:3300/0 conn(0x7fa7280d3700 0x7fa7280d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 -- 172.21.15.133:0/3086976728 >> v2:172.21.15.100:3300/0 conn(0x7fa7280d3700 msgr2=0x7fa7280d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 --2- 172.21.15.133:0/3086976728 >> v2:172.21.15.100:3300/0 conn(0x7fa7280d3700 0x7fa7280d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 -- 172.21.15.133:0/3086976728 >> v1:172.21.15.100:6789/0 conn(0x7fa7280d5c40 legacy=0x7fa728163070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72cc00640 1 -- 172.21.15.133:0/3086976728 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa728160380 con 0x7fa72815f860 2024-05-09T05:04:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.178+0000 7fa72d600640 1 --2- 172.21.15.133:0/3086976728 >> v2:172.21.15.100:3300/0 conn(0x7fa7280d3700 0x7fa7280d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.179+0000 7fa72cc00640 1 --2- 172.21.15.133:0/3086976728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 0x7fa7280d3ae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa714009870 tx=0x7fa71402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48d3cd2b6f6f882 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa727e00640 1 -- 172.21.15.133:0/3086976728 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714037070 con 0x7fa72815f860 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa727e00640 1 -- 172.21.15.133:0/3086976728 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71402ae50 con 0x7fa72815f860 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa727e00640 1 -- 172.21.15.133:0/3086976728 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa714032860 con 0x7fa72815f860 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 -- 172.21.15.133:0/3086976728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 msgr2=0x7fa7280d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 --2- 172.21.15.133:0/3086976728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 0x7fa7280d3ae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa714009870 tx=0x7fa71402a300 comp rx=0 tx=0).stop 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 -- 172.21.15.133:0/3086976728 shutdown_connections 2024-05-09T05:04:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 --2- 172.21.15.133:0/3086976728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa72815f860 0x7fa7280d3ae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 --2- 172.21.15.133:0/3086976728 >> v2:172.21.15.100:3300/0 conn(0x7fa7280d3700 0x7fa7280d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 -- 172.21.15.133:0/3086976728 >> 172.21.15.133:0/3086976728 conn(0x7fa7280d5120 msgr2=0x7fa7280d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 -- 172.21.15.133:0/3086976728 shutdown_connections 2024-05-09T05:04:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.180+0000 7fa72ea00640 1 -- 172.21.15.133:0/3086976728 wait complete. 2024-05-09T05:04:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.182+0000 7fa72ea00640 1 Processor -- start 2024-05-09T05:04:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.182+0000 7fa72ea00640 1 -- start start 2024-05-09T05:04:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.183+0000 7fa72ea00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7280d3700 0x7fa72815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.183+0000 7fa72ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7280d5c40 0x7fa7280a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.183+0000 7fa72ea00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 0x7fa7280a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.183+0000 7fa72ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa7280b4240 con 0x7fa7280d5c40 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.183+0000 7fa72ea00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa7280d0db0 con 0x7fa72815f860 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.183+0000 7fa72ea00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa7280ba810 con 0x7fa7280d3700 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7280d3700 0x7fa72815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 0x7fa7280a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 0x7fa7280a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35908/0 (socket says 172.21.15.133:35908) 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 -- 172.21.15.133:0/1841147054 learned_addr learned my addr 172.21.15.133:0/1841147054 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72cc00640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7280d5c40 0x7fa7280a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 -- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7280d3700 msgr2=0x7fa72815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7280d3700 0x7fa72815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 -- 172.21.15.133:0/1841147054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7280d5c40 msgr2=0x7fa7280a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7280d5c40 0x7fa7280a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.184+0000 7fa72e000640 1 -- 172.21.15.133:0/1841147054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280a11a0 con 0x7fa72815f860 2024-05-09T05:04:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa72e000640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 0x7fa7280a0b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c7a0 tx=0x7fa72000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720003b70 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720003d30 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72000aa90 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7280a1480 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7280a1a40 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa72000ac30 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.185+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa720012690 con 0x7fa72815f860 2024-05-09T05:04:00.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.186+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72806a550 con 0x7fa72815f860 2024-05-09T05:04:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.189+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa720012890 con 0x7fa72815f860 2024-05-09T05:04:00.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.269+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "874ccff6-39df-4f07-a1d8-b7318906c024", "id": 1} v 0) -- 0x7fa7280d34e0 con 0x7fa72815f860 2024-05-09T05:04:00.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.277+0000 7fa725600640 1 -- 172.21.15.133:0/1841147054 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "874ccff6-39df-4f07-a1d8-b7318906c024", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa720012a70 con 0x7fa72815f860 2024-05-09T05:04:00.277 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 msgr2=0x7fa7280a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 0x7fa7280a0b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c7a0 tx=0x7fa72000cc60 comp rx=0 tx=0).stop 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 shutdown_connections 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa72815f860 0x7fa7280a0b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7280d5c40 0x7fa7280a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 --2- 172.21.15.133:0/1841147054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa7280d3700 0x7fa72815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 >> 172.21.15.133:0/1841147054 conn(0x7fa7280d5120 msgr2=0x7fa7280b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 shutdown_connections 2024-05-09T05:04:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.278+0000 7fa72ea00640 1 -- 172.21.15.133:0/1841147054 wait complete. 2024-05-09T05:04:00.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 0d9236fa-1a35-4663-a14c-528110732f57 2 2024-05-09T05:04:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.467+0000 7f2e7c000640 1 Processor -- start 2024-05-09T05:04:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.467+0000 7f2e7c000640 1 -- start start 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.468+0000 7f2e7c000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 0x7f2e740d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.468+0000 7f2e7c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e740d1240 con 0x7f2e740d5e00 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.468+0000 7f2e7c000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e740d2e90 con 0x7f2e740d1c10 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.468+0000 7f2e7c000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2e740d3170 con 0x7f2e7415f6f0 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e79600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 0x7f2e740d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e79600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 0x7f2e740d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:41994/0 (socket says 172.21.15.133:41994) 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e7a000640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e740d1c10 0x7f2e740b4ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48438/0 (socket says 172.21.15.133:48438) 2024-05-09T05:04:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e79600640 1 -- 172.21.15.133:0/356521871 learned_addr learned my addr 172.21.15.133:0/356521871 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e79600640 1 -- 172.21.15.133:0/356521871 >> v1:172.21.15.133:6789/0 conn(0x7f2e740d1c10 legacy=0x7f2e740b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e79600640 1 -- 172.21.15.133:0/356521871 >> v1:172.21.15.100:6789/0 conn(0x7f2e740d5e00 legacy=0x7f2e740d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.469+0000 7f2e79600640 1 -- 172.21.15.133:0/356521871 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e740d3450 con 0x7f2e7415f6f0 2024-05-09T05:04:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.470+0000 7f2e79600640 1 --2- 172.21.15.133:0/356521871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 0x7f2e740d09c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098a0 tx=0x7f2e6802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea09deb733d5c819 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:00.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e73e00640 1 -- 172.21.15.133:0/356521871 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68037070 con 0x7f2e7415f6f0 2024-05-09T05:04:00.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e73e00640 1 -- 172.21.15.133:0/356521871 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e68032440 con 0x7f2e7415f6f0 2024-05-09T05:04:00.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e73e00640 1 -- 172.21.15.133:0/356521871 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68032810 con 0x7f2e7415f6f0 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e7c000640 1 -- 172.21.15.133:0/356521871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 msgr2=0x7f2e740d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e7c000640 1 --2- 172.21.15.133:0/356521871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 0x7f2e740d09c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098a0 tx=0x7f2e6802a250 comp rx=0 tx=0).stop 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e7c000640 1 -- 172.21.15.133:0/356521871 shutdown_connections 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e7c000640 1 --2- 172.21.15.133:0/356521871 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e7415f6f0 0x7f2e740d09c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.471+0000 7f2e7c000640 1 -- 172.21.15.133:0/356521871 >> 172.21.15.133:0/356521871 conn(0x7f2e7409e600 msgr2=0x7f2e740d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.472+0000 7f2e7c000640 1 -- 172.21.15.133:0/356521871 shutdown_connections 2024-05-09T05:04:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.472+0000 7f2e7c000640 1 -- 172.21.15.133:0/356521871 wait complete. 2024-05-09T05:04:00.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.473+0000 7f2e7c000640 1 Processor -- start 2024-05-09T05:04:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.473+0000 7f2e7c000640 1 -- start start 2024-05-09T05:04:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.474+0000 7f2e7c000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 0x7f2e74157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.474+0000 7f2e7c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e740d5e00 0x7f2e741f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.474+0000 7f2e7c000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e7415f6f0 0x7f2e741f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.474+0000 7f2e7c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e740b51c0 con 0x7f2e740d5e00 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.474+0000 7f2e7c000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2e740d0f00 con 0x7f2e7415f6f0 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.474+0000 7f2e7c000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2e740b5340 con 0x7f2e740d1c10 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 0x7f2e74157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 0x7f2e74157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42004/0 (socket says 172.21.15.133:42004) 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 -- 172.21.15.133:0/3931927553 learned_addr learned my addr 172.21.15.133:0/3931927553 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e7a000640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e7415f6f0 0x7f2e741f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e78c00640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e740d5e00 0x7f2e741f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 -- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e7415f6f0 msgr2=0x7f2e741f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e7415f6f0 0x7f2e741f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 -- 172.21.15.133:0/3931927553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e740d5e00 msgr2=0x7f2e741f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e740d5e00 0x7f2e741f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 -- 172.21.15.133:0/3931927553 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e741f8b60 con 0x7f2e740d1c10 2024-05-09T05:04:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.475+0000 7f2e79600640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 0x7f2e74157060 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098a0 tx=0x7f2e680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:00.477 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:00.474+0000 7f2400d1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68041070 con 0x7f2e740d1c10 2024-05-09T05:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e6803c890 con 0x7f2e740d1c10 2024-05-09T05:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68037040 con 0x7f2e740d1c10 2024-05-09T05:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e741607c0 con 0x7f2e740d1c10 2024-05-09T05:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e74160d80 con 0x7f2e740d1c10 2024-05-09T05:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e68044070 con 0x7f2e740d1c10 2024-05-09T05:04:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.476+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2e68030440 con 0x7f2e740d1c10 2024-05-09T05:04:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.477+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e74161440 con 0x7f2e740d1c10 2024-05-09T05:04:00.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.479+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2e74161440 con 0x7f2e740d1c10 2024-05-09T05:04:00.524 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:00.523+0000 7f2efc130040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:04:00.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.556+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0d9236fa-1a35-4663-a14c-528110732f57", "id": 2} v 0) -- 0x7f2e7406a630 con 0x7f2e740d1c10 2024-05-09T05:04:00.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.562+0000 7f2e71600640 1 -- 172.21.15.133:0/3931927553 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d9236fa-1a35-4663-a14c-528110732f57", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2e6803cc80 con 0x7f2e740d1c10 2024-05-09T05:04:00.563 INFO:teuthology.orchestra.run.smithi133.stdout:2 2024-05-09T05:04:00.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 msgr2=0x7f2e74157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 0x7f2e74157060 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e680098a0 tx=0x7f2e680046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 shutdown_connections 2024-05-09T05:04:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e7415f6f0 0x7f2e741f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e740d5e00 0x7f2e741f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 --2- 172.21.15.133:0/3931927553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e740d1c10 0x7f2e74157060 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 >> 172.21.15.133:0/3931927553 conn(0x7f2e7409e600 msgr2=0x7f2e740b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 shutdown_connections 2024-05-09T05:04:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.564+0000 7f2e7c000640 1 -- 172.21.15.133:0/3931927553 wait complete. 2024-05-09T05:04:00.579 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:00.578+0000 7f2400d1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:04:00.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 0e05dc99-b5a0-4c43-aad6-683d8c627338 3 2024-05-09T05:04:00.630 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:00.628+0000 7f2400d1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:04:00.640 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:00.640+0000 7f2efc130040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:04:00.695 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:00.695+0000 7f2efc130040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:04:00.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.766+0000 7f23af200640 1 Processor -- start 2024-05-09T05:04:00.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.766+0000 7f23af200640 1 -- start start 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23af200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23a8162800 0x7f23a80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23af200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 0x7f23a806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23af200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a80cc750 con 0x7f23a806d7d0 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23af200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f23a80d12b0 con 0x7f23a8162800 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23af200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f23a8162be0 con 0x7f23a80cc330 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23ad400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 0x7f23a806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23ad400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 0x7f23a806d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42010/0 (socket says 172.21.15.133:42010) 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23ad400640 1 -- 172.21.15.133:0/1938201824 learned_addr learned my addr 172.21.15.133:0/1938201824 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.768+0000 7f23ade00640 1 --2- 172.21.15.133:0/1938201824 >> v2:172.21.15.100:3300/0 conn(0x7f23a8162800 0x7f23a80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.769+0000 7f23ad400640 1 -- 172.21.15.133:0/1938201824 >> v2:172.21.15.100:3300/0 conn(0x7f23a8162800 msgr2=0x7f23a80cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:00.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.769+0000 7f23ad400640 1 --2- 172.21.15.133:0/1938201824 >> v2:172.21.15.100:3300/0 conn(0x7f23a8162800 0x7f23a80cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.769+0000 7f23ad400640 1 -- 172.21.15.133:0/1938201824 >> v1:172.21.15.100:6789/0 conn(0x7f23a806d7d0 legacy=0x7f23a8162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.769+0000 7f23ad400640 1 -- 172.21.15.133:0/1938201824 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80cf200 con 0x7f23a80cc330 2024-05-09T05:04:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.770+0000 7f23ad400640 1 --2- 172.21.15.133:0/1938201824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 0x7f23a806d290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2398009870 tx=0x7f239802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80714d4c9b50cce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.770+0000 7f23aca00640 1 -- 172.21.15.133:0/1938201824 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398037070 con 0x7f23a80cc330 2024-05-09T05:04:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.770+0000 7f23aca00640 1 -- 172.21.15.133:0/1938201824 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2398032440 con 0x7f23a80cc330 2024-05-09T05:04:00.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.770+0000 7f23aca00640 1 -- 172.21.15.133:0/1938201824 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398032810 con 0x7f23a80cc330 2024-05-09T05:04:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 -- 172.21.15.133:0/1938201824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 msgr2=0x7f23a806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 --2- 172.21.15.133:0/1938201824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 0x7f23a806d290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2398009870 tx=0x7f239802a1c0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 -- 172.21.15.133:0/1938201824 shutdown_connections 2024-05-09T05:04:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 --2- 172.21.15.133:0/1938201824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a80cc330 0x7f23a806d290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 --2- 172.21.15.133:0/1938201824 >> v2:172.21.15.100:3300/0 conn(0x7f23a8162800 0x7f23a80cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 -- 172.21.15.133:0/1938201824 >> 172.21.15.133:0/1938201824 conn(0x7f23a80ce010 msgr2=0x7f23a80ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 -- 172.21.15.133:0/1938201824 shutdown_connections 2024-05-09T05:04:00.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.771+0000 7f23af200640 1 -- 172.21.15.133:0/1938201824 wait complete. 2024-05-09T05:04:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.772+0000 7f23af200640 1 Processor -- start 2024-05-09T05:04:00.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.773+0000 7f23af200640 1 -- start start 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.773+0000 7f23af200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a806d7d0 0x7f23a80c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.773+0000 7f23af200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 0x7f23a8070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.773+0000 7f23af200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a8162800 0x7f23a8161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.773+0000 7f23af200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80cfaa0 con 0x7f23a806d7d0 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23af200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80cf7c0 con 0x7f23a80cc330 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23af200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f23a806dc00 con 0x7f23a8162800 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ae800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a8162800 0x7f23a8161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 0x7f23a8070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ae800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a8162800 0x7f23a8161610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42024/0 (socket says 172.21.15.133:42024) 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 0x7f23a8070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35934/0 (socket says 172.21.15.133:35934) 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ae800640 1 -- 172.21.15.133:0/362686693 learned_addr learned my addr 172.21.15.133:0/362686693 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ade00640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a806d7d0 0x7f23a80c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 -- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a8162800 msgr2=0x7f23a8161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a8162800 0x7f23a8161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 -- 172.21.15.133:0/362686693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a806d7d0 msgr2=0x7f23a80c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a806d7d0 0x7f23a80c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.774+0000 7f23ad400640 1 -- 172.21.15.133:0/362686693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a8070f40 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23ad400640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 0x7f23a8070a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2398031000 tx=0x7f23980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398041020 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2398030780 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398037040 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a80c5b00 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a80c60c0 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2398044020 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.775+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f239803dba0 con 0x7f23a80cc330 2024-05-09T05:04:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.776+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a806a550 con 0x7f23a80cc330 2024-05-09T05:04:00.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.779+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f239804b030 con 0x7f23a80cc330 2024-05-09T05:04:00.823 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:00.821+0000 7f2400d1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:04:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.858+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e05dc99-b5a0-4c43-aad6-683d8c627338", "id": 3} v 0) -- 0x7f23a806fcd0 con 0x7f23a80cc330 2024-05-09T05:04:00.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.866+0000 7f23a2000640 1 -- 172.21.15.133:0/362686693 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e05dc99-b5a0-4c43-aad6-683d8c627338", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f23a8070f40 con 0x7f23a80cc330 2024-05-09T05:04:00.867 INFO:teuthology.orchestra.run.smithi133.stdout:3 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.867+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 msgr2=0x7f23a8070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.867+0000 7f23af200640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 0x7f23a8070a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2398031000 tx=0x7f23980046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 shutdown_connections 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23a8162800 0x7f23a8161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a80cc330 0x7f23a8070a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 --2- 172.21.15.133:0/362686693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a806d7d0 0x7f23a80c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 >> 172.21.15.133:0/362686693 conn(0x7f23a80ce010 msgr2=0x7f23a8072940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:00.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 shutdown_connections 2024-05-09T05:04:00.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:00.868+0000 7f23af200640 1 -- 172.21.15.133:0/362686693 wait complete. 2024-05-09T05:04:00.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 583b4b3c-e1f1-42da-99e2-a052b3d5f5c7 4 2024-05-09T05:04:00.888 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:00.887+0000 7f2400d1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:04:00.918 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:00.917+0000 7f2efc130040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:04:00.949 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:00.947+0000 7f2400d1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:04:00.977 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:00.976+0000 7f2efc130040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:04:01.041 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:01.041+0000 7f2efc130040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:04:01.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.061+0000 7faf13e00640 1 Processor -- start 2024-05-09T05:04:01.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.061+0000 7faf13e00640 1 -- start start 2024-05-09T05:04:01.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf13e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf140d5cc0 0x7faf140d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf13e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf141630d0 con 0x7faf140d22c0 2024-05-09T05:04:01.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf13e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf140d41e0 con 0x7faf14162cf0 2024-05-09T05:04:01.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf13e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7faf140d0fb0 con 0x7faf140d5cc0 2024-05-09T05:04:01.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf12a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faf14162cf0 0x7faf140d1bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48446/0 (socket says 172.21.15.133:48446) 2024-05-09T05:04:01.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf12a00640 1 -- 172.21.15.133:0/2497138659 learned_addr learned my addr 172.21.15.133:0/2497138659 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-05-09T05:04:01.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.063+0000 7faf13400640 1 --2- 172.21.15.133:0/2497138659 >> v2:172.21.15.133:3300/0 conn(0x7faf140d5cc0 0x7faf140d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.064+0000 7faf13400640 1 -- 172.21.15.133:0/2497138659 >> v1:172.21.15.133:6789/0 conn(0x7faf14162cf0 legacy=0x7faf140d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.064+0000 7faf13400640 1 -- 172.21.15.133:0/2497138659 >> v1:172.21.15.100:6789/0 conn(0x7faf140d22c0 legacy=0x7faf140c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.064+0000 7faf13400640 1 -- 172.21.15.133:0/2497138659 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf140d0c40 con 0x7faf140d5cc0 2024-05-09T05:04:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.065+0000 7faf13400640 1 --2- 172.21.15.133:0/2497138659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140d1440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097a0 tx=0x7faf0c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24d3cd05075adfa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.065+0000 7faf12000640 1 -- 172.21.15.133:0/2497138659 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c037070 con 0x7faf140d5cc0 2024-05-09T05:04:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.065+0000 7faf12000640 1 -- 172.21.15.133:0/2497138659 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c032440 con 0x7faf140d5cc0 2024-05-09T05:04:01.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.065+0000 7faf12000640 1 -- 172.21.15.133:0/2497138659 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c032810 con 0x7faf140d5cc0 2024-05-09T05:04:01.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.065+0000 7faf13e00640 1 -- 172.21.15.133:0/2497138659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 msgr2=0x7faf140d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.065+0000 7faf13e00640 1 --2- 172.21.15.133:0/2497138659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140d1440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097a0 tx=0x7faf0c02a230 comp rx=0 tx=0).stop 2024-05-09T05:04:01.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.066+0000 7faf13e00640 1 -- 172.21.15.133:0/2497138659 shutdown_connections 2024-05-09T05:04:01.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.066+0000 7faf13e00640 1 --2- 172.21.15.133:0/2497138659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140d1440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.066+0000 7faf13e00640 1 -- 172.21.15.133:0/2497138659 >> 172.21.15.133:0/2497138659 conn(0x7faf140d51a0 msgr2=0x7faf140d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.066+0000 7faf13e00640 1 -- 172.21.15.133:0/2497138659 shutdown_connections 2024-05-09T05:04:01.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.066+0000 7faf13e00640 1 -- 172.21.15.133:0/2497138659 wait complete. 2024-05-09T05:04:01.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.067+0000 7faf13e00640 1 Processor -- start 2024-05-09T05:04:01.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.067+0000 7faf13e00640 1 -- start start 2024-05-09T05:04:01.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.068+0000 7faf13e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf140d22c0 0x7faf1415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.068+0000 7faf13e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.068+0000 7faf13e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf14162cf0 0x7faf141617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.068+0000 7faf13e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faf140d3f90 con 0x7faf14162cf0 2024-05-09T05:04:01.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.068+0000 7faf13e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf140d44c0 con 0x7faf140d5cc0 2024-05-09T05:04:01.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.068+0000 7faf13e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7faf140b5d30 con 0x7faf140d22c0 2024-05-09T05:04:01.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf12a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf140d22c0 0x7faf1415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35944/0 (socket says 172.21.15.133:35944) 2024-05-09T05:04:01.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 -- 172.21.15.133:0/3672478261 learned_addr learned my addr 172.21.15.133:0/3672478261 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf13400640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf14162cf0 0x7faf141617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 -- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf140d22c0 msgr2=0x7faf1415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf140d22c0 0x7faf1415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 -- 172.21.15.133:0/3672478261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf14162cf0 msgr2=0x7faf141617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf14162cf0 0x7faf141617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 -- 172.21.15.133:0/3672478261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf140b7dd0 con 0x7faf140d5cc0 2024-05-09T05:04:01.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf12a00640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf140d22c0 0x7faf1415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:04:01.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf13400640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf14162cf0 0x7faf141617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:01.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.069+0000 7faf0a000640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140b4450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c450 tx=0x7faefc00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc0052d0 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc005470 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc012870 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1415ccd0 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf140b7010 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faefc012a10 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.070+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7faefc003b00 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.071+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf140699e0 con 0x7faf140d5cc0 2024-05-09T05:04:01.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.073+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7faefc012d00 con 0x7faf140d5cc0 2024-05-09T05:04:01.075 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:01.074+0000 7f2400d1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:04:01.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.149+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "583b4b3c-e1f1-42da-99e2-a052b3d5f5c7", "id": 4} v 0) -- 0x7faf1406a550 con 0x7faf140d5cc0 2024-05-09T05:04:01.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.155+0000 7faf0b400640 1 -- 172.21.15.133:0/3672478261 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "583b4b3c-e1f1-42da-99e2-a052b3d5f5c7", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7faefc0035f0 con 0x7faf140d5cc0 2024-05-09T05:04:01.156 INFO:teuthology.orchestra.run.smithi133.stdout:4 2024-05-09T05:04:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 msgr2=0x7faf140b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140b4450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faefc00c450 tx=0x7faefc00c910 comp rx=0 tx=0).stop 2024-05-09T05:04:01.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 shutdown_connections 2024-05-09T05:04:01.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf14162cf0 0x7faf141617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf140d5cc0 0x7faf140b4450 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 --2- 172.21.15.133:0/3672478261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf140d22c0 0x7faf1415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 >> 172.21.15.133:0/3672478261 conn(0x7faf140d51a0 msgr2=0x7faf1406e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 shutdown_connections 2024-05-09T05:04:01.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.157+0000 7faf13e00640 1 -- 172.21.15.133:0/3672478261 wait complete. 2024-05-09T05:04:01.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new cb91184c-0eaa-4cd0-9dbe-be1931e89c7c 5 2024-05-09T05:04:01.178 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:01.177+0000 7f2efc130040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:04:01.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.361+0000 7f83f1a00640 1 Processor -- start 2024-05-09T05:04:01.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.362+0000 7f83f1a00640 1 -- start start 2024-05-09T05:04:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83ec162cf0 0x7f83ec0d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83ec0d5cc0 0x7f83ec0d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f83ec0d0fb0 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f83ec0d44c0 con 0x7f83ec162cf0 2024-05-09T05:04:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f83ec1630d0 con 0x7f83ec0b5d30 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83ebe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83ec162cf0 0x7f83ec0d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83ebe00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83ec162cf0 0x7f83ec0d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35952/0 (socket says 172.21.15.133:35952) 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83f1000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0d20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42042/0 (socket says 172.21.15.133:42042) 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.363+0000 7f83ebe00640 1 -- 172.21.15.133:0/4025364994 learned_addr learned my addr 172.21.15.133:0/4025364994 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83e3e00640 1 --2- 172.21.15.133:0/4025364994 >> v2:172.21.15.100:3300/0 conn(0x7f83ec0d5cc0 0x7f83ec0d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83ebe00640 1 -- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 msgr2=0x7f83ec0d20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83ebe00640 1 --2- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0d20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83ebe00640 1 -- 172.21.15.133:0/4025364994 >> v2:172.21.15.100:3300/0 conn(0x7f83ec0d5cc0 msgr2=0x7f83ec0d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83ebe00640 1 --2- 172.21.15.133:0/4025364994 >> v2:172.21.15.100:3300/0 conn(0x7f83ec0d5cc0 0x7f83ec0d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83ebe00640 1 -- 172.21.15.133:0/4025364994 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec0d41e0 con 0x7f83ec162cf0 2024-05-09T05:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.364+0000 7f83e3e00640 1 --2- 172.21.15.133:0/4025364994 >> v2:172.21.15.100:3300/0 conn(0x7f83ec0d5cc0 0x7f83ec0d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:01.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.365+0000 7f83ebe00640 1 --2- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec162cf0 0x7f83ec0d1440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f83ec06cc90 tx=0x7f83dc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5433aacac78f8aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.365+0000 7f83eb400640 1 -- 172.21.15.133:0/4025364994 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc037070 con 0x7f83ec162cf0 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.365+0000 7f83eb400640 1 -- 172.21.15.133:0/4025364994 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc032440 con 0x7f83ec162cf0 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.365+0000 7f83eb400640 1 -- 172.21.15.133:0/4025364994 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc032810 con 0x7f83ec162cf0 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 -- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec162cf0 msgr2=0x7f83ec0d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 --2- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec162cf0 0x7f83ec0d1440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f83ec06cc90 tx=0x7f83dc02a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 -- 172.21.15.133:0/4025364994 shutdown_connections 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 --2- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0d20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 --2- 172.21.15.133:0/4025364994 >> v2:172.21.15.100:3300/0 conn(0x7f83ec0d5cc0 0x7f83ec0d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 --2- 172.21.15.133:0/4025364994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec162cf0 0x7f83ec0d1440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 -- 172.21.15.133:0/4025364994 >> 172.21.15.133:0/4025364994 conn(0x7f83ec0d51a0 msgr2=0x7f83ec0d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 -- 172.21.15.133:0/4025364994 shutdown_connections 2024-05-09T05:04:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.366+0000 7f83f1a00640 1 -- 172.21.15.133:0/4025364994 wait complete. 2024-05-09T05:04:01.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.367+0000 7f83f1a00640 1 Processor -- start 2024-05-09T05:04:01.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 -- start start 2024-05-09T05:04:01.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec0d5cc0 0x7f83ec15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83ec162cf0 0x7f83ec0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec0b65c0 con 0x7f83ec162cf0 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec0b6440 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.368+0000 7f83f1a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f83ec0c8cf0 con 0x7f83ec0b5d30 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec0d5cc0 0x7f83ec15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83ebe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83ebe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42058/0 (socket says 172.21.15.133:42058) 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83ebe00640 1 -- 172.21.15.133:0/2478825010 learned_addr learned my addr 172.21.15.133:0/2478825010 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83f1000640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83ec162cf0 0x7f83ec0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 -- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 msgr2=0x7f83ec0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 -- 172.21.15.133:0/2478825010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83ec162cf0 msgr2=0x7f83ec0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83ec162cf0 0x7f83ec0b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 -- 172.21.15.133:0/2478825010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec0cf200 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83ebe00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.369+0000 7f83e3e00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec0d5cc0 0x7f83ec15fd20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c7f0 tx=0x7f83d400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4015070 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d4004220 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4003610 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec0b3400 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec0b3ca0 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f83d40039c0 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.370+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f83d4007b40 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.371+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ec0699e0 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.373+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f83d4003cb0 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.449+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb91184c-0eaa-4cd0-9dbe-be1931e89c7c", "id": 5} v 0) -- 0x7f83ec06a550 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.459+0000 7f83e8c00640 1 -- 172.21.15.133:0/2478825010 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb91184c-0eaa-4cd0-9dbe-be1931e89c7c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f83d40075c0 con 0x7f83ec0d5cc0 2024-05-09T05:04:01.460 INFO:teuthology.orchestra.run.smithi133.stdout:5 2024-05-09T05:04:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.460+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec0d5cc0 msgr2=0x7f83ec15fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.460+0000 7f83f1a00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec0d5cc0 0x7f83ec15fd20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83d400c7f0 tx=0x7f83d400ccb0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 shutdown_connections 2024-05-09T05:04:01.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83ec162cf0 0x7f83ec0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83ec0d5cc0 0x7f83ec15fd20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 --2- 172.21.15.133:0/2478825010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83ec0b5d30 0x7f83ec0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 >> 172.21.15.133:0/2478825010 conn(0x7f83ec0d51a0 msgr2=0x7f83ec0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 shutdown_connections 2024-05-09T05:04:01.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.461+0000 7f83f1a00640 1 -- 172.21.15.133:0/2478825010 wait complete. 2024-05-09T05:04:01.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new b5e48f05-bea8-470e-8489-734309351cc6 6 2024-05-09T05:04:01.528 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:01.526+0000 7f2400d1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:04:01.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.648+0000 7f5c3f200640 1 Processor -- start 2024-05-09T05:04:01.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.648+0000 7f5c3f200640 1 -- start start 2024-05-09T05:04:01.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.650+0000 7f5c3f200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c400d3700 0x7f5c400d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.650+0000 7f5c3f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c4015f860 0x7f5c400d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.650+0000 7f5c3f200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c400d4020 con 0x7f5c400d5c40 2024-05-09T05:04:01.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.650+0000 7f5c3f200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4015fdc0 con 0x7f5c400d3700 2024-05-09T05:04:01.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.650+0000 7f5c3f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5c401600a0 con 0x7f5c4015f860 2024-05-09T05:04:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3de00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c400d3700 0x7f5c400d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3de00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c400d3700 0x7f5c400d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35970/0 (socket says 172.21.15.133:35970) 2024-05-09T05:04:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3de00640 1 -- 172.21.15.133:0/3327597926 learned_addr learned my addr 172.21.15.133:0/3327597926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3d400640 1 --2- 172.21.15.133:0/3327597926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c4015f860 0x7f5c400d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3d400640 1 -- 172.21.15.133:0/3327597926 >> v2:172.21.15.133:3300/0 conn(0x7f5c400d3700 msgr2=0x7f5c400d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:01.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3d400640 1 --2- 172.21.15.133:0/3327597926 >> v2:172.21.15.133:3300/0 conn(0x7f5c400d3700 0x7f5c400d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3d400640 1 -- 172.21.15.133:0/3327597926 >> v1:172.21.15.133:6789/0 conn(0x7f5c400d5c40 legacy=0x7f5c40163070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.651+0000 7f5c3d400640 1 -- 172.21.15.133:0/3327597926 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c40160380 con 0x7f5c4015f860 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.652+0000 7f5c3d400640 1 --2- 172.21.15.133:0/3327597926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c4015f860 0x7f5c400d3ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0097a0 tx=0x7f5c2c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1f9eb41b5b4ea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3ca00640 1 -- 172.21.15.133:0/3327597926 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c037070 con 0x7f5c4015f860 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3ca00640 1 -- 172.21.15.133:0/3327597926 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c032440 con 0x7f5c4015f860 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3ca00640 1 -- 172.21.15.133:0/3327597926 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c032810 con 0x7f5c4015f860 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3f200640 1 -- 172.21.15.133:0/3327597926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c4015f860 msgr2=0x7f5c400d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3f200640 1 --2- 172.21.15.133:0/3327597926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c4015f860 0x7f5c400d3ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0097a0 tx=0x7f5c2c02a210 comp rx=0 tx=0).stop 2024-05-09T05:04:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3f200640 1 -- 172.21.15.133:0/3327597926 shutdown_connections 2024-05-09T05:04:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3f200640 1 --2- 172.21.15.133:0/3327597926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c4015f860 0x7f5c400d3ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3f200640 1 --2- 172.21.15.133:0/3327597926 >> v2:172.21.15.133:3300/0 conn(0x7f5c400d3700 0x7f5c400d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.653+0000 7f5c3f200640 1 -- 172.21.15.133:0/3327597926 >> 172.21.15.133:0/3327597926 conn(0x7f5c400d5120 msgr2=0x7f5c400d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.654+0000 7f5c3f200640 1 -- 172.21.15.133:0/3327597926 shutdown_connections 2024-05-09T05:04:01.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.654+0000 7f5c3f200640 1 -- 172.21.15.133:0/3327597926 wait complete. 2024-05-09T05:04:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.655+0000 7f5c3f200640 1 Processor -- start 2024-05-09T05:04:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.655+0000 7f5c3f200640 1 -- start start 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.656+0000 7f5c3f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c400d3700 0x7f5c4015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.656+0000 7f5c3f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 0x7f5c400cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.656+0000 7f5c3f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4015f860 0x7f5c400cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.656+0000 7f5c3f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400b4240 con 0x7f5c4015f860 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.656+0000 7f5c3f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400d0db0 con 0x7f5c400d3700 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.656+0000 7f5c3f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5c400cc940 con 0x7f5c400d5c40 2024-05-09T05:04:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 0x7f5c400cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3de00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c400d3700 0x7f5c4015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 0x7f5c400cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42076/0 (socket says 172.21.15.133:42076) 2024-05-09T05:04:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 -- 172.21.15.133:0/4269912704 learned_addr learned my addr 172.21.15.133:0/4269912704 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 -- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c400d3700 msgr2=0x7f5c4015bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c400d3700 0x7f5c4015bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 -- 172.21.15.133:0/4269912704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4015f860 msgr2=0x7f5c400cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4015f860 0x7f5c400cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 -- 172.21.15.133:0/4269912704 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c400ccc20 con 0x7f5c400d5c40 2024-05-09T05:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.657+0000 7f5c3d400640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 0x7f5c400cc1f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000c00 tx=0x7f5c2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c037040 con 0x7f5c400d5c40 2024-05-09T05:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c030500 con 0x7f5c400d5c40 2024-05-09T05:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c400ccf00 con 0x7f5c400d5c40 2024-05-09T05:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0308d0 con 0x7f5c400d5c40 2024-05-09T05:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c400cd4c0 con 0x7f5c400d5c40 2024-05-09T05:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c2c044020 con 0x7f5c400d5c40 2024-05-09T05:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.658+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5c2c03bb60 con 0x7f5c400d5c40 2024-05-09T05:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.659+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4006a550 con 0x7f5c400d5c40 2024-05-09T05:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.662+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5c2c04b020 con 0x7f5c400d5c40 2024-05-09T05:04:01.665 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:01.662+0000 7f2efc130040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:04:01.680 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:01.679+0000 7f2400d1e040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:04:01.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.740+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b5e48f05-bea8-470e-8489-734309351cc6", "id": 6} v 0) -- 0x7f5c400d34e0 con 0x7f5c400d5c40 2024-05-09T05:04:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.750+0000 7f5c36000640 1 -- 172.21.15.133:0/4269912704 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5e48f05-bea8-470e-8489-734309351cc6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5c2c03bdf0 con 0x7f5c400d5c40 2024-05-09T05:04:01.750 INFO:teuthology.orchestra.run.smithi133.stdout:6 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 msgr2=0x7f5c400cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 0x7f5c400cc1f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c000c00 tx=0x7f5c2c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 shutdown_connections 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c4015f860 0x7f5c400cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c400d5c40 0x7f5c400cc1f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 --2- 172.21.15.133:0/4269912704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c400d3700 0x7f5c4015bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.751+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 >> 172.21.15.133:0/4269912704 conn(0x7f5c400d5120 msgr2=0x7f5c4015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.752+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 shutdown_connections 2024-05-09T05:04:01.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.752+0000 7f5c3f200640 1 -- 172.21.15.133:0/4269912704 wait complete. 2024-05-09T05:04:01.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 8db26a90-eef8-4e73-9f8c-7d0ecab1fc16 7 2024-05-09T05:04:01.826 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:01.825+0000 7f2efc130040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:04:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.943+0000 7f7842400640 1 Processor -- start 2024-05-09T05:04:01.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.944+0000 7f7842400640 1 -- start start 2024-05-09T05:04:01.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7842400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7842400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f783c15f860 0x7f783c0d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7842400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0d4020 con 0x7f783c0d5c40 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7842400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f783c15fdc0 con 0x7f783c15f860 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7842400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f783c1600a0 con 0x7f783c0d3700 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7841000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7841000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c0d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42080/0 (socket says 172.21.15.133:42080) 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f7841000640 1 -- 172.21.15.133:0/1390566100 learned_addr learned my addr 172.21.15.133:0/1390566100 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.945+0000 7f783be00640 1 --2- 172.21.15.133:0/1390566100 >> v2:172.21.15.133:3300/0 conn(0x7f783c15f860 0x7f783c0d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.946+0000 7f7841000640 1 -- 172.21.15.133:0/1390566100 >> v2:172.21.15.133:3300/0 conn(0x7f783c15f860 msgr2=0x7f783c0d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:01.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.946+0000 7f7841000640 1 --2- 172.21.15.133:0/1390566100 >> v2:172.21.15.133:3300/0 conn(0x7f783c15f860 0x7f783c0d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.946+0000 7f7841000640 1 -- 172.21.15.133:0/1390566100 >> v1:172.21.15.100:6789/0 conn(0x7f783c0d5c40 legacy=0x7f783c163070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:01.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.946+0000 7f7841000640 1 -- 172.21.15.133:0/1390566100 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c160380 con 0x7f783c0d3700 2024-05-09T05:04:01.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.947+0000 7f7841000640 1 --2- 172.21.15.133:0/1390566100 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c0d2f00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d908a1b327410780 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.947+0000 7f783b400640 1 -- 172.21.15.133:0/1390566100 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830037070 con 0x7f783c0d3700 2024-05-09T05:04:01.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.947+0000 7f783b400640 1 -- 172.21.15.133:0/1390566100 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7830032440 con 0x7f783c0d3700 2024-05-09T05:04:01.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.947+0000 7f783b400640 1 -- 172.21.15.133:0/1390566100 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830032810 con 0x7f783c0d3700 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.947+0000 7f7842400640 1 -- 172.21.15.133:0/1390566100 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 msgr2=0x7f783c0d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.947+0000 7f7842400640 1 --2- 172.21.15.133:0/1390566100 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c0d2f00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783002a250 comp rx=0 tx=0).stop 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.948+0000 7f7842400640 1 -- 172.21.15.133:0/1390566100 shutdown_connections 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.948+0000 7f7842400640 1 --2- 172.21.15.133:0/1390566100 >> v2:172.21.15.133:3300/0 conn(0x7f783c15f860 0x7f783c0d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.948+0000 7f7842400640 1 --2- 172.21.15.133:0/1390566100 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c0d2f00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.948+0000 7f7842400640 1 -- 172.21.15.133:0/1390566100 >> 172.21.15.133:0/1390566100 conn(0x7f783c0d5120 msgr2=0x7f783c0d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.948+0000 7f7842400640 1 -- 172.21.15.133:0/1390566100 shutdown_connections 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.948+0000 7f7842400640 1 -- 172.21.15.133:0/1390566100 wait complete. 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.949+0000 7f7842400640 1 Processor -- start 2024-05-09T05:04:01.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 -- start start 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f783c0d5c40 0x7f783c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f783c15f860 0x7f783c14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0b4240 con 0x7f783c15f860 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0d0db0 con 0x7f783c0d5c40 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.950+0000 7f7842400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f783c0b8810 con 0x7f783c0d3700 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f7841000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f783c0d5c40 0x7f783c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f7841000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c14c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42096/0 (socket says 172.21.15.133:42096) 2024-05-09T05:04:01.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f7841000640 1 -- 172.21.15.133:0/1450785494 learned_addr learned my addr 172.21.15.133:0/1450785494 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f7841a00640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f783c15f860 0x7f783c14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 -- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 msgr2=0x7f783c14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c14c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 -- 172.21.15.133:0/1450785494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f783c15f860 msgr2=0x7f783c14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f783c15f860 0x7f783c14e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 -- 172.21.15.133:0/1450785494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c14edd0 con 0x7f783c0d5c40 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f7841a00640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f783c15f860 0x7f783c14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.951+0000 7f783be00640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f783c0d5c40 0x7f783c15aab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f782800e870 tx=0x7f782800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828017070 con 0x7f783c0d5c40 2024-05-09T05:04:01.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782800ee60 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782800cb00 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c15b140 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c0b8d70 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f782801a070 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.952+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f782800cca0 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.953+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c06a550 con 0x7f783c0d5c40 2024-05-09T05:04:01.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:01.955+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f78280063e0 con 0x7f783c0d5c40 2024-05-09T05:04:01.978 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:01.975+0000 7f2400d1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:04:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.035+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8db26a90-eef8-4e73-9f8c-7d0ecab1fc16", "id": 7} v 0) -- 0x7f783c0d34e0 con 0x7f783c0d5c40 2024-05-09T05:04:02.037 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:02.036+0000 7f2400d1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:04:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.041+0000 7f7838c00640 1 -- 172.21.15.133:0/1450785494 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8db26a90-eef8-4e73-9f8c-7d0ecab1fc16", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f7828006690 con 0x7f783c0d5c40 2024-05-09T05:04:02.041 INFO:teuthology.orchestra.run.smithi133.stdout:7 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f783c0d5c40 msgr2=0x7f783c15aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f783c0d5c40 0x7f783c15aab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f782800e870 tx=0x7f782800ed30 comp rx=0 tx=0).stop 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 shutdown_connections 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f783c15f860 0x7f783c14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f783c0d5c40 0x7f783c15aab0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 --2- 172.21.15.133:0/1450785494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f783c0d3700 0x7f783c14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 >> 172.21.15.133:0/1450785494 conn(0x7f783c0d5120 msgr2=0x7f783c1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.042+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 shutdown_connections 2024-05-09T05:04:02.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:02.043+0000 7f7842400640 1 -- 172.21.15.133:0/1450785494 wait complete. 2024-05-09T05:04:02.059 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-09T05:04:02.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-09T05:04:02.067 INFO:tasks.ceph.osd.0:Started 2024-05-09T05:04:02.067 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-09T05:04:02.067 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-09T05:04:02.074 INFO:tasks.ceph.osd.1:Started 2024-05-09T05:04:02.074 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-09T05:04:02.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-09T05:04:02.079 INFO:tasks.ceph.osd.2:Started 2024-05-09T05:04:02.079 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-09T05:04:02.079 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-09T05:04:02.086 INFO:tasks.ceph.osd.3:Started 2024-05-09T05:04:02.086 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-09T05:04:02.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-09T05:04:02.093 INFO:tasks.ceph.osd.4:Started 2024-05-09T05:04:02.093 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-09T05:04:02.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-09T05:04:02.100 INFO:tasks.ceph.osd.5:Started 2024-05-09T05:04:02.100 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-09T05:04:02.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-09T05:04:02.105 INFO:tasks.ceph.osd.6:Started 2024-05-09T05:04:02.105 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-09T05:04:02.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-09T05:04:02.110 INFO:tasks.ceph.osd.7:Started 2024-05-09T05:04:02.111 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:02.148 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:02.148+0000 7f2efc130040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:04:02.197 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:02.196+0000 7f2400d1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:04:02.249 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:02.246+0000 7f2efc130040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:04:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.338+0000 7f8e49c00640 1 Processor -- start 2024-05-09T05:04:02.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.338+0000 7f8e49c00640 1 -- start start 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.339+0000 7f8e49c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d3660 0x7f8e440d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.339+0000 7f8e49c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e440d2f80 con 0x7f8e440b4530 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.339+0000 7f8e49c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e440b51e0 con 0x7f8e440d1a10 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.339+0000 7f8e49c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8e440d3fe0 con 0x7f8e440d3660 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.339+0000 7f8e43e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8e440b4530 0x7f8e440b5c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48694/0 (socket says 172.21.15.100:48694) 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.339+0000 7f8e43e00640 1 -- 172.21.15.100:0/1104328455 learned_addr learned my addr 172.21.15.100:0/1104328455 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e43400640 1 --2- 172.21.15.100:0/1104328455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d3660 0x7f8e440d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e42a00640 1 -- 172.21.15.100:0/1104328455 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188496070 0 0) 0x7f8e440d2f80 con 0x7f8e440b4530 2024-05-09T05:04:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e42a00640 1 -- 172.21.15.100:0/1104328455 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e28003520 con 0x7f8e440b4530 2024-05-09T05:04:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e43400640 1 -- 172.21.15.100:0/1104328455 >> v1:172.21.15.133:6789/0 conn(0x7f8e440d1a10 legacy=0x7f8e440cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e43400640 1 -- 172.21.15.100:0/1104328455 >> v1:172.21.15.100:6789/0 conn(0x7f8e440b4530 legacy=0x7f8e440b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e42a00640 1 -- 172.21.15.100:0/1104328455 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2442685694 0 0) 0x7f8e28003520 con 0x7f8e440b4530 2024-05-09T05:04:02.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.340+0000 7f8e43400640 1 -- 172.21.15.100:0/1104328455 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e440d25f0 con 0x7f8e440d3660 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.341+0000 7f8e43400640 1 --2- 172.21.15.100:0/1104328455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d3660 0x7f8e440d3aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e300097d0 tx=0x7f8e3002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2aba509fb3191a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e42a00640 1 -- 172.21.15.100:0/1104328455 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30037070 con 0x7f8e440d3660 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e42a00640 1 -- 172.21.15.100:0/1104328455 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3002ac30 con 0x7f8e440d3660 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e42a00640 1 -- 172.21.15.100:0/1104328455 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e340016f0 con 0x7f8e440d3660 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 -- 172.21.15.100:0/1104328455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d3660 msgr2=0x7f8e440d3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 --2- 172.21.15.100:0/1104328455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d3660 0x7f8e440d3aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e300097d0 tx=0x7f8e3002a1a0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 -- 172.21.15.100:0/1104328455 shutdown_connections 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 --2- 172.21.15.100:0/1104328455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d3660 0x7f8e440d3aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 -- 172.21.15.100:0/1104328455 >> 172.21.15.100:0/1104328455 conn(0x7f8e4408eb30 msgr2=0x7f8e4409e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 -- 172.21.15.100:0/1104328455 shutdown_connections 2024-05-09T05:04:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.342+0000 7f8e49c00640 1 -- 172.21.15.100:0/1104328455 wait complete. 2024-05-09T05:04:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.344+0000 7f8e49c00640 1 Processor -- start 2024-05-09T05:04:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.344+0000 7f8e49c00640 1 -- start start 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 0x7f8e440cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d1a10 0x7f8e4415fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e440d3660 0x7f8e440b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e440d28d0 con 0x7f8e440b4530 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8e440b5730 con 0x7f8e440d3660 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8e440b4910 con 0x7f8e440d1a10 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 0x7f8e440cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 0x7f8e440cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35930/0 (socket says 172.21.15.100:35930) 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e43e00640 1 -- 172.21.15.100:0/1518824373 learned_addr learned my addr 172.21.15.100:0/1518824373 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e43400640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d1a10 0x7f8e4415fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.345+0000 7f8e49200640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e440d3660 0x7f8e440b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e43e00640 1 -- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d1a10 msgr2=0x7f8e4415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e43e00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d1a10 0x7f8e4415fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e43e00640 1 -- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e440d3660 msgr2=0x7f8e440b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e43e00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e440d3660 0x7f8e440b9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e43e00640 1 -- 172.21.15.100:0/1518824373 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e440cc630 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e43e00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 0x7f8e440cea70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e340013c0 tx=0x7f8e3400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34005ad0 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3400ce50 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e440cc910 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34007070 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e440cced0 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.346+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e34007210 con 0x7f8e440b4530 2024-05-09T05:04:02.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.347+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8e34007500 con 0x7f8e440b4530 2024-05-09T05:04:02.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.347+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4406a550 con 0x7f8e440b4530 2024-05-09T05:04:02.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.350+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8e3400a640 con 0x7f8e440b4530 2024-05-09T05:04:02.400 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:02.400+0000 7f2efc130040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:04:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.416+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e440b4bd0 con 0x7f8e440b4530 2024-05-09T05:04:02.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.416+0000 7f8e3be00640 1 -- 172.21.15.100:0/1518824373 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8e3400a820 con 0x7f8e440b4530 2024-05-09T05:04:02.418 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:02.419 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:02.037335+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.417+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 msgr2=0x7f8e440cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.417+0000 7f8e49c00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 0x7f8e440cea70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e340013c0 tx=0x7f8e3400cb10 comp rx=0 tx=0).stop 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 shutdown_connections 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e440d3660 0x7f8e440b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e440d1a10 0x7f8e4415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 --2- 172.21.15.100:0/1518824373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e440b4530 0x7f8e440cea70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 >> 172.21.15.100:0/1518824373 conn(0x7f8e4408eb30 msgr2=0x7f8e4406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 shutdown_connections 2024-05-09T05:04:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:02.418+0000 7f8e49c00640 1 -- 172.21.15.100:0/1518824373 wait complete. 2024-05-09T05:04:02.435 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-09T05:04:02.436 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-09T05:04:02.572 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:02.571+0000 7f2400d1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:04:02.628 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:02.626+0000 7f2400d1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:04:02.736 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:02.735+0000 7f2efc130040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:04:02.764 INFO:tasks.ceph.osd.4.smithi133.stderr:2024-05-09T05:04:02.764+0000 7f9c72e32640 -1 Falling back to public interface 2024-05-09T05:04:02.786 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-05-09T05:04:02.784+0000 7fd6417cb640 -1 Falling back to public interface 2024-05-09T05:04:02.792 INFO:tasks.ceph.osd.5.smithi133.stderr:2024-05-09T05:04:02.792+0000 7fe39a5c4640 -1 Falling back to public interface 2024-05-09T05:04:02.794 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-05-09T05:04:02.793+0000 7fd4108ff640 -1 Falling back to public interface 2024-05-09T05:04:02.794 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-05-09T05:04:02.793+0000 7fbf26643640 -1 Falling back to public interface 2024-05-09T05:04:02.795 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-05-09T05:04:02.793+0000 7f329f42c640 -1 Falling back to public interface 2024-05-09T05:04:02.795 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:02.795+0000 7f2efc130040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:04:02.800 INFO:tasks.ceph.osd.7.smithi133.stderr:2024-05-09T05:04:02.800+0000 7ff66581b640 -1 Falling back to public interface 2024-05-09T05:04:02.816 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:02.814+0000 7f2400d1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:04:02.819 INFO:tasks.ceph.osd.6.smithi133.stderr:2024-05-09T05:04:02.819+0000 7fee9080d640 -1 Falling back to public interface 2024-05-09T05:04:02.981 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:02.981+0000 7f2efc130040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:04:02.982 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:02.980+0000 7f2400d1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:04:03.039 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:03.037+0000 7f2400d1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:04:03.121 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:03.119+0000 7f2400d1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:04:03.149 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:03.149+0000 7f2efc130040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:04:03.174 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:03.172+0000 7f2400d1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:04:03.209 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:03.209+0000 7f2efc130040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:04:03.244 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:03.289 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:03.288+0000 7f2efc130040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:04:03.342 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:03.341+0000 7f2efc130040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:04:03.406 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.404+0000 7f23e7200640 1 Processor -- start 2024-05-09T05:04:03.409 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.404+0000 7f23e7200640 1 -- start start 2024-05-09T05:04:03.416 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23e815f630 0x7f23e80d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:03.416 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e7200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e815fa10 0x7f23e80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:03.416 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e7200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e80b7fb0 con 0x7f23e80d0840 2024-05-09T05:04:03.416 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e7200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f23e80d0d00 con 0x7f23e815f630 2024-05-09T05:04:03.416 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e7200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f23e80d0fe0 con 0x7f23e815fa10 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23e815f630 0x7f23e80d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23e815f630 0x7f23e80d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35936/0 (socket says 172.21.15.100:35936) 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.406+0000 7f23e5e00640 1 -- 172.21.15.100:0/3274335065 learned_addr learned my addr 172.21.15.100:0/3274335065 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.407+0000 7f23e6800640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e815fa10 0x7f23e80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.407+0000 7f23e5e00640 1 -- 172.21.15.100:0/3274335065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e815fa10 msgr2=0x7f23e80b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.407+0000 7f23e5e00640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e815fa10 0x7f23e80b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.407+0000 7f23e5e00640 1 -- 172.21.15.100:0/3274335065 >> v1:172.21.15.133:6789/0 conn(0x7f23e80d0840 legacy=0x7f23e80d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.407+0000 7f23e5e00640 1 -- 172.21.15.100:0/3274335065 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e80b8250 con 0x7f23e815f630 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.407+0000 7f23e6800640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e815fa10 0x7f23e80b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.408+0000 7f23e5e00640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815f630 0x7f23e80d3060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009870 tx=0x7f23d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8655f52d51513b58 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.408+0000 7f23e4a00640 1 -- 172.21.15.100:0/3274335065 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8037070 con 0x7f23e815f630 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.408+0000 7f23e4a00640 1 -- 172.21.15.100:0/3274335065 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d8032440 con 0x7f23e815f630 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.408+0000 7f23e4a00640 1 -- 172.21.15.100:0/3274335065 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8032810 con 0x7f23e815f630 2024-05-09T05:04:03.417 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 -- 172.21.15.100:0/3274335065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815f630 msgr2=0x7f23e80d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815f630 0x7f23e80d3060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009870 tx=0x7f23d802a270 comp rx=0 tx=0).stop 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 -- 172.21.15.100:0/3274335065 shutdown_connections 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e815fa10 0x7f23e80b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 --2- 172.21.15.100:0/3274335065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815f630 0x7f23e80d3060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 -- 172.21.15.100:0/3274335065 >> 172.21.15.100:0/3274335065 conn(0x7f23e80d5160 msgr2=0x7f23e80d5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 -- 172.21.15.100:0/3274335065 shutdown_connections 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.409+0000 7f23e7200640 1 -- 172.21.15.100:0/3274335065 wait complete. 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.410+0000 7f23e7200640 1 Processor -- start 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 -- start start 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e80d0840 0x7f23e80cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815f630 0x7f23e8153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815fa10 0x7f23e80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23e80d5ee0 con 0x7f23e815fa10 2024-05-09T05:04:03.418 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23e80d5d60 con 0x7f23e815f630 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.411+0000 7f23e7200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f23e80d3cb0 con 0x7f23e80d0840 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815fa10 0x7f23e80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e5e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e80d0840 0x7f23e80cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e5e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e80d0840 0x7f23e80cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:57256/0 (socket says 172.21.15.100:57256) 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e5400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815f630 0x7f23e8153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e5e00640 1 -- 172.21.15.100:0/2641808910 learned_addr learned my addr 172.21.15.100:0/2641808910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 -- 172.21.15.100:0/2641808910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e80d0840 msgr2=0x7f23e80cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e80d0840 0x7f23e80cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 -- 172.21.15.100:0/2641808910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815f630 msgr2=0x7f23e8153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815f630 0x7f23e8153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 -- 172.21.15.100:0/2641808910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e8154420 con 0x7f23e815fa10 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.412+0000 7f23e6800640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815fa10 0x7f23e80ce610 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f23e000cc90 tx=0x7f23e000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e000f680 con 0x7f23e815fa10 2024-05-09T05:04:03.419 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e000f840 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e000fc30 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e80c9520 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e80c9ae0 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23e0018400 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.413+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f23e0018dc0 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.414+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e80c9fd0 con 0x7f23e815fa10 2024-05-09T05:04:03.420 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.416+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f23e0014030 con 0x7f23e815fa10 2024-05-09T05:04:03.485 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.483+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23e80cbd70 con 0x7f23e815fa10 2024-05-09T05:04:03.485 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.484+0000 7f23de000640 1 -- 172.21.15.100:0/2641808910 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f23e00186f0 con 0x7f23e815fa10 2024-05-09T05:04:03.486 INFO:teuthology.misc.health.smithi100.stdout: 2024-05-09T05:04:03.486 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:02.037335+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815fa10 msgr2=0x7f23e80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815fa10 0x7f23e80ce610 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f23e000cc90 tx=0x7f23e000a650 comp rx=0 tx=0).stop 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 shutdown_connections 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23e815fa10 0x7f23e80ce610 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23e815f630 0x7f23e8153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 --2- 172.21.15.100:0/2641808910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23e80d0840 0x7f23e80cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 >> 172.21.15.100:0/2641808910 conn(0x7f23e80d5160 msgr2=0x7f23e815e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.485+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 shutdown_connections 2024-05-09T05:04:03.487 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:03.486+0000 7f23e7200640 1 -- 172.21.15.100:0/2641808910 wait complete. 2024-05-09T05:04:03.499 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T05:04:03.723 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:03.721+0000 7f2400d1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:04:03.854 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:03.852+0000 7f2400d1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:04:03.889 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:03.888+0000 7f2efc130040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:04:04.028 INFO:tasks.ceph.mgr.x.smithi133.stderr:2024-05-09T05:04:04.028+0000 7f2efc130040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:04:04.902 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:04.901+0000 7f23a0200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T05:04:04.902 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-05-09T05:04:04.902+0000 7f23a0200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T05:04:06.143 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-05-09T05:04:06.142+0000 7f329f42c640 -1 osd.0 0 log_to_monitors true 2024-05-09T05:04:06.212 INFO:tasks.ceph.osd.7.smithi133.stderr:2024-05-09T05:04:06.212+0000 7ff66581b640 -1 osd.7 0 log_to_monitors true 2024-05-09T05:04:06.379 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-05-09T05:04:06.379+0000 7fd6417cb640 -1 osd.3 0 log_to_monitors true 2024-05-09T05:04:06.394 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-05-09T05:04:06.393+0000 7fd4108ff640 -1 osd.2 0 log_to_monitors true 2024-05-09T05:04:06.399 INFO:tasks.ceph.osd.4.smithi133.stderr:2024-05-09T05:04:06.398+0000 7f9c72e32640 -1 osd.4 0 log_to_monitors true 2024-05-09T05:04:06.409 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-05-09T05:04:06.409+0000 7fbf26643640 -1 osd.1 0 log_to_monitors true 2024-05-09T05:04:06.471 INFO:tasks.ceph.osd.5.smithi133.stderr:2024-05-09T05:04:06.471+0000 7fe39a5c4640 -1 osd.5 0 log_to_monitors true 2024-05-09T05:04:06.494 INFO:tasks.ceph.osd.6.smithi133.stderr:2024-05-09T05:04:06.493+0000 7fee9080d640 -1 osd.6 0 log_to_monitors true 2024-05-09T05:04:10.082 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-05-09T05:04:10.082+0000 7f329a400640 -1 osd.0 0 waiting for initial osdmap 2024-05-09T05:04:10.099 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-05-09T05:04:10.098+0000 7f328fa00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.229 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-05-09T05:04:10.229+0000 7fbf21e00640 -1 osd.1 0 waiting for initial osdmap 2024-05-09T05:04:10.231 INFO:tasks.ceph.osd.7.smithi133.stderr:2024-05-09T05:04:10.231+0000 7ff660000640 -1 osd.7 0 waiting for initial osdmap 2024-05-09T05:04:10.231 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-05-09T05:04:10.231+0000 7fd63d000640 -1 osd.3 0 waiting for initial osdmap 2024-05-09T05:04:10.238 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-05-09T05:04:10.237+0000 7fbf17400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.241 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-05-09T05:04:10.241+0000 7fd632600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.242 INFO:tasks.ceph.osd.5.smithi133.stderr:2024-05-09T05:04:10.242+0000 7fe395400640 -1 osd.5 0 waiting for initial osdmap 2024-05-09T05:04:10.242 INFO:tasks.ceph.osd.7.smithi133.stderr:2024-05-09T05:04:10.242+0000 7ff656000640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.252 INFO:tasks.ceph.osd.5.smithi133.stderr:2024-05-09T05:04:10.252+0000 7fe38b400640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.262 INFO:tasks.ceph.osd.6.smithi133.stderr:2024-05-09T05:04:10.262+0000 7fee8ba00640 -1 osd.6 0 waiting for initial osdmap 2024-05-09T05:04:10.272 INFO:tasks.ceph.osd.6.smithi133.stderr:2024-05-09T05:04:10.272+0000 7fee81000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.273 INFO:tasks.ceph.osd.4.smithi133.stderr:2024-05-09T05:04:10.273+0000 7f9c6dc00640 -1 osd.4 0 waiting for initial osdmap 2024-05-09T05:04:10.280 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-05-09T05:04:10.279+0000 7fd40b800640 -1 osd.2 0 waiting for initial osdmap 2024-05-09T05:04:10.283 INFO:tasks.ceph.osd.4.smithi133.stderr:2024-05-09T05:04:10.283+0000 7f9c63c00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.285 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-05-09T05:04:10.285+0000 7fd401800640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:04:10.307 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:10.456 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.455+0000 7f1283200640 1 Processor -- start 2024-05-09T05:04:10.456 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.455+0000 7f1283200640 1 -- start start 2024-05-09T05:04:10.457 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f1283200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c1468c0 0x7f127c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:10.457 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f1283200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f127c146ca0 0x7f127c06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:10.457 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f1283200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c0d0590 con 0x7f127c0cf8d0 2024-05-09T05:04:10.457 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f1283200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f127c161090 con 0x7f127c146ca0 2024-05-09T05:04:10.457 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f1283200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f127c0d0870 con 0x7f127c1468c0 2024-05-09T05:04:10.458 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f127b400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f127c146ca0 0x7f127c06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:10.458 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f127be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c1468c0 0x7f127c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:10.458 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f127be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c1468c0 0x7f127c06e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:57386/0 (socket says 172.21.15.100:57386) 2024-05-09T05:04:10.459 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.457+0000 7f127be00640 1 -- 172.21.15.100:0/3501414300 learned_addr learned my addr 172.21.15.100:0/3501414300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:10.459 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.458+0000 7f127b400640 1 -- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c1468c0 msgr2=0x7f127c06e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:10.459 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.458+0000 7f127b400640 1 --2- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c1468c0 0x7f127c06e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.459 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.458+0000 7f127b400640 1 -- 172.21.15.100:0/3501414300 >> v1:172.21.15.133:6789/0 conn(0x7f127c0cf8d0 legacy=0x7f127c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:10.459 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.458+0000 7f127b400640 1 -- 172.21.15.100:0/3501414300 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c0d0b50 con 0x7f127c146ca0 2024-05-09T05:04:10.459 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.459+0000 7f127b400640 1 --2- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c146ca0 0x7f127c06ed80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1268009790 tx=0x7f126802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e540918bcf28321d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:10.460 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f127aa00640 1 -- 172.21.15.100:0/3501414300 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268037070 con 0x7f127c146ca0 2024-05-09T05:04:10.460 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f127aa00640 1 -- 172.21.15.100:0/3501414300 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1268032440 con 0x7f127c146ca0 2024-05-09T05:04:10.460 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f127aa00640 1 -- 172.21.15.100:0/3501414300 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268032810 con 0x7f127c146ca0 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 -- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c146ca0 msgr2=0x7f127c06ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 --2- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c146ca0 0x7f127c06ed80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1268009790 tx=0x7f126802a180 comp rx=0 tx=0).stop 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 -- 172.21.15.100:0/3501414300 shutdown_connections 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 --2- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c146ca0 0x7f127c06ed80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 --2- 172.21.15.100:0/3501414300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c1468c0 0x7f127c06e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 -- 172.21.15.100:0/3501414300 >> 172.21.15.100:0/3501414300 conn(0x7f127c0b6640 msgr2=0x7f127c0b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 -- 172.21.15.100:0/3501414300 shutdown_connections 2024-05-09T05:04:10.461 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.460+0000 7f1283200640 1 -- 172.21.15.100:0/3501414300 wait complete. 2024-05-09T05:04:10.462 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.462+0000 7f1283200640 1 Processor -- start 2024-05-09T05:04:10.462 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.462+0000 7f1283200640 1 -- start start 2024-05-09T05:04:10.464 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1283200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c0cf8d0 0x7f127c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1283200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1468c0 0x7f127c15d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1283200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 0x7f127c15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1283200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f127c072aa0 con 0x7f127c146ca0 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1283200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f127c072580 con 0x7f127c1468c0 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1283200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f127c072c20 con 0x7f127c0cf8d0 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1281200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 0x7f127c15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1281200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 0x7f127c15dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36062/0 (socket says 172.21.15.100:36062) 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f1281200640 1 -- 172.21.15.100:0/2148685125 learned_addr learned my addr 172.21.15.100:0/2148685125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f127be00640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c0cf8d0 0x7f127c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.463+0000 7f127b400640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1468c0 0x7f127c15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1281200640 1 -- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c0cf8d0 msgr2=0x7f127c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1281200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c0cf8d0 0x7f127c0ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.465 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1281200640 1 -- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1468c0 msgr2=0x7f127c15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1281200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1468c0 0x7f127c15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1281200640 1 -- 172.21.15.100:0/2148685125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c13f580 con 0x7f127c146ca0 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1281200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 0x7f127c15dd40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f127400c7a0 tx=0x7f127400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274003b70 con 0x7f127c146ca0 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1274003d10 con 0x7f127c146ca0 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127400aa70 con 0x7f127c146ca0 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c13f2a0 con 0x7f127c146ca0 2024-05-09T05:04:10.466 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.464+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c0b0b10 con 0x7f127c146ca0 2024-05-09T05:04:10.467 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.465+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127c076930 con 0x7f127c146ca0 2024-05-09T05:04:10.467 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.466+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f127400ac10 con 0x7f127c146ca0 2024-05-09T05:04:10.468 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.467+0000 7f1273e00640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f125c076270 0x7f125c078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:10.468 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.467+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f1274096700 con 0x7f127c146ca0 2024-05-09T05:04:10.468 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.468+0000 7f127be00640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f125c076270 0x7f125c078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:10.468 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.468+0000 7f127be00640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f125c076270 0x7f125c078730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f126c009b60 tx=0x7f126c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:10.472 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.472+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1274060e30 con 0x7f127c146ca0 2024-05-09T05:04:10.662 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.662+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f127c15bb20 con 0x7f127c146ca0 2024-05-09T05:04:10.664 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.663+0000 7f1273e00640 1 -- 172.21.15.100:0/2148685125 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f1274060730 con 0x7f127c146ca0 2024-05-09T05:04:10.664 INFO:teuthology.misc.health.smithi100.stdout: 2024-05-09T05:04:10.664 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":12,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:07.898601+0000","last_up_change":"0.000000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f125c076270 msgr2=0x7f125c078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f125c076270 0x7f125c078730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f126c009b60 tx=0x7f126c008040 comp rx=0 tx=0).stop 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 msgr2=0x7f127c15dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 0x7f127c15dd40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f127400c7a0 tx=0x7f127400cc60 comp rx=0 tx=0).stop 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 shutdown_connections 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f125c076270 0x7f125c078730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c146ca0 0x7f127c15dd40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1468c0 0x7f127c15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 --2- 172.21.15.100:0/2148685125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f127c0cf8d0 0x7f127c0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:10.667 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 >> 172.21.15.100:0/2148685125 conn(0x7f127c0b6640 msgr2=0x7f127c161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:10.668 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 shutdown_connections 2024-05-09T05:04:10.668 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:10.666+0000 7f1283200640 1 -- 172.21.15.100:0/2148685125 wait complete. 2024-05-09T05:04:10.681 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-09T05:04:10.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:04:10.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:04:17.486 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.670+0000 7fdc09000640 1 Processor -- start 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.670+0000 7fdc09000640 1 -- start start 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.671+0000 7fdc09000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc040b5f70 0x7fdc040ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.671+0000 7fdc09000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc04072160 0x7fdc0408c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.671+0000 7fdc09000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.671+0000 7fdc09000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdc040725c0 con 0x7fdc040b5f70 2024-05-09T05:04:17.673 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.671+0000 7fdc09000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fdc040cebc0 con 0x7fdc04072160 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.671+0000 7fdc09000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdc040ceea0 con 0x7fdc0408c820 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc040b5f70 0x7fdc040ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc040b5f70 0x7fdc040ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51696/0 (socket says 172.21.15.100:51696) 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 -- 172.21.15.100:0/436307300 learned_addr learned my addr 172.21.15.100:0/436307300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc02a00640 1 --2- 172.21.15.100:0/436307300 >> v2:172.21.15.133:3300/0 conn(0x7fdc04072160 0x7fdc0408c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03e00640 1 --2- 172.21.15.100:0/436307300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 -- 172.21.15.100:0/436307300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 msgr2=0x7fdc040cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 --2- 172.21.15.100:0/436307300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 -- 172.21.15.100:0/436307300 >> v2:172.21.15.133:3300/0 conn(0x7fdc04072160 msgr2=0x7fdc0408c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 --2- 172.21.15.100:0/436307300 >> v2:172.21.15.133:3300/0 conn(0x7fdc04072160 0x7fdc0408c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.674 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.672+0000 7fdc03400640 1 -- 172.21.15.100:0/436307300 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc040cf180 con 0x7fdc040b5f70 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.673+0000 7fdc03400640 1 --2- 172.21.15.100:0/436307300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc040ce4e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406dcb0 tx=0x7fdbfc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2dc5f6fbb529f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc02000640 1 -- 172.21.15.100:0/436307300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc036070 con 0x7fdc040b5f70 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc02000640 1 -- 172.21.15.100:0/436307300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc031600 con 0x7fdc040b5f70 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc02000640 1 -- 172.21.15.100:0/436307300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0319d0 con 0x7fdc040b5f70 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 -- 172.21.15.100:0/436307300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 msgr2=0x7fdc040ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 --2- 172.21.15.100:0/436307300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc040ce4e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406dcb0 tx=0x7fdbfc02a610 comp rx=0 tx=0).stop 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 -- 172.21.15.100:0/436307300 shutdown_connections 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 --2- 172.21.15.100:0/436307300 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 --2- 172.21.15.100:0/436307300 >> v2:172.21.15.133:3300/0 conn(0x7fdc04072160 0x7fdc0408c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 --2- 172.21.15.100:0/436307300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc040ce4e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.674+0000 7fdc09000640 1 -- 172.21.15.100:0/436307300 >> 172.21.15.100:0/436307300 conn(0x7fdc040b0ad0 msgr2=0x7fdc040b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:17.676 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.675+0000 7fdc09000640 1 -- 172.21.15.100:0/436307300 shutdown_connections 2024-05-09T05:04:17.677 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.675+0000 7fdc09000640 1 -- 172.21.15.100:0/436307300 wait complete. 2024-05-09T05:04:17.677 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.676+0000 7fdc09000640 1 Processor -- start 2024-05-09T05:04:17.677 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 -- start start 2024-05-09T05:04:17.679 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc04072160 0x7fdc0408bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc0416db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0416c190 con 0x7fdc040b5f70 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdc040cf740 con 0x7fdc04072160 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.677+0000 7fdc09000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0416c310 con 0x7fdc0408c820 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc0416db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc0416db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51700/0 (socket says 172.21.15.100:51700) 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 -- 172.21.15.100:0/1033657713 learned_addr learned my addr 172.21.15.100:0/1033657713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03400640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc04072160 0x7fdc0408bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc02a00640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 -- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 msgr2=0x7fdc040b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:17.680 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 -- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc04072160 msgr2=0x7fdc0408bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc04072160 0x7fdc0408bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc03e00640 1 -- 172.21.15.100:0/1033657713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0415fdd0 con 0x7fdc040b5f70 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.678+0000 7fdc02a00640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.679+0000 7fdc03e00640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc0416db80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400d830 tx=0x7fdbf400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.679+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400b6c0 con 0x7fdc040b5f70 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.679+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf4019070 con 0x7fdc040b5f70 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.679+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc041600b0 con 0x7fdc040b5f70 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.679+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400bac0 con 0x7fdc040b5f70 2024-05-09T05:04:17.681 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.679+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc04160670 con 0x7fdc040b5f70 2024-05-09T05:04:17.682 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.680+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0415bd80 con 0x7fdc040b5f70 2024-05-09T05:04:17.682 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.681+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdbf401e460 con 0x7fdc040b5f70 2024-05-09T05:04:17.683 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.682+0000 7fdbfb400640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdbe00762d0 0x7fdbe0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:17.683 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.683+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fdbf4097a20 con 0x7fdc040b5f70 2024-05-09T05:04:17.683 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.683+0000 7fdc03400640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdbe00762d0 0x7fdbe0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:17.684 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.683+0000 7fdc03400640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdbe00762d0 0x7fdbe0078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc033000 tx=0x7fdbfc009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:17.691 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.691+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdbf4061630 con 0x7fdc040b5f70 2024-05-09T05:04:17.901 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.901+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc04076930 con 0x7fdc040b5f70 2024-05-09T05:04:17.902 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.902+0000 7fdbfb400640 1 -- 172.21.15.100:0/1033657713 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7fdbf4060f30 con 0x7fdc040b5f70 2024-05-09T05:04:17.903 INFO:teuthology.misc.health.smithi100.stdout: 2024-05-09T05:04:17.903 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":16,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:14.124363+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:17.905 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdbe00762d0 msgr2=0x7fdbe0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:17.905 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdbe00762d0 0x7fdbe0078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc033000 tx=0x7fdbfc009000 comp rx=0 tx=0).stop 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 msgr2=0x7fdc0416db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc0416db80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400d830 tx=0x7fdbf400dcf0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 shutdown_connections 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdbe00762d0 0x7fdbe0078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040b5f70 0x7fdc0416db80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc0408c820 0x7fdc040b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 --2- 172.21.15.100:0/1033657713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc04072160 0x7fdc0408bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 >> 172.21.15.100:0/1033657713 conn(0x7fdc040b0ad0 msgr2=0x7fdc04073850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 shutdown_connections 2024-05-09T05:04:17.906 INFO:teuthology.misc.health.smithi100.stderr:2024-05-09T05:04:17.905+0000 7fdc09000640 1 -- 172.21.15.100:0/1033657713 wait complete. 2024-05-09T05:04:17.921 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-09T05:04:17.921 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-09T05:04:17.922 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T05:04:17.922 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T05:04:17.927 INFO:tasks.ceph.mds.a:Started 2024-05-09T05:04:17.927 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T05:04:17.927 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T05:04:17.934 INFO:tasks.ceph.mds.c:Started 2024-05-09T05:04:17.934 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T05:04:17.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T05:04:17.942 INFO:tasks.ceph.mds.b:Started 2024-05-09T05:04:17.942 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T05:04:17.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T05:04:17.949 INFO:tasks.ceph.mds.d:Started 2024-05-09T05:04:17.950 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-09T05:04:17.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:18.070 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-05-09T05:04:18.070 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-05-09T05:04:18.072 INFO:tasks.ceph.mds.c.smithi100.stderr:2024-05-09T05:04:18.072+0000 7fb789a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-09T05:04:18.101 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2024-05-09T05:04:18.103 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2024-05-09T05:04:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.127+0000 7fb527c00640 1 Processor -- start 2024-05-09T05:04:18.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.127+0000 7fb527c00640 1 -- start start 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.128+0000 7fb527c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200baba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.128+0000 7fb527c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5200b45b0 0x7fb5200d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.128+0000 7fb527c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5200d3710 con 0x7fb5200d4cf0 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.128+0000 7fb527c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb52015f970 con 0x7fb5200b45b0 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.128+0000 7fb527c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb5200d4320 con 0x7fb52015f590 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.128+0000 7fb51fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5200b45b0 0x7fb5200d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5200b45b0 0x7fb5200d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51734/0 (socket says 172.21.15.100:51734) 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51fe00640 1 -- 172.21.15.100:0/3884910608 learned_addr learned my addr 172.21.15.100:0/3884910608 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb525c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb5200d4cf0 0x7fb5200b83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45402/0 (socket says 172.21.15.100:45402) 2024-05-09T05:04:18.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb525200640 1 --2- 172.21.15.100:0/3884910608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200baba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:18.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51fe00640 1 -- 172.21.15.100:0/3884910608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 msgr2=0x7fb5200baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:18.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51fe00640 1 --2- 172.21.15.100:0/3884910608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200baba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51fe00640 1 -- 172.21.15.100:0/3884910608 >> v1:172.21.15.100:6789/0 conn(0x7fb5200d4cf0 legacy=0x7fb5200b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:18.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51fe00640 1 -- 172.21.15.100:0/3884910608 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5200d39f0 con 0x7fb5200b45b0 2024-05-09T05:04:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.129+0000 7fb51f400640 1 -- 172.21.15.100:0/3884910608 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305020961 0 0) 0x7fb5200d3710 con 0x7fb5200d4cf0 2024-05-09T05:04:18.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.130+0000 7fb51fe00640 1 --2- 172.21.15.100:0/3884910608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200b45b0 0x7fb5200d47b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009870 tx=0x7fb50c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d674cf24c3c73c2a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.130+0000 7fb51f400640 1 -- 172.21.15.100:0/3884910608 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c037070 con 0x7fb5200b45b0 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.130+0000 7fb51f400640 1 -- 172.21.15.100:0/3884910608 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50c032440 con 0x7fb5200b45b0 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.130+0000 7fb51f400640 1 -- 172.21.15.100:0/3884910608 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c032810 con 0x7fb5200b45b0 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 -- 172.21.15.100:0/3884910608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200b45b0 msgr2=0x7fb5200d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 --2- 172.21.15.100:0/3884910608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200b45b0 0x7fb5200d47b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009870 tx=0x7fb50c02a1c0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 -- 172.21.15.100:0/3884910608 shutdown_connections 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 --2- 172.21.15.100:0/3884910608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200b45b0 0x7fb5200d47b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 --2- 172.21.15.100:0/3884910608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 -- 172.21.15.100:0/3884910608 >> 172.21.15.100:0/3884910608 conn(0x7fb520074130 msgr2=0x7fb5200d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 -- 172.21.15.100:0/3884910608 shutdown_connections 2024-05-09T05:04:18.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.131+0000 7fb527c00640 1 -- 172.21.15.100:0/3884910608 wait complete. 2024-05-09T05:04:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.133+0000 7fb527c00640 1 Processor -- start 2024-05-09T05:04:18.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.133+0000 7fb527c00640 1 -- start start 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb527c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5200b45b0 0x7fb52015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb527c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 0x7fb520158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb527c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200ba210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb527c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5200bb0e0 con 0x7fb5200d4cf0 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb527c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb5200d3fb0 con 0x7fb5200b45b0 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb527c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb5200b8ac0 con 0x7fb52015f590 2024-05-09T05:04:18.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb51fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 0x7fb520158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb51fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 0x7fb520158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51750/0 (socket says 172.21.15.100:51750) 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb51fe00640 1 -- 172.21.15.100:0/692912659 learned_addr learned my addr 172.21.15.100:0/692912659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb525200640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5200b45b0 0x7fb52015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.134+0000 7fb525c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51fe00640 1 -- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 msgr2=0x7fb5200ba210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51fe00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200ba210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51fe00640 1 -- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5200b45b0 msgr2=0x7fb52015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51fe00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5200b45b0 0x7fb52015bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51fe00640 1 -- 172.21.15.100:0/692912659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5201f8690 con 0x7fb5200d4cf0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51fe00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 0x7fb520158850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb50c02a200 tx=0x7fb50c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c037040 con 0x7fb5200d4cf0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50c042070 con 0x7fb5200d4cf0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c030880 con 0x7fb5200d4cf0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5201f8970 con 0x7fb5200d4cf0 2024-05-09T05:04:18.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.135+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5201f8f30 con 0x7fb5200d4cf0 2024-05-09T05:04:18.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.136+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52006a5c0 con 0x7fb5200d4cf0 2024-05-09T05:04:18.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.137+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb50c02ad10 con 0x7fb5200d4cf0 2024-05-09T05:04:18.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.138+0000 7fb51cc00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb5000762d0 0x7fb500078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:18.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.138+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb50c0b76b0 con 0x7fb5200d4cf0 2024-05-09T05:04:18.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.139+0000 7fb525200640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb5000762d0 0x7fb500078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:18.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.139+0000 7fb525200640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb5000762d0 0x7fb500078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb514009aa0 tx=0x7fb514009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:18.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.144+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb50c080d00 con 0x7fb5200d4cf0 2024-05-09T05:04:18.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.385+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb52006c3d0 con 0x7fb5200d4cf0 2024-05-09T05:04:18.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.386+0000 7fb51cc00640 1 -- 172.21.15.100:0/692912659 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fb50c085000 con 0x7fb5200d4cf0 2024-05-09T05:04:18.386 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:18.387 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T05:04:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb5000762d0 msgr2=0x7fb500078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb5000762d0 0x7fb500078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb514009aa0 tx=0x7fb514009190 comp rx=0 tx=0).stop 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 msgr2=0x7fb520158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 0x7fb520158850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb50c02a200 tx=0x7fb50c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 shutdown_connections 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb5000762d0 0x7fb500078790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb52015f590 0x7fb5200ba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5200d4cf0 0x7fb520158850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 --2- 172.21.15.100:0/692912659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5200b45b0 0x7fb52015bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 >> 172.21.15.100:0/692912659 conn(0x7fb520074130 msgr2=0x7fb5200c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.388+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 shutdown_connections 2024-05-09T05:04:18.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:18.389+0000 7fb527c00640 1 -- 172.21.15.100:0/692912659 wait complete. 2024-05-09T05:04:20.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:20.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.618+0000 7f4a33a00640 1 Processor -- start 2024-05-09T05:04:20.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.618+0000 7f4a33a00640 1 -- start start 2024-05-09T05:04:20.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.620+0000 7f4a33a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a2c072650 0x7f4a2c072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:20.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.620+0000 7f4a33a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a2c06ebf0 0x7f4a2c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:20.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.620+0000 7f4a33a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c073380 con 0x7f4a2c0b47a0 2024-05-09T05:04:20.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.620+0000 7f4a33a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2c1562b0 con 0x7f4a2c072650 2024-05-09T05:04:20.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.620+0000 7f4a33a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2c073f00 con 0x7f4a2c06ebf0 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.620+0000 7f4a23e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a2c072650 0x7f4a2c072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a23e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a2c072650 0x7f4a2c072ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51762/0 (socket says 172.21.15.100:51762) 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a23e00640 1 -- 172.21.15.100:0/3001700860 learned_addr learned my addr 172.21.15.100:0/3001700860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a31a00640 1 --2- 172.21.15.100:0/3001700860 >> v2:172.21.15.133:3300/0 conn(0x7f4a2c06ebf0 0x7f4a2c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a23e00640 1 -- 172.21.15.100:0/3001700860 >> v2:172.21.15.133:3300/0 conn(0x7f4a2c06ebf0 msgr2=0x7f4a2c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a23e00640 1 --2- 172.21.15.100:0/3001700860 >> v2:172.21.15.133:3300/0 conn(0x7f4a2c06ebf0 0x7f4a2c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a23e00640 1 -- 172.21.15.100:0/3001700860 >> v1:172.21.15.133:6789/0 conn(0x7f4a2c0b47a0 legacy=0x7f4a2c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a23e00640 1 -- 172.21.15.100:0/3001700860 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c073660 con 0x7f4a2c072650 2024-05-09T05:04:20.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.621+0000 7f4a31a00640 1 --2- 172.21.15.100:0/3001700860 >> v2:172.21.15.133:3300/0 conn(0x7f4a2c06ebf0 0x7f4a2c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:20.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.622+0000 7f4a23e00640 1 --2- 172.21.15.100:0/3001700860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c072ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b3ab0 tx=0x7f4a1402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5ea80b775b3919 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.622+0000 7f4a2be00640 1 -- 172.21.15.100:0/3001700860 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14032700 con 0x7f4a2c072650 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.622+0000 7f4a2be00640 1 -- 172.21.15.100:0/3001700860 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a140328a0 con 0x7f4a2c072650 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.622+0000 7f4a2be00640 1 -- 172.21.15.100:0/3001700860 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14032c70 con 0x7f4a2c072650 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 -- 172.21.15.100:0/3001700860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 msgr2=0x7f4a2c072ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 --2- 172.21.15.100:0/3001700860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c072ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0b3ab0 tx=0x7f4a1402c800 comp rx=0 tx=0).stop 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 -- 172.21.15.100:0/3001700860 shutdown_connections 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 --2- 172.21.15.100:0/3001700860 >> v2:172.21.15.133:3300/0 conn(0x7f4a2c06ebf0 0x7f4a2c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 --2- 172.21.15.100:0/3001700860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c072ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 -- 172.21.15.100:0/3001700860 >> 172.21.15.100:0/3001700860 conn(0x7f4a2c0b31e0 msgr2=0x7f4a2c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 -- 172.21.15.100:0/3001700860 shutdown_connections 2024-05-09T05:04:20.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.623+0000 7f4a33a00640 1 -- 172.21.15.100:0/3001700860 wait complete. 2024-05-09T05:04:20.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.625+0000 7f4a33a00640 1 Processor -- start 2024-05-09T05:04:20.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.625+0000 7f4a33a00640 1 -- start start 2024-05-09T05:04:20.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a33a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a2c06ebf0 0x7f4a2c147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:20.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a33a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c09bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:20.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a33a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a2c0b47a0 0x7f4a2c09c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:20.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a33a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c073010 con 0x7f4a2c072650 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a33a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c073c20 con 0x7f4a2c0b47a0 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a33a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c15cbe0 con 0x7f4a2c06ebf0 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a23e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c09bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a23e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c09bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51770/0 (socket says 172.21.15.100:51770) 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.626+0000 7f4a23e00640 1 -- 172.21.15.100:0/1975204769 learned_addr learned my addr 172.21.15.100:0/1975204769 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a23e00640 1 -- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a2c06ebf0 msgr2=0x7f4a2c147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a31000640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a2c06ebf0 0x7f4a2c147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a31a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a2c0b47a0 0x7f4a2c09c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a23e00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a2c06ebf0 0x7f4a2c147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a23e00640 1 -- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a2c0b47a0 msgr2=0x7f4a2c09c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a23e00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a2c0b47a0 0x7f4a2c09c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a23e00640 1 -- 172.21.15.100:0/1975204769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c1f86d0 con 0x7f4a2c072650 2024-05-09T05:04:20.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a31000640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a2c06ebf0 0x7f4a2c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:20.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a23e00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c09bbc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a1402c840 tx=0x7f4a140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:20.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14043020 con 0x7f4a2c072650 2024-05-09T05:04:20.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a14034c80 con 0x7f4a2c072650 2024-05-09T05:04:20.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c1f8970 con 0x7f4a2c072650 2024-05-09T05:04:20.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1403f6b0 con 0x7f4a2c072650 2024-05-09T05:04:20.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.627+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a2c1f8f30 con 0x7f4a2c072650 2024-05-09T05:04:20.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.628+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c06a5c0 con 0x7f4a2c072650 2024-05-09T05:04:20.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.630+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4a14046020 con 0x7f4a2c072650 2024-05-09T05:04:20.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.631+0000 7f4a29600640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4a080762d0 0x7f4a08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:20.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.631+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4a140b82e0 con 0x7f4a2c072650 2024-05-09T05:04:20.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.631+0000 7f4a31000640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4a080762d0 0x7f4a08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:20.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.632+0000 7f4a31000640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4a080762d0 0x7f4a08078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00a830 tx=0x7f4a1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:20.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.635+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a1404d030 con 0x7f4a2c072650 2024-05-09T05:04:20.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.878+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a2c15c420 con 0x7f4a2c072650 2024-05-09T05:04:20.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.879+0000 7f4a29600640 1 -- 172.21.15.100:0/1975204769 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f4a14031070 con 0x7f4a2c072650 2024-05-09T05:04:20.880 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:20.880 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-09T05:04:20.881 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4a080762d0 msgr2=0x7f4a08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4a080762d0 0x7f4a08078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00a830 tx=0x7f4a1c008040 comp rx=0 tx=0).stop 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 msgr2=0x7f4a2c09bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c09bbc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a1402c840 tx=0x7f4a140046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 shutdown_connections 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4a080762d0 0x7f4a08078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a2c0b47a0 0x7f4a2c09c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c072650 0x7f4a2c09bbc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 --2- 172.21.15.100:0/1975204769 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a2c06ebf0 0x7f4a2c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.882+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 >> 172.21.15.100:0/1975204769 conn(0x7f4a2c0b31e0 msgr2=0x7f4a2c155980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.883+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 shutdown_connections 2024-05-09T05:04:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:20.883+0000 7f4a33a00640 1 -- 172.21.15.100:0/1975204769 wait complete. 2024-05-09T05:04:20.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T05:04:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.095+0000 7f019fa00640 1 Processor -- start 2024-05-09T05:04:21.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.095+0000 7f019fa00640 1 -- start start 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019fa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01980ade90 0x7f01980b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019fa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01980afb70 0x7f01980affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019fa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01980b55b0 con 0x7f01980d0a70 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019fa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f01980ae3a0 con 0x7f01980afb70 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019fa00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f01980b4590 con 0x7f01980ade90 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019d000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f01980d0a70 0x7f019815e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45406/0 (socket says 172.21.15.100:45406) 2024-05-09T05:04:21.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019d000640 1 -- 172.21.15.100:0/97855407 learned_addr learned my addr 172.21.15.100:0/97855407 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.097+0000 7f019da00640 1 --2- 172.21.15.100:0/97855407 >> v2:172.21.15.100:3300/0 conn(0x7f01980afb70 0x7f01980affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f0197e00640 1 -- 172.21.15.100:0/97855407 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416776043 0 0) 0x7f0188001110 con 0x7f01980d0a70 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f0197e00640 1 -- 172.21.15.100:0/97855407 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017c003520 con 0x7f01980d0a70 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f018fe00640 1 --2- 172.21.15.100:0/97855407 >> v2:172.21.15.133:3300/0 conn(0x7f01980ade90 0x7f01980b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f019da00640 1 -- 172.21.15.100:0/97855407 >> v2:172.21.15.133:3300/0 conn(0x7f01980ade90 msgr2=0x7f01980b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f019da00640 1 --2- 172.21.15.100:0/97855407 >> v2:172.21.15.133:3300/0 conn(0x7f01980ade90 0x7f01980b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f019da00640 1 -- 172.21.15.100:0/97855407 >> v1:172.21.15.100:6789/0 conn(0x7f01980d0a70 legacy=0x7f019815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.098+0000 7f019da00640 1 -- 172.21.15.100:0/97855407 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01980b4870 con 0x7f01980afb70 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.099+0000 7f019da00640 1 --2- 172.21.15.100:0/97855407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f01980affa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01980b0930 tx=0x7f019002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea118e10a506d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.099+0000 7f0197e00640 1 -- 172.21.15.100:0/97855407 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190007740 con 0x7f01980afb70 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f0197e00640 1 -- 172.21.15.100:0/97855407 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01900078e0 con 0x7f01980afb70 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f0197e00640 1 -- 172.21.15.100:0/97855407 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190007c90 con 0x7f01980afb70 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 -- 172.21.15.100:0/97855407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 msgr2=0x7f01980affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 --2- 172.21.15.100:0/97855407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f01980affa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01980b0930 tx=0x7f019002a680 comp rx=0 tx=0).stop 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 -- 172.21.15.100:0/97855407 shutdown_connections 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 --2- 172.21.15.100:0/97855407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f01980affa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 --2- 172.21.15.100:0/97855407 >> v2:172.21.15.133:3300/0 conn(0x7f01980ade90 0x7f01980b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 -- 172.21.15.100:0/97855407 >> 172.21.15.100:0/97855407 conn(0x7f01980b31e0 msgr2=0x7f01980d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 -- 172.21.15.100:0/97855407 shutdown_connections 2024-05-09T05:04:21.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.100+0000 7f019fa00640 1 -- 172.21.15.100:0/97855407 wait complete. 2024-05-09T05:04:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.102+0000 7f019fa00640 1 Processor -- start 2024-05-09T05:04:21.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.102+0000 7f019fa00640 1 -- start start 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f019fa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01980ade90 0x7f019806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f019fa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f0198070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f019fa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01980d0a70 0x7f01981f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f019fa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01980b04e0 con 0x7f01980afb70 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f019fa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f01980ae680 con 0x7f01980ade90 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f019fa00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f0198072570 con 0x7f01980d0a70 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f018fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f0198070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f018fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f0198070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51786/0 (socket says 172.21.15.100:51786) 2024-05-09T05:04:21.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.103+0000 7f018fe00640 1 -- 172.21.15.100:0/3771596754 learned_addr learned my addr 172.21.15.100:0/3771596754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f019da00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01980d0a70 0x7f01981f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f018fe00640 1 -- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01980d0a70 msgr2=0x7f01981f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f018fe00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01980d0a70 0x7f01981f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f018fe00640 1 -- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01980ade90 msgr2=0x7f019806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f018fe00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01980ade90 0x7f019806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f018fe00640 1 -- 172.21.15.100:0/3771596754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019806ea80 con 0x7f01980afb70 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f018fe00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f0198070070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f018000d800 tx=0x7f018000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018000b6c0 con 0x7f01980afb70 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0180019070 con 0x7f01980afb70 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019806ed60 con 0x7f01980afb70 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.104+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018000ba80 con 0x7f01980afb70 2024-05-09T05:04:21.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.105+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019806f320 con 0x7f01980afb70 2024-05-09T05:04:21.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.106+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0198076070 con 0x7f01980afb70 2024-05-09T05:04:21.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.107+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f018000bc20 con 0x7f01980afb70 2024-05-09T05:04:21.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.108+0000 7f0195600640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f01740762d0 0x7f0174078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.108+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f01800976f0 con 0x7f01980afb70 2024-05-09T05:04:21.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.108+0000 7f019d000640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f01740762d0 0x7f0174078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.109+0000 7f019d000640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f01740762d0 0x7f0174078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01880013f0 tx=0x7f0188001240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:21.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.115+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0180061430 con 0x7f01980afb70 2024-05-09T05:04:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.321+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f019806a5c0 con 0x7f01980afb70 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.322+0000 7f0195600640 1 -- 172.21.15.100:0/3771596754 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f0180060d30 con 0x7f01980afb70 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:04:21.323 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f01740762d0 msgr2=0x7f0174078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f01740762d0 0x7f0174078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01880013f0 tx=0x7f0188001240 comp rx=0 tx=0).stop 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 msgr2=0x7f0198070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f0198070070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f018000d800 tx=0x7f018000dcc0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 shutdown_connections 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f01740762d0 0x7f0174078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01980d0a70 0x7f01981f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01980afb70 0x7f0198070070 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 --2- 172.21.15.100:0/3771596754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01980ade90 0x7f019806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 >> 172.21.15.100:0/3771596754 conn(0x7f01980b31e0 msgr2=0x7f0198072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:21.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 shutdown_connections 2024-05-09T05:04:21.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.325+0000 7f019fa00640 1 -- 172.21.15.100:0/3771596754 wait complete. 2024-05-09T05:04:21.343 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T05:04:21.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T05:04:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.547+0000 7fac89a00640 1 Processor -- start 2024-05-09T05:04:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.548+0000 7fac89a00640 1 -- start start 2024-05-09T05:04:21.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.549+0000 7fac89a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac840b5e10 0x7fac841639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.549+0000 7fac89a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac84160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.549+0000 7fac89a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8415f8c0 con 0x7fac8406fd50 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.549+0000 7fac89a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fac841608c0 con 0x7fac840b5e10 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.549+0000 7fac89a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fac8415fef0 con 0x7fac840724b0 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac840b5e10 0x7fac841639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac840b5e10 0x7fac841639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51798/0 (socket says 172.21.15.100:51798) 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 -- 172.21.15.100:0/2185474570 learned_addr learned my addr 172.21.15.100:0/2185474570 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac82a00640 1 --1- 172.21.15.100:0/2185474570 >> v1:172.21.15.100:6789/0 conn(0x7fac8406fd50 0x7fac840b5700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45416/0 (socket says 172.21.15.100:45416) 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac83400640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac84160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 -- 172.21.15.100:0/2185474570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 msgr2=0x7fac84160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:21.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac84160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 -- 172.21.15.100:0/2185474570 >> v1:172.21.15.100:6789/0 conn(0x7fac8406fd50 legacy=0x7fac840b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac7be00640 1 -- 172.21.15.100:0/2185474570 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84072c30 con 0x7fac840b5e10 2024-05-09T05:04:21.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.550+0000 7fac83400640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac84160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.551+0000 7fac7be00640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac840b5e10 0x7fac841639e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64389c8bf0a7740 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.551+0000 7fac82000640 1 -- 172.21.15.100:0/2185474570 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c037070 con 0x7fac840b5e10 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.551+0000 7fac82000640 1 -- 172.21.15.100:0/2185474570 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c032440 con 0x7fac840b5e10 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.551+0000 7fac82000640 1 -- 172.21.15.100:0/2185474570 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c032810 con 0x7fac840b5e10 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 -- 172.21.15.100:0/2185474570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac840b5e10 msgr2=0x7fac841639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac840b5e10 0x7fac841639e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c02a250 comp rx=0 tx=0).stop 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 -- 172.21.15.100:0/2185474570 shutdown_connections 2024-05-09T05:04:21.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac84160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 --2- 172.21.15.100:0/2185474570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac840b5e10 0x7fac841639e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 -- 172.21.15.100:0/2185474570 >> 172.21.15.100:0/2185474570 conn(0x7fac840b2c20 msgr2=0x7fac840b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 -- 172.21.15.100:0/2185474570 shutdown_connections 2024-05-09T05:04:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.552+0000 7fac89a00640 1 -- 172.21.15.100:0/2185474570 wait complete. 2024-05-09T05:04:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.554+0000 7fac89a00640 1 Processor -- start 2024-05-09T05:04:21.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.554+0000 7fac89a00640 1 -- start start 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac89a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 0x7fac841f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac89a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac8415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac89a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac840b5e10 0x7fac841e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac89a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac84072900 con 0x7fac8406fd50 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac89a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fac8415fb80 con 0x7fac840b5e10 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac89a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fac8406e470 con 0x7fac840724b0 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.555+0000 7fac82a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 0x7fac841f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 0x7fac841f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51806/0 (socket says 172.21.15.100:51806) 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 -- 172.21.15.100:0/2271712310 learned_addr learned my addr 172.21.15.100:0/2271712310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac7be00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac8415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 -- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 msgr2=0x7fac8415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac8415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 -- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac840b5e10 msgr2=0x7fac841e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac840b5e10 0x7fac841e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 -- 172.21.15.100:0/2271712310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac841ea5b0 con 0x7fac8406fd50 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac82a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 0x7fac841f5600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac7400c420 tx=0x7fac7400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac740074e0 con 0x7fac8406fd50 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac74007680 con 0x7fac8406fd50 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74004a20 con 0x7fac8406fd50 2024-05-09T05:04:21.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.556+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8409ccb0 con 0x7fac8406fd50 2024-05-09T05:04:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.557+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8409d270 con 0x7fac8406fd50 2024-05-09T05:04:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.558+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84069500 con 0x7fac8406fd50 2024-05-09T05:04:21.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.559+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac7401a020 con 0x7fac8406fd50 2024-05-09T05:04:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.560+0000 7fac7aa00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fac600762d0 0x7fac60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:21.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.560+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fac74096b40 con 0x7fac8406fd50 2024-05-09T05:04:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.560+0000 7fac7be00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fac600762d0 0x7fac60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:21.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.561+0000 7fac7be00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fac600762d0 0x7fac60078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac6c034000 tx=0x7fac6c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:21.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.564+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac740607e0 con 0x7fac8406fd50 2024-05-09T05:04:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:21.757+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fac840b3810 con 0x7fac8406fd50 2024-05-09T05:04:22.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.123+0000 7fac7aa00640 1 -- 172.21.15.100:0/2271712310 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fac740600e0 con 0x7fac8406fd50 2024-05-09T05:04:22.124 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-05-09T05:04:22.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fac600762d0 msgr2=0x7fac60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:22.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fac600762d0 0x7fac60078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac6c034000 tx=0x7fac6c02e000 comp rx=0 tx=0).stop 2024-05-09T05:04:22.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 msgr2=0x7fac841f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 0x7fac841f5600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac7400c420 tx=0x7fac7400c8e0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 shutdown_connections 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fac600762d0 0x7fac60078790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac840b5e10 0x7fac841e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac840724b0 0x7fac8415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 --2- 172.21.15.100:0/2271712310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8406fd50 0x7fac841f5600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.127+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 >> 172.21.15.100:0/2271712310 conn(0x7fac840b2c20 msgr2=0x7fac8415d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:22.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.128+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 shutdown_connections 2024-05-09T05:04:22.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.128+0000 7fac89a00640 1 -- 172.21.15.100:0/2271712310 wait complete. 2024-05-09T05:04:22.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T05:04:22.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.349+0000 7fb5b6800640 1 Processor -- start 2024-05-09T05:04:22.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.349+0000 7fb5b6800640 1 -- start start 2024-05-09T05:04:22.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.350+0000 7fb5b6800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5b00b5af0 0x7fb5b015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:22.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.350+0000 7fb5b6800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b00b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:22.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.350+0000 7fb5b6800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b015c530 con 0x7fb5b00b0510 2024-05-09T05:04:22.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.350+0000 7fb5b6800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb5b0073c30 con 0x7fb5b00b5af0 2024-05-09T05:04:22.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.350+0000 7fb5b6800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b0073020 con 0x7fb5b01608e0 2024-05-09T05:04:22.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.351+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b00b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:22.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.351+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b00b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:45866/0 (socket says 172.21.15.100:45866) 2024-05-09T05:04:22.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.351+0000 7fb5afe00640 1 -- 172.21.15.100:0/1120572798 learned_addr learned my addr 172.21.15.100:0/1120572798 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:22.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.351+0000 7fb5af400640 1 --2- 172.21.15.100:0/1120572798 >> v2:172.21.15.133:3300/0 conn(0x7fb5b00b5af0 0x7fb5b015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.352+0000 7fb5afe00640 1 -- 172.21.15.100:0/1120572798 >> v2:172.21.15.133:3300/0 conn(0x7fb5b00b5af0 msgr2=0x7fb5b015fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.352+0000 7fb5afe00640 1 --2- 172.21.15.100:0/1120572798 >> v2:172.21.15.133:3300/0 conn(0x7fb5b00b5af0 0x7fb5b015fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.352+0000 7fb5afe00640 1 -- 172.21.15.100:0/1120572798 >> v1:172.21.15.133:6789/0 conn(0x7fb5b00b0510 legacy=0x7fb5b01601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.352+0000 7fb5afe00640 1 -- 172.21.15.100:0/1120572798 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b0073300 con 0x7fb5b01608e0 2024-05-09T05:04:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.353+0000 7fb5afe00640 1 --2- 172.21.15.100:0/1120572798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b00b3e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009870 tx=0x7fb5a802c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a3f9f4b451685b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.354+0000 7fb5ae000640 1 -- 172.21.15.100:0/1120572798 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8038070 con 0x7fb5b01608e0 2024-05-09T05:04:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.354+0000 7fb5ae000640 1 -- 172.21.15.100:0/1120572798 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a8031710 con 0x7fb5b01608e0 2024-05-09T05:04:22.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.354+0000 7fb5ae000640 1 -- 172.21.15.100:0/1120572798 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8031ae0 con 0x7fb5b01608e0 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.354+0000 7fb5b6800640 1 -- 172.21.15.100:0/1120572798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 msgr2=0x7fb5b00b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.354+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1120572798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b00b3e40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009870 tx=0x7fb5a802c480 comp rx=0 tx=0).stop 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.355+0000 7fb5b6800640 1 -- 172.21.15.100:0/1120572798 shutdown_connections 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.355+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1120572798 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b00b3e40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.355+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1120572798 >> v2:172.21.15.133:3300/0 conn(0x7fb5b00b5af0 0x7fb5b015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.355+0000 7fb5b6800640 1 -- 172.21.15.100:0/1120572798 >> 172.21.15.100:0/1120572798 conn(0x7fb5b00b2b40 msgr2=0x7fb5b00b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.355+0000 7fb5b6800640 1 -- 172.21.15.100:0/1120572798 shutdown_connections 2024-05-09T05:04:22.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.355+0000 7fb5b6800640 1 -- 172.21.15.100:0/1120572798 wait complete. 2024-05-09T05:04:22.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.356+0000 7fb5b6800640 1 Processor -- start 2024-05-09T05:04:22.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 -- start start 2024-05-09T05:04:22.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 0x7fb5b0154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:22.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5b00b5af0 0x7fb5b01f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:22.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b01f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:22.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00740c0 con 0x7fb5b00b0510 2024-05-09T05:04:22.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00738c0 con 0x7fb5b00b5af0 2024-05-09T05:04:22.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.357+0000 7fb5b6800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b0155160 con 0x7fb5b01608e0 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 0x7fb5b0154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 0x7fb5b0154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49660/0 (socket says 172.21.15.100:49660) 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 -- 172.21.15.100:0/1689087442 learned_addr learned my addr 172.21.15.100:0/1689087442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5afe00640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b01f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 -- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 msgr2=0x7fb5b01f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b01f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 -- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5b00b5af0 msgr2=0x7fb5b01f8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5aea00640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5b00b5af0 0x7fb5b01f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5b00b5af0 0x7fb5b01f8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5af400640 1 -- 172.21.15.100:0/1689087442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b01553c0 con 0x7fb5b00b0510 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.358+0000 7fb5aea00640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5b00b5af0 0x7fb5b01f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.359+0000 7fb5af400640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 0x7fb5b0154c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009db0 tx=0x7fb5a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.359+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0018020 con 0x7fb5b00b0510 2024-05-09T05:04:22.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.359+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5a0014480 con 0x7fb5b00b0510 2024-05-09T05:04:22.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.359+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0014850 con 0x7fb5b00b0510 2024-05-09T05:04:22.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.359+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b0157820 con 0x7fb5b00b0510 2024-05-09T05:04:22.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.359+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b0159f00 con 0x7fb5b00b0510 2024-05-09T05:04:22.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.360+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b006a6d0 con 0x7fb5b00b0510 2024-05-09T05:04:22.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.361+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb5a0005d10 con 0x7fb5b00b0510 2024-05-09T05:04:22.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.362+0000 7fb5a7400640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb58c0762d0 0x7fb58c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:22.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.363+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fb5a0097fb0 con 0x7fb5b00b0510 2024-05-09T05:04:22.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.363+0000 7fb5aea00640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb58c0762d0 0x7fb58c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:22.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.363+0000 7fb5aea00640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb58c0762d0 0x7fb58c078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0070390 tx=0x7fb598009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:22.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.368+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb5a0022070 con 0x7fb5b00b0510 2024-05-09T05:04:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:22.572+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5b00d0c00 con 0x7fb5b00b0510 2024-05-09T05:04:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.140+0000 7fb5a7400640 1 -- 172.21.15.100:0/1689087442 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fb5a0010040 con 0x7fb5b00b0510 2024-05-09T05:04:23.141 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-05-09T05:04:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.144+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb58c0762d0 msgr2=0x7fb58c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.144+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb58c0762d0 0x7fb58c078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0070390 tx=0x7fb598009040 comp rx=0 tx=0).stop 2024-05-09T05:04:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.144+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 msgr2=0x7fb5b0154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:23.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.144+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 0x7fb5b0154c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009db0 tx=0x7fb5a000c490 comp rx=0 tx=0).stop 2024-05-09T05:04:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.145+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 shutdown_connections 2024-05-09T05:04:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.145+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb58c0762d0 0x7fb58c078790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.145+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb5b01608e0 0x7fb5b01f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.145+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5b00b5af0 0x7fb5b01f8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.145+0000 7fb5b6800640 1 --2- 172.21.15.100:0/1689087442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5b00b0510 0x7fb5b0154c20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.145+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 >> 172.21.15.100:0/1689087442 conn(0x7fb5b00b2b40 msgr2=0x7fb5b0154440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:23.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.147+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 shutdown_connections 2024-05-09T05:04:23.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.149+0000 7fb5b6800640 1 -- 172.21.15.100:0/1689087442 wait complete. 2024-05-09T05:04:23.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T05:04:23.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.361+0000 7fa82ee00640 1 Processor -- start 2024-05-09T05:04:23.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.361+0000 7fa82ee00640 1 -- start start 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa82ee00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8280b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa82ee00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8280b02a0 0x7fa8280cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa82ee00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa828160ba0 con 0x7fa8280b0720 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa82ee00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa82815d590 con 0x7fa8280b02a0 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa82ee00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa82815ff90 con 0x7fa82815d1b0 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa81f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8280b02a0 0x7fa8280cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa81f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8280b02a0 0x7fa8280cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49674/0 (socket says 172.21.15.100:49674) 2024-05-09T05:04:23.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.363+0000 7fa81f400640 1 -- 172.21.15.100:0/2807101716 learned_addr learned my addr 172.21.15.100:0/2807101716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.364+0000 7fa827e00640 1 --2- 172.21.15.100:0/2807101716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8280b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.364+0000 7fa81f400640 1 -- 172.21.15.100:0/2807101716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 msgr2=0x7fa8280b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.364+0000 7fa81f400640 1 --2- 172.21.15.100:0/2807101716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8280b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.364+0000 7fa81f400640 1 -- 172.21.15.100:0/2807101716 >> v1:172.21.15.133:6789/0 conn(0x7fa8280b0720 legacy=0x7fa828163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.364+0000 7fa81f400640 1 -- 172.21.15.100:0/2807101716 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa828160270 con 0x7fa8280b02a0 2024-05-09T05:04:23.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.365+0000 7fa81f400640 1 --2- 172.21.15.100:0/2807101716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b02a0 0x7fa8280cff00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa810009870 tx=0x7fa81002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a411125e2ac965 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.365+0000 7fa827400640 1 -- 172.21.15.100:0/2807101716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810037070 con 0x7fa8280b02a0 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.365+0000 7fa827400640 1 -- 172.21.15.100:0/2807101716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa810032440 con 0x7fa8280b02a0 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.365+0000 7fa827400640 1 -- 172.21.15.100:0/2807101716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810032810 con 0x7fa8280b02a0 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 -- 172.21.15.100:0/2807101716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b02a0 msgr2=0x7fa8280cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2807101716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b02a0 0x7fa8280cff00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa810009870 tx=0x7fa81002a130 comp rx=0 tx=0).stop 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 -- 172.21.15.100:0/2807101716 shutdown_connections 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2807101716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b02a0 0x7fa8280cff00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2807101716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8280b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 -- 172.21.15.100:0/2807101716 >> 172.21.15.100:0/2807101716 conn(0x7fa8280b2c90 msgr2=0x7fa8280b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 -- 172.21.15.100:0/2807101716 shutdown_connections 2024-05-09T05:04:23.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.366+0000 7fa82ee00640 1 -- 172.21.15.100:0/2807101716 wait complete. 2024-05-09T05:04:23.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.368+0000 7fa82ee00640 1 Processor -- start 2024-05-09T05:04:23.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.368+0000 7fa82ee00640 1 -- start start 2024-05-09T05:04:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa82ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8280b02a0 0x7fa8280aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:23.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa82ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 0x7fa8281f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa82ee00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8281e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa82ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8280b57c0 con 0x7fa8280b0720 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa82ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa828160830 con 0x7fa8280b02a0 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa82ee00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa82815fc10 con 0x7fa82815d1b0 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa81f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 0x7fa8281f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa81f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 0x7fa8281f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49682/0 (socket says 172.21.15.100:49682) 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa81f400640 1 -- 172.21.15.100:0/2712644231 learned_addr learned my addr 172.21.15.100:0/2712644231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:23.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.369+0000 7fa827e00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8280b02a0 0x7fa8280aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa81f400640 1 -- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 msgr2=0x7fa8281e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa82ce00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8281e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa81f400640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8281e94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa81f400640 1 -- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8280b02a0 msgr2=0x7fa8280aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa81f400640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8280b02a0 0x7fa8280aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa81f400640 1 -- 172.21.15.100:0/2712644231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8280cd0d0 con 0x7fa8280b0720 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa827e00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8280b02a0 0x7fa8280aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa81f400640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 0x7fa8281f5e60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa810000c00 tx=0x7fa8100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810041020 con 0x7fa8280b0720 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8100306c0 con 0x7fa8280b0720 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8281f63a0 con 0x7fa8280b0720 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.370+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810037040 con 0x7fa8280b0720 2024-05-09T05:04:23.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.371+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8280ae2f0 con 0x7fa8280b0720 2024-05-09T05:04:23.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.372+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82806a630 con 0x7fa8280b0720 2024-05-09T05:04:23.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.373+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa810044020 con 0x7fa8280b0720 2024-05-09T05:04:23.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.374+0000 7fa824c00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8040762d0 0x7fa804078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:23.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.374+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fa8100b8220 con 0x7fa8280b0720 2024-05-09T05:04:23.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.375+0000 7fa827e00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8040762d0 0x7fa804078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:23.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.375+0000 7fa827e00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8040762d0 0x7fa804078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa818007330 tx=0x7fa81800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:23.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.378+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa81004b030 con 0x7fa8280b0720 2024-05-09T05:04:23.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:23.611+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa8280cdf50 con 0x7fa8280b0720 2024-05-09T05:04:24.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.144+0000 7fa824c00640 1 -- 172.21.15.100:0/2712644231 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa810081bc0 con 0x7fa8280b0720 2024-05-09T05:04:24.145 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T05:04:24.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8040762d0 msgr2=0x7fa804078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8040762d0 0x7fa804078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa818007330 tx=0x7fa81800b040 comp rx=0 tx=0).stop 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 msgr2=0x7fa8281f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 0x7fa8281f5e60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa810000c00 tx=0x7fa8100046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 shutdown_connections 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8040762d0 0x7fa804078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa82815d1b0 0x7fa8281e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8280b0720 0x7fa8281f5e60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 --2- 172.21.15.100:0/2712644231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8280b02a0 0x7fa8280aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 >> 172.21.15.100:0/2712644231 conn(0x7fa8280b2c90 msgr2=0x7fa8281625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 shutdown_connections 2024-05-09T05:04:24.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.150+0000 7fa82ee00640 1 -- 172.21.15.100:0/2712644231 wait complete. 2024-05-09T05:04:24.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:24.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.359+0000 7fcf56800640 1 Processor -- start 2024-05-09T05:04:24.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.360+0000 7fcf56800640 1 -- start start 2024-05-09T05:04:24.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.361+0000 7fcf56800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf5015f590 0x7fcf500baba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.361+0000 7fcf56800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf500d3710 con 0x7fcf500b83b0 2024-05-09T05:04:24.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.361+0000 7fcf56800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf500d39f0 con 0x7fcf500b45b0 2024-05-09T05:04:24.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.361+0000 7fcf56800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fcf5015f970 con 0x7fcf5015f590 2024-05-09T05:04:24.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.361+0000 7fcf4fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcf500b83b0 0x7fcf500cffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40174/0 (socket says 172.21.15.100:40174) 2024-05-09T05:04:24.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.361+0000 7fcf4fe00640 1 -- 172.21.15.100:0/1666933881 learned_addr learned my addr 172.21.15.100:0/1666933881 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998963133 0 0) 0x7fcf500d3710 con 0x7fcf500b83b0 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf34003520 con 0x7fcf500b83b0 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4f400640 1 --2- 172.21.15.100:0/1666933881 >> v2:172.21.15.133:3300/0 conn(0x7fcf5015f590 0x7fcf500baba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 320656879 0 0) 0x7fcf34003520 con 0x7fcf500b83b0 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 >> v2:172.21.15.133:3300/0 conn(0x7fcf5015f590 msgr2=0x7fcf500baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 --2- 172.21.15.100:0/1666933881 >> v2:172.21.15.133:3300/0 conn(0x7fcf5015f590 0x7fcf500baba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 >> v1:172.21.15.133:6789/0 conn(0x7fcf500b45b0 legacy=0x7fcf500d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf500d3cd0 con 0x7fcf500b83b0 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fcf48001a70 con 0x7fcf500b83b0 2024-05-09T05:04:24.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 >> v1:172.21.15.100:6789/0 conn(0x7fcf500b83b0 legacy=0x7fcf500cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf34003a50 0x7fcf34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34004800 0x7fcf34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf340053c0 0x7fcf3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5015f970 con 0x7fcf34003a50 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3400c250 con 0x7fcf340053c0 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3400c450 con 0x7fcf34004800 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.362+0000 7fcf4f400640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf34003a50 0x7fcf34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.363+0000 7fcf4f400640 1 -- 172.21.15.100:0/1666933881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34004800 msgr2=0x7fcf34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.363+0000 7fcf4f400640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34004800 0x7fcf34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.363+0000 7fcf4f400640 1 -- 172.21.15.100:0/1666933881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf340053c0 msgr2=0x7fcf3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.363+0000 7fcf4f400640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf340053c0 0x7fcf3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.363+0000 7fcf4f400640 1 -- 172.21.15.100:0/1666933881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34003520 con 0x7fcf34003a50 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.363+0000 7fcf4fe00640 1 -- 172.21.15.100:0/1666933881 reap_dead start 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.364+0000 7fcf4f400640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf34003a50 0x7fcf34003e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000ba30 tx=0x7fcf34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a3c368fc584bcb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.364+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf40030070 con 0x7fcf34003a50 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.364+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf4002ae10 con 0x7fcf34003a50 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.364+0000 7fcf4e000640 1 -- 172.21.15.100:0/1666933881 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000b600 con 0x7fcf34003a50 2024-05-09T05:04:24.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.364+0000 7fcf56800640 1 -- 172.21.15.100:0/1666933881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf34003a50 msgr2=0x7fcf34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.364+0000 7fcf56800640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf34003a50 0x7fcf34003e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000ba30 tx=0x7fcf34005830 comp rx=0 tx=0).stop 2024-05-09T05:04:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.365+0000 7fcf56800640 1 -- 172.21.15.100:0/1666933881 shutdown_connections 2024-05-09T05:04:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.365+0000 7fcf56800640 1 --2- 172.21.15.100:0/1666933881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf34003a50 0x7fcf34003e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.365+0000 7fcf56800640 1 -- 172.21.15.100:0/1666933881 >> 172.21.15.100:0/1666933881 conn(0x7fcf50074130 msgr2=0x7fcf500d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.365+0000 7fcf56800640 1 -- 172.21.15.100:0/1666933881 shutdown_connections 2024-05-09T05:04:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.365+0000 7fcf56800640 1 -- 172.21.15.100:0/1666933881 wait complete. 2024-05-09T05:04:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.366+0000 7fcf56800640 1 Processor -- start 2024-05-09T05:04:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.366+0000 7fcf56800640 1 -- start start 2024-05-09T05:04:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf56800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34003a50 0x7fcf501f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf56800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 0x7fcf50155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf56800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf500ced30 0x7fcf501558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf56800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500b8820 con 0x7fcf500ce8b0 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf56800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcf500d4320 con 0x7fcf500ced30 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf56800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fcf500b89a0 con 0x7fcf34003a50 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf4ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 0x7fcf50155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf4ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 0x7fcf50155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49698/0 (socket says 172.21.15.100:49698) 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.367+0000 7fcf4ea00640 1 -- 172.21.15.100:0/2022038231 learned_addr learned my addr 172.21.15.100:0/2022038231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4f400640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34003a50 0x7fcf501f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4fe00640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf500ced30 0x7fcf501558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4ea00640 1 -- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34003a50 msgr2=0x7fcf501f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4ea00640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34003a50 0x7fcf501f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4ea00640 1 -- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf500ced30 msgr2=0x7fcf501558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4ea00640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf500ced30 0x7fcf501558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4ea00640 1 -- 172.21.15.100:0/2022038231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf50162350 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4f400640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34003a50 0x7fcf501f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4fe00640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf500ced30 0x7fcf501558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf4ea00640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 0x7fcf50155360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c450 tx=0x7fcf3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf380052d0 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf38005490 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf500cc4f0 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.368+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf38012870 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.369+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf500ccab0 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.370+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5006a5c0 con 0x7fcf500ce8b0 2024-05-09T05:04:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.371+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf38012a10 con 0x7fcf500ce8b0 2024-05-09T05:04:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.372+0000 7fcf47400640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcf2c0762d0 0x7fcf2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.372+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fcf38097250 con 0x7fcf500ce8b0 2024-05-09T05:04:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.372+0000 7fcf4f400640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcf2c0762d0 0x7fcf2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.372+0000 7fcf4f400640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcf2c0762d0 0x7fcf2c078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000ba00 tx=0x7fcf40030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:24.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.376+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf38060b10 con 0x7fcf500ce8b0 2024-05-09T05:04:24.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.569+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf500d1fe0 con 0x7fcf500ce8b0 2024-05-09T05:04:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.573+0000 7fcf47400640 1 -- 172.21.15.100:0/2022038231 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16642 (secure 0 0 0) 0x7fcf38060410 con 0x7fcf500ce8b0 2024-05-09T05:04:24.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:24.574 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:23.613150+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:24.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcf2c0762d0 msgr2=0x7fcf2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcf2c0762d0 0x7fcf2c078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000ba00 tx=0x7fcf40030000 comp rx=0 tx=0).stop 2024-05-09T05:04:24.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 msgr2=0x7fcf50155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 0x7fcf50155360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800c450 tx=0x7fcf3800c910 comp rx=0 tx=0).stop 2024-05-09T05:04:24.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 shutdown_connections 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcf2c0762d0 0x7fcf2c078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf500ced30 0x7fcf501558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf500ce8b0 0x7fcf50155360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 --2- 172.21.15.100:0/2022038231 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf34003a50 0x7fcf501f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 >> 172.21.15.100:0/2022038231 conn(0x7fcf50074130 msgr2=0x7fcf5015eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.575+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 shutdown_connections 2024-05-09T05:04:24.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.576+0000 7fcf56800640 1 -- 172.21.15.100:0/2022038231 wait complete. 2024-05-09T05:04:24.594 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:24.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.789+0000 7f0e71600640 1 Processor -- start 2024-05-09T05:04:24.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.789+0000 7f0e71600640 1 -- start start 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e71600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0e6c0d0a70 0x7f0e6c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e71600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e6c0ade90 0x7f0e6c0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e71600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0afb70 0x7f0e6c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e71600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6c15e780 con 0x7f0e6c0d0a70 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e71600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6c0b55b0 con 0x7f0e6c0ade90 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e71600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f0e6c0ae3a0 con 0x7f0e6c0afb70 2024-05-09T05:04:24.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e6aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0e6c0d0a70 0x7f0e6c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e6aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0e6c0d0a70 0x7f0e6c15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49712/0 (socket says 172.21.15.100:49712) 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e6aa00640 1 -- 172.21.15.100:0/624028649 learned_addr learned my addr 172.21.15.100:0/624028649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e6b400640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0afb70 0x7f0e6c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.791+0000 7f0e6a000640 1 --2- 172.21.15.100:0/624028649 >> v2:172.21.15.133:3300/0 conn(0x7f0e6c0ade90 0x7f0e6c0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6aa00640 1 -- 172.21.15.100:0/624028649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0afb70 msgr2=0x7f0e6c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6aa00640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0afb70 0x7f0e6c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6aa00640 1 -- 172.21.15.100:0/624028649 >> v2:172.21.15.133:3300/0 conn(0x7f0e6c0ade90 msgr2=0x7f0e6c0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6aa00640 1 --2- 172.21.15.100:0/624028649 >> v2:172.21.15.133:3300/0 conn(0x7f0e6c0ade90 0x7f0e6c0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6aa00640 1 -- 172.21.15.100:0/624028649 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c0b4590 con 0x7f0e6c0d0a70 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6b400640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0afb70 0x7f0e6c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.792+0000 7f0e6a000640 1 --2- 172.21.15.100:0/624028649 >> v2:172.21.15.133:3300/0 conn(0x7f0e6c0ade90 0x7f0e6c0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.793+0000 7f0e6aa00640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0d0a70 0x7f0e6c15e240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0b0930 tx=0x7f0e5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7099bd6e3861c78a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.793+0000 7f0e69600640 1 -- 172.21.15.100:0/624028649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c037070 con 0x7f0e6c0d0a70 2024-05-09T05:04:24.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.793+0000 7f0e69600640 1 -- 172.21.15.100:0/624028649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5c032440 con 0x7f0e6c0d0a70 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.793+0000 7f0e69600640 1 -- 172.21.15.100:0/624028649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c032810 con 0x7f0e6c0d0a70 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 -- 172.21.15.100:0/624028649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0d0a70 msgr2=0x7f0e6c15e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0d0a70 0x7f0e6c15e240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0b0930 tx=0x7f0e5c02a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 -- 172.21.15.100:0/624028649 shutdown_connections 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0afb70 0x7f0e6c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 --2- 172.21.15.100:0/624028649 >> v2:172.21.15.133:3300/0 conn(0x7f0e6c0ade90 0x7f0e6c0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 --2- 172.21.15.100:0/624028649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0d0a70 0x7f0e6c15e240 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 -- 172.21.15.100:0/624028649 >> 172.21.15.100:0/624028649 conn(0x7f0e6c0b31e0 msgr2=0x7f0e6c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 -- 172.21.15.100:0/624028649 shutdown_connections 2024-05-09T05:04:24.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.794+0000 7f0e71600640 1 -- 172.21.15.100:0/624028649 wait complete. 2024-05-09T05:04:24.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.796+0000 7f0e71600640 1 Processor -- start 2024-05-09T05:04:24.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.797+0000 7f0e71600640 1 -- start start 2024-05-09T05:04:24.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e71600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 0x7f0e6c09ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e71600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6c0afb70 0x7f0e6c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e71600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0d0a70 0x7f0e6c09e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e71600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0ae680 con 0x7f0e6c0ade90 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e71600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0b4b50 con 0x7f0e6c0afb70 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e71600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f0e6c0b0520 con 0x7f0e6c0d0a70 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e6aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 0x7f0e6c09ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e6aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 0x7f0e6c09ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49726/0 (socket says 172.21.15.100:49726) 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e6aa00640 1 -- 172.21.15.100:0/2260218952 learned_addr learned my addr 172.21.15.100:0/2260218952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e6aa00640 1 -- 172.21.15.100:0/2260218952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0d0a70 msgr2=0x7f0e6c09e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.798+0000 7f0e6aa00640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0d0a70 0x7f0e6c09e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e6aa00640 1 -- 172.21.15.100:0/2260218952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6c0afb70 msgr2=0x7f0e6c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e6aa00640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6c0afb70 0x7f0e6c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e6aa00640 1 -- 172.21.15.100:0/2260218952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c1545e0 con 0x7f0e6c0ade90 2024-05-09T05:04:24.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e6aa00640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 0x7f0e6c09ba10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c02a220 tx=0x7f0e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c037040 con 0x7f0e6c0ade90 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5c042070 con 0x7f0e6c0ade90 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c030bb0 con 0x7f0e6c0ade90 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c09c0f0 con 0x7f0e6c0ade90 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.799+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c09c6b0 con 0x7f0e6c0ade90 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.800+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c076070 con 0x7f0e6c0ade90 2024-05-09T05:04:24.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.801+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e5c047460 con 0x7f0e6c0ade90 2024-05-09T05:04:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.802+0000 7f0e62a00640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0e4c0762d0 0x7f0e4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.803+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f0e5c0b8250 con 0x7f0e6c0ade90 2024-05-09T05:04:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.803+0000 7f0e6a000640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0e4c0762d0 0x7f0e4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:24.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.803+0000 7f0e6a000640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0e4c0762d0 0x7f0e4c078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e58006b10 tx=0x7f0e58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:24.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.807+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e5c081ba0 con 0x7f0e6c0ade90 2024-05-09T05:04:24.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:24.998+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e6c15aec0 con 0x7f0e6c0ade90 2024-05-09T05:04:25.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.001+0000 7f0e62a00640 1 -- 172.21.15.100:0/2260218952 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16642 (secure 0 0 0) 0x7f0e5c0814a0 con 0x7f0e6c0ade90 2024-05-09T05:04:25.002 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:25.002 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:23.613150+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0e4c0762d0 msgr2=0x7f0e4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0e4c0762d0 0x7f0e4c078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0e58006b10 tx=0x7f0e58008040 comp rx=0 tx=0).stop 2024-05-09T05:04:25.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 msgr2=0x7f0e6c09ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 0x7f0e6c09ba10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c02a220 tx=0x7f0e5c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 shutdown_connections 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0e4c0762d0 0x7f0e4c078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e6c0d0a70 0x7f0e6c09e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e6c0afb70 0x7f0e6c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 --2- 172.21.15.100:0/2260218952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e6c0ade90 0x7f0e6c09ba10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 >> 172.21.15.100:0/2260218952 conn(0x7f0e6c0b31e0 msgr2=0x7f0e6c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:25.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 shutdown_connections 2024-05-09T05:04:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.004+0000 7f0e71600640 1 -- 172.21.15.100:0/2260218952 wait complete. 2024-05-09T05:04:25.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T05:04:25.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.225+0000 7f82e9a00640 1 Processor -- start 2024-05-09T05:04:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.225+0000 7f82e9a00640 1 -- start start 2024-05-09T05:04:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.226+0000 7f82e9a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82e4162ac0 0x7f82e40b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.226+0000 7f82e9a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e4162ea0 con 0x7f82e40d3f90 2024-05-09T05:04:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.226+0000 7f82e9a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40d1d30 con 0x7f82e40d33b0 2024-05-09T05:04:25.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.226+0000 7f82e9a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f82e40d26d0 con 0x7f82e4162ac0 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e3400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f82e40d3f90 0x7f82e40b2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40184/0 (socket says 172.21.15.100:40184) 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e3400640 1 -- 172.21.15.100:0/988260582 learned_addr learned my addr 172.21.15.100:0/988260582 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2a00640 1 --2- 172.21.15.100:0/988260582 >> v2:172.21.15.133:3300/0 conn(0x7f82e4162ac0 0x7f82e40b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240389833 0 0) 0x7f82e4162ea0 con 0x7f82e40d3f90 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c8003520 con 0x7f82e40d3f90 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2980986217 0 0) 0x7f82c8003520 con 0x7f82e40d3f90 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 >> v2:172.21.15.133:3300/0 conn(0x7f82e4162ac0 msgr2=0x7f82e40b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 --2- 172.21.15.100:0/988260582 >> v2:172.21.15.133:3300/0 conn(0x7f82e4162ac0 0x7f82e40b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 >> v1:172.21.15.133:6789/0 conn(0x7f82e40d33b0 legacy=0x7f82e40d3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40d2010 con 0x7f82e40d3f90 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f82dc001a70 con 0x7f82e40d3f90 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 >> v1:172.21.15.100:6789/0 conn(0x7f82e40d3f90 legacy=0x7f82e40b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8003a50 0x7f82c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.227+0000 7f82e2000640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82c8004800 0x7f82c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e2000640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80053c0 0x7f82c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40d26d0 con 0x7f82c8004800 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f82c800c230 con 0x7f82c8003a50 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f82c800c430 con 0x7f82c80053c0 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82dbe00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82c8004800 0x7f82c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e2a00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8003a50 0x7f82c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e3400640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80053c0 0x7f82c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82dbe00640 1 -- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80053c0 msgr2=0x7f82c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82dbe00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80053c0 0x7f82c800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82dbe00640 1 -- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8003a50 msgr2=0x7f82c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82dbe00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8003a50 0x7f82c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82dbe00640 1 -- 172.21.15.100:0/988260582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8003520 con 0x7f82c8004800 2024-05-09T05:04:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.228+0000 7f82e3400640 1 -- 172.21.15.100:0/988260582 reap_dead start 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.229+0000 7f82dbe00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82c8004800 0x7f82c8004c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001790 tx=0x7f82c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed704e331aaa535 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.229+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0013b0 con 0x7f82c8004800 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.229+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc0052d0 con 0x7f82c8004800 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.229+0000 7f82e2000640 1 -- 172.21.15.100:0/988260582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc02aa90 con 0x7f82c8004800 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 -- 172.21.15.100:0/988260582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82c8004800 msgr2=0x7f82c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82c8004800 0x7f82c8004c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001790 tx=0x7f82c8005830 comp rx=0 tx=0).stop 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 -- 172.21.15.100:0/988260582 shutdown_connections 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 --2- 172.21.15.100:0/988260582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82c8004800 0x7f82c8004c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 -- 172.21.15.100:0/988260582 >> 172.21.15.100:0/988260582 conn(0x7f82e409e5e0 msgr2=0x7f82e40d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 -- 172.21.15.100:0/988260582 shutdown_connections 2024-05-09T05:04:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.230+0000 7f82e9a00640 1 -- 172.21.15.100:0/988260582 wait complete. 2024-05-09T05:04:25.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.232+0000 7f82e9a00640 1 Processor -- start 2024-05-09T05:04:25.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.232+0000 7f82e9a00640 1 -- start start 2024-05-09T05:04:25.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e9a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8004800 0x7f82e41576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e9a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82e40b7750 0x7f82e40caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 0x7f82e40cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e9a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40d3880 con 0x7f82e40cb0e0 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e9a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40b4960 con 0x7f82c8004800 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e9a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40d3a00 con 0x7f82e40b7750 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 0x7f82e40cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 0x7f82e40cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49740/0 (socket says 172.21.15.100:49740) 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e3400640 1 -- 172.21.15.100:0/3117386790 learned_addr learned my addr 172.21.15.100:0/3117386790 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.233+0000 7f82e2a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8004800 0x7f82e41576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82dbe00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82e40b7750 0x7f82e40caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e3400640 1 -- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82e40b7750 msgr2=0x7f82e40caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e3400640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82e40b7750 0x7f82e40caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e3400640 1 -- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8004800 msgr2=0x7f82e41576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e3400640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8004800 0x7f82e41576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:25.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e3400640 1 -- 172.21.15.100:0/3117386790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40ca040 con 0x7f82e40cb0e0 2024-05-09T05:04:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e3400640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 0x7f82e40cb560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82dc001330 tx=0x7f82dc00b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00b810 con 0x7f82e40cb0e0 2024-05-09T05:04:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82dc00b9b0 con 0x7f82e40cb0e0 2024-05-09T05:04:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00bda0 con 0x7f82e40cb0e0 2024-05-09T05:04:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e40c9a80 con 0x7f82e40cb0e0 2024-05-09T05:04:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.234+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e40cd4f0 con 0x7f82e40cb0e0 2024-05-09T05:04:25.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.235+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e406a630 con 0x7f82e40cb0e0 2024-05-09T05:04:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.237+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82dc01b020 con 0x7f82e40cb0e0 2024-05-09T05:04:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.238+0000 7f82daa00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82c0076300 0x7f82c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.239+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82dc097690 con 0x7f82e40cb0e0 2024-05-09T05:04:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.239+0000 7f82e2a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82c0076300 0x7f82c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:25.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.239+0000 7f82e2a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82c0076300 0x7f82c00787c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009a90 tx=0x7f82d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:25.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.243+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82e40ca040 con 0x7f82e40cb0e0 2024-05-09T05:04:25.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:25.490+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f82e40d6070 con 0x7f82e40cb0e0 2024-05-09T05:04:26.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.185+0000 7f82daa00640 1 -- 172.21.15.100:0/3117386790 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f82dc060f50 con 0x7f82e40cb0e0 2024-05-09T05:04:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82c0076300 msgr2=0x7f82c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82c0076300 0x7f82c00787c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009a90 tx=0x7f82d4008040 comp rx=0 tx=0).stop 2024-05-09T05:04:26.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 msgr2=0x7f82e40cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 0x7f82e40cb560 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82dc001330 tx=0x7f82dc00b0d0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 shutdown_connections 2024-05-09T05:04:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82c0076300 0x7f82c00787c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82e40cb0e0 0x7f82e40cb560 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82e40b7750 0x7f82e40caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 --2- 172.21.15.100:0/3117386790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c8004800 0x7f82e41576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.188+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 >> 172.21.15.100:0/3117386790 conn(0x7f82e409e5e0 msgr2=0x7f82e4161c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:26.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.189+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 shutdown_connections 2024-05-09T05:04:26.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.189+0000 7f82e9a00640 1 -- 172.21.15.100:0/3117386790 wait complete. 2024-05-09T05:04:26.210 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-09T05:04:26.210 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T05:04:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.412+0000 7f3104000640 1 Processor -- start 2024-05-09T05:04:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.413+0000 7f3104000640 1 -- start start 2024-05-09T05:04:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3104000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30fc0d31c0 0x7f30fc0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3104000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f30fc15f8d0 0x7f30fc0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3104000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30fc0b48a0 con 0x7f30fc0d3870 2024-05-09T05:04:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3104000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc0b4b80 con 0x7f30fc15f8d0 2024-05-09T05:04:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3104000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f30fc0b4e60 con 0x7f30fc0d31c0 2024-05-09T05:04:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3101600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f30fc0d3870 0x7f30fc0d3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40190/0 (socket says 172.21.15.100:40190) 2024-05-09T05:04:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3101600640 1 -- 172.21.15.100:0/1742587325 learned_addr learned my addr 172.21.15.100:0/1742587325 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:26.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.414+0000 7f3102000640 1 --2- 172.21.15.100:0/1742587325 >> v2:172.21.15.100:3300/0 conn(0x7f30fc15f8d0 0x7f30fc0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f3100c00640 1 --2- 172.21.15.100:0/1742587325 >> v2:172.21.15.133:3300/0 conn(0x7f30fc0d31c0 0x7f30fc0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f30fbe00640 1 -- 172.21.15.100:0/1742587325 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720441471 0 0) 0x7f30fc0b48a0 con 0x7f30fc0d3870 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f30fbe00640 1 -- 172.21.15.100:0/1742587325 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e0003520 con 0x7f30fc0d3870 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f3102000640 1 -- 172.21.15.100:0/1742587325 >> v2:172.21.15.133:3300/0 conn(0x7f30fc0d31c0 msgr2=0x7f30fc0d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f3102000640 1 --2- 172.21.15.100:0/1742587325 >> v2:172.21.15.133:3300/0 conn(0x7f30fc0d31c0 0x7f30fc0d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f3102000640 1 -- 172.21.15.100:0/1742587325 >> v1:172.21.15.100:6789/0 conn(0x7f30fc0d3870 legacy=0x7f30fc0d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.415+0000 7f3102000640 1 -- 172.21.15.100:0/1742587325 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc0b5140 con 0x7f30fc15f8d0 2024-05-09T05:04:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.416+0000 7f3102000640 1 --2- 172.21.15.100:0/1742587325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc15f8d0 0x7f30fc0b5660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30fc08dc00 tx=0x7f30f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0643e23c8ca2b20 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.416+0000 7f30fbe00640 1 -- 172.21.15.100:0/1742587325 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4037070 con 0x7f30fc15f8d0 2024-05-09T05:04:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.416+0000 7f30fbe00640 1 -- 172.21.15.100:0/1742587325 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4032440 con 0x7f30fc15f8d0 2024-05-09T05:04:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.416+0000 7f30fbe00640 1 -- 172.21.15.100:0/1742587325 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f40327f0 con 0x7f30fc15f8d0 2024-05-09T05:04:26.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 -- 172.21.15.100:0/1742587325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc15f8d0 msgr2=0x7f30fc0b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 --2- 172.21.15.100:0/1742587325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc15f8d0 0x7f30fc0b5660 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30fc08dc00 tx=0x7f30f402a1a0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 -- 172.21.15.100:0/1742587325 shutdown_connections 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 --2- 172.21.15.100:0/1742587325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc15f8d0 0x7f30fc0b5660 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 --2- 172.21.15.100:0/1742587325 >> v2:172.21.15.133:3300/0 conn(0x7f30fc0d31c0 0x7f30fc0d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 -- 172.21.15.100:0/1742587325 >> 172.21.15.100:0/1742587325 conn(0x7f30fc09e5d0 msgr2=0x7f30fc0d5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 -- 172.21.15.100:0/1742587325 shutdown_connections 2024-05-09T05:04:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.417+0000 7f3104000640 1 -- 172.21.15.100:0/1742587325 wait complete. 2024-05-09T05:04:26.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.419+0000 7f3104000640 1 Processor -- start 2024-05-09T05:04:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.419+0000 7f3104000640 1 -- start start 2024-05-09T05:04:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3104000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30fc0d31c0 0x7f30fc0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3104000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 0x7f30fc0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3104000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30fc15f8d0 0x7f30fc15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3104000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0b5ba0 con 0x7f30fc0d3870 2024-05-09T05:04:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3104000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30fc0d1000 con 0x7f30fc0d31c0 2024-05-09T05:04:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3104000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f30fc0b5d20 con 0x7f30fc15f8d0 2024-05-09T05:04:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3100c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 0x7f30fc0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3100c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 0x7f30fc0ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49756/0 (socket says 172.21.15.100:49756) 2024-05-09T05:04:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.420+0000 7f3100c00640 1 -- 172.21.15.100:0/3443603554 learned_addr learned my addr 172.21.15.100:0/3443603554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3101600640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30fc0d31c0 0x7f30fc0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3102000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30fc15f8d0 0x7f30fc15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3100c00640 1 -- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30fc15f8d0 msgr2=0x7f30fc15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3100c00640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30fc15f8d0 0x7f30fc15c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3100c00640 1 -- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30fc0d31c0 msgr2=0x7f30fc0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3100c00640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30fc0d31c0 0x7f30fc0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3100c00640 1 -- 172.21.15.100:0/3443603554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30fc1f8990 con 0x7f30fc0d3870 2024-05-09T05:04:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3100c00640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 0x7f30fc0ba240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30e800d800 tx=0x7f30e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e800b6c0 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8019070 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30fc1f8c70 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.421+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e800ba80 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.422+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30fc15ff00 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.423+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30fc06a630 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.424+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30e800bc20 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.425+0000 7f30f9600640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f30dc0762d0 0x7f30dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.425+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f30e8097b30 con 0x7f30fc0d3870 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.426+0000 7f3101600640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f30dc0762d0 0x7f30dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:26.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.426+0000 7f3101600640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f30dc0762d0 0x7f30dc078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30ec001800 tx=0x7f30ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:26.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.430+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30e80613f0 con 0x7f30fc0d3870 2024-05-09T05:04:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:26.683+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f30fc0d03c0 con 0x7f30fc0d3870 2024-05-09T05:04:27.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.188+0000 7f30f9600640 1 -- 172.21.15.100:0/3443603554 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f30e8060cf0 con 0x7f30fc0d3870 2024-05-09T05:04:27.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.192+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f30dc0762d0 msgr2=0x7f30dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.192+0000 7f3104000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f30dc0762d0 0x7f30dc078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30ec001800 tx=0x7f30ec009040 comp rx=0 tx=0).stop 2024-05-09T05:04:27.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 msgr2=0x7f30fc0ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 0x7f30fc0ba240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30e800d800 tx=0x7f30e800dcc0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 shutdown_connections 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f30dc0762d0 0x7f30dc078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30fc15f8d0 0x7f30fc15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30fc0d3870 0x7f30fc0ba240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 --2- 172.21.15.100:0/3443603554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30fc0d31c0 0x7f30fc0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 >> 172.21.15.100:0/3443603554 conn(0x7f30fc09e5d0 msgr2=0x7f30fc0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 shutdown_connections 2024-05-09T05:04:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.193+0000 7f3104000640 1 -- 172.21.15.100:0/3443603554 wait complete. 2024-05-09T05:04:27.215 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T05:04:27.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:27.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.408+0000 7f8e20400640 1 Processor -- start 2024-05-09T05:04:27.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.408+0000 7f8e20400640 1 -- start start 2024-05-09T05:04:27.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.409+0000 7f8e20400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e1806fd60 0x7f8e18070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e20400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 0x7f8e18073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e20400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e18070680 con 0x7f8e18073840 2024-05-09T05:04:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e20400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1806f390 con 0x7f8e1806fd60 2024-05-09T05:04:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e20400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1806e810 con 0x7f8e180afe20 2024-05-09T05:04:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e1d000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8e18073840 0x7f8e1815fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40204/0 (socket says 172.21.15.100:40204) 2024-05-09T05:04:27.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e1d000640 1 -- 172.21.15.100:0/2871797383 learned_addr learned my addr 172.21.15.100:0/2871797383 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e1da00640 1 --2- 172.21.15.100:0/2871797383 >> v2:172.21.15.133:3300/0 conn(0x7f8e1806fd60 0x7f8e18070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e1e400640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 0x7f8e18073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229750253 0 0) 0x7f8e18070680 con 0x7f8e18073840 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.410+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dfc003520 con 0x7f8e18073840 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 979894331 0 0) 0x7f8dfc003520 con 0x7f8e18073840 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 msgr2=0x7f8e18073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:27.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 0x7f8e18073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 >> v2:172.21.15.133:3300/0 conn(0x7f8e1806fd60 msgr2=0x7f8e18070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 --2- 172.21.15.100:0/2871797383 >> v2:172.21.15.133:3300/0 conn(0x7f8e1806fd60 0x7f8e18070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1806eaf0 con 0x7f8e18073840 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f8e040016f0 con 0x7f8e18073840 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 >> v1:172.21.15.100:6789/0 conn(0x7f8e18073840 legacy=0x7f8e1815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8dfc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc004800 0x7f8dfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 0x7f8dfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1806f390 con 0x7f8dfc003a00 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1806e810 con 0x7f8dfc004800 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc00dc00 con 0x7f8e180afe20 2024-05-09T05:04:27.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.411+0000 7f8e1da00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8dfc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1d000640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc004800 0x7f8dfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1da00640 1 -- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 msgr2=0x7f8dfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:27.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1da00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180afe20 0x7f8dfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1da00640 1 -- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc004800 msgr2=0x7f8dfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:27.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1da00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc004800 0x7f8dfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1da00640 1 -- 172.21.15.100:0/2871797383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc003520 con 0x7f8dfc003a00 2024-05-09T05:04:27.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.412+0000 7f8e1d000640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dfc004800 0x7f8dfc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:27.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e1da00640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8dfc003e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009fc0 tx=0x7f8dfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54ffed318890d49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:27.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10009c10 con 0x7f8dfc003a00 2024-05-09T05:04:27.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e10036070 con 0x7f8dfc003a00 2024-05-09T05:04:27.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e17e00640 1 -- 172.21.15.100:0/2871797383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1002d070 con 0x7f8dfc003a00 2024-05-09T05:04:27.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e20400640 1 -- 172.21.15.100:0/2871797383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 msgr2=0x7f8dfc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e20400640 1 --2- 172.21.15.100:0/2871797383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8dfc003e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009fc0 tx=0x7f8dfc005830 comp rx=0 tx=0).stop 2024-05-09T05:04:27.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.413+0000 7f8e1e400640 1 -- 172.21.15.100:0/2871797383 reap_dead start 2024-05-09T05:04:27.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.414+0000 7f8e20400640 1 -- 172.21.15.100:0/2871797383 shutdown_connections 2024-05-09T05:04:27.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.414+0000 7f8e20400640 1 -- 172.21.15.100:0/2871797383 >> 172.21.15.100:0/2871797383 conn(0x7f8e180b31e0 msgr2=0x7f8e180d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:27.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.414+0000 7f8e20400640 1 -- 172.21.15.100:0/2871797383 shutdown_connections 2024-05-09T05:04:27.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.414+0000 7f8e20400640 1 -- 172.21.15.100:0/2871797383 wait complete. 2024-05-09T05:04:27.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.415+0000 7f8e20400640 1 Processor -- start 2024-05-09T05:04:27.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.415+0000 7f8e20400640 1 -- start start 2024-05-09T05:04:27.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e20400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8e180cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e20400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18154370 0x7f8e181602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e20400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e181487f0 0x7f8e18148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e20400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1806e4a0 con 0x7f8dfc003a00 2024-05-09T05:04:27.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e20400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1806f0b0 con 0x7f8e18154370 2024-05-09T05:04:27.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e20400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8e18159f00 con 0x7f8e181487f0 2024-05-09T05:04:27.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.416+0000 7f8e1da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8e180cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8e180cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49784/0 (socket says 172.21.15.100:49784) 2024-05-09T05:04:27.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 -- 172.21.15.100:0/555241486 learned_addr learned my addr 172.21.15.100:0/555241486 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:27.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1d000640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18154370 0x7f8e181602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1e400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e181487f0 0x7f8e18148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 -- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e181487f0 msgr2=0x7f8e18148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e181487f0 0x7f8e18148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 -- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18154370 msgr2=0x7f8e181602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18154370 0x7f8e181602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 -- 172.21.15.100:0/555241486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e180ce6f0 con 0x7f8dfc003a00 2024-05-09T05:04:27.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e1da00640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8e180cf790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000e230 tx=0x7f8e10009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10009c10 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.417+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e10003bb0 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.418+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10004020 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.418+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e180ce9d0 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.418+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e180cef90 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.419+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e18076070 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.420+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e10005d10 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.421+0000 7f8e15600640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8df8076300 0x7f8df80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.421+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8e100b89c0 con 0x7f8dfc003a00 2024-05-09T05:04:27.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.422+0000 7f8e1d000640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8df8076300 0x7f8df80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.422+0000 7f8e1d000640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8df8076300 0x7f8df80787c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e04001860 tx=0x7f8e04001c70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:27.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.426+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8e10082310 con 0x7f8dfc003a00 2024-05-09T05:04:27.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.672+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e18073d60 con 0x7f8dfc003a00 2024-05-09T05:04:27.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.673+0000 7f8e15600640 1 -- 172.21.15.100:0/555241486 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f8e1008a300 con 0x7f8dfc003a00 2024-05-09T05:04:27.674 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:27.675 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:04:27.675 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8df8076300 msgr2=0x7f8df80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8df8076300 0x7f8df80787c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e04001860 tx=0x7f8e04001c70 comp rx=0 tx=0).stop 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 msgr2=0x7f8e180cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8e180cf790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000e230 tx=0x7f8e10009750 comp rx=0 tx=0).stop 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 shutdown_connections 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8df8076300 0x7f8df80787c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e181487f0 0x7f8e18148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18154370 0x7f8e181602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 --2- 172.21.15.100:0/555241486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dfc003a00 0x7f8e180cf790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 >> 172.21.15.100:0/555241486 conn(0x7f8e180b31e0 msgr2=0x7f8e180b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 shutdown_connections 2024-05-09T05:04:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.676+0000 7f8e20400640 1 -- 172.21.15.100:0/555241486 wait complete. 2024-05-09T05:04:27.694 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.879+0000 7f82f3200640 1 Processor -- start 2024-05-09T05:04:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.879+0000 7f82f3200640 1 -- start start 2024-05-09T05:04:27.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82f3200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82f41456c0 0x7f82f415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82f3200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82f406f570 0x7f82f406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82f3200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f415d730 con 0x7f82f415fb60 2024-05-09T05:04:27.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82f3200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f82f40cfb40 con 0x7f82f406f570 2024-05-09T05:04:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82f3200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f82f415d530 con 0x7f82f41456c0 2024-05-09T05:04:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82e9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82f406f570 0x7f82f406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82e9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82f406f570 0x7f82f406f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49796/0 (socket says 172.21.15.100:49796) 2024-05-09T05:04:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82e9400640 1 -- 172.21.15.100:0/2713789349 learned_addr learned my addr 172.21.15.100:0/2713789349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82e9400640 1 -- 172.21.15.100:0/2713789349 >> v2:172.21.15.133:3300/0 conn(0x7f82f41456c0 msgr2=0x7f82f415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82e9400640 1 --2- 172.21.15.100:0/2713789349 >> v2:172.21.15.133:3300/0 conn(0x7f82f41456c0 0x7f82f415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.881+0000 7f82e9400640 1 -- 172.21.15.100:0/2713789349 >> v1:172.21.15.133:6789/0 conn(0x7f82f415fb60 legacy=0x7f82f415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:27.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.882+0000 7f82e9400640 1 -- 172.21.15.100:0/2713789349 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f40cef30 con 0x7f82f406f570 2024-05-09T05:04:27.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82e9400640 1 --2- 172.21.15.100:0/2713789349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f406f570 0x7f82f406f9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f82f4070330 tx=0x7f82dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2481cb8efb05b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82f1400640 1 -- 172.21.15.100:0/2713789349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc037070 con 0x7f82f406f570 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82f1400640 1 -- 172.21.15.100:0/2713789349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82dc032440 con 0x7f82f406f570 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82f1400640 1 -- 172.21.15.100:0/2713789349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc032810 con 0x7f82f406f570 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82f3200640 1 -- 172.21.15.100:0/2713789349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f406f570 msgr2=0x7f82f406f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82f3200640 1 --2- 172.21.15.100:0/2713789349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f406f570 0x7f82f406f9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f82f4070330 tx=0x7f82dc02a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.883+0000 7f82f3200640 1 -- 172.21.15.100:0/2713789349 shutdown_connections 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.884+0000 7f82f3200640 1 --2- 172.21.15.100:0/2713789349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f406f570 0x7f82f406f9f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.884+0000 7f82f3200640 1 --2- 172.21.15.100:0/2713789349 >> v2:172.21.15.133:3300/0 conn(0x7f82f41456c0 0x7f82f415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.884+0000 7f82f3200640 1 -- 172.21.15.100:0/2713789349 >> 172.21.15.100:0/2713789349 conn(0x7f82f406c7f0 msgr2=0x7f82f406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.884+0000 7f82f3200640 1 -- 172.21.15.100:0/2713789349 shutdown_connections 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.884+0000 7f82f3200640 1 -- 172.21.15.100:0/2713789349 wait complete. 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.885+0000 7f82f3200640 1 Processor -- start 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.885+0000 7f82f3200640 1 -- start start 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.886+0000 7f82f3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f406f570 0x7f82f4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.886+0000 7f82f3200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82f41456c0 0x7f82f41f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.886+0000 7f82f3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 0x7f82f40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.886+0000 7f82f3200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f82f40cf7d0 con 0x7f82f415fb60 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.886+0000 7f82f3200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f82f40cf4f0 con 0x7f82f406f570 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.886+0000 7f82f3200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f82f40cec00 con 0x7f82f41456c0 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 0x7f82f40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 0x7f82f40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49802/0 (socket says 172.21.15.100:49802) 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 -- 172.21.15.100:0/330236836 learned_addr learned my addr 172.21.15.100:0/330236836 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f1e00640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f406f570 0x7f82f4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82e9400640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82f41456c0 0x7f82f41f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 -- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82f41456c0 msgr2=0x7f82f41f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82f41456c0 0x7f82f41f92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 -- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f406f570 msgr2=0x7f82f4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f406f570 0x7f82f4156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 -- 172.21.15.100:0/330236836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f41589a0 con 0x7f82f415fb60 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f1e00640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f406f570 0x7f82f4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82f2800640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 0x7f82f40afac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00c780 tx=0x7f82ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.887+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec004b60 con 0x7f82f415fb60 2024-05-09T05:04:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.888+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec004d00 con 0x7f82f415fb60 2024-05-09T05:04:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.888+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f4158c80 con 0x7f82f415fb60 2024-05-09T05:04:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.888+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00aa90 con 0x7f82f415fb60 2024-05-09T05:04:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.888+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f4159240 con 0x7f82f415fb60 2024-05-09T05:04:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.889+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f40ce3d0 con 0x7f82f415fb60 2024-05-09T05:04:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.890+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f82ec00ac30 con 0x7f82f415fb60 2024-05-09T05:04:27.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.891+0000 7f82eaa00640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82d00762d0 0x7f82d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.891+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82ec0978a0 con 0x7f82f415fb60 2024-05-09T05:04:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.891+0000 7f82f1e00640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82d00762d0 0x7f82d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.892+0000 7f82f1e00640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82d00762d0 0x7f82d0078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82e4006fd0 tx=0x7f82e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:27.896+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82f40ce3d0 con 0x7f82f415fb60 2024-05-09T05:04:28.087 INFO:tasks.ceph.mds.c.smithi100.stderr:2024-05-09T05:04:28.087+0000 7fb782200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:04:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.103+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82f4072a30 con 0x7f82f415fb60 2024-05-09T05:04:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.106+0000 7f82eaa00640 1 -- 172.21.15.100:0/330236836 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f82f4072a30 con 0x7f82f415fb60 2024-05-09T05:04:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:28.108 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82d00762d0 msgr2=0x7f82d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82d00762d0 0x7f82d0078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82e4006fd0 tx=0x7f82e4008040 comp rx=0 tx=0).stop 2024-05-09T05:04:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 msgr2=0x7f82f40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 0x7f82f40afac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00c780 tx=0x7f82ec00cc40 comp rx=0 tx=0).stop 2024-05-09T05:04:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 shutdown_connections 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82d00762d0 0x7f82d0078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82f415fb60 0x7f82f40afac0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82f41456c0 0x7f82f41f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 --2- 172.21.15.100:0/330236836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82f406f570 0x7f82f4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 >> 172.21.15.100:0/330236836 conn(0x7f82f406c7f0 msgr2=0x7f82f406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 shutdown_connections 2024-05-09T05:04:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.109+0000 7f82f3200640 1 -- 172.21.15.100:0/330236836 wait complete. 2024-05-09T05:04:28.129 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:04:28.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:04:28.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.323+0000 7f91db200640 1 Processor -- start 2024-05-09T05:04:28.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.323+0000 7f91db200640 1 -- start start 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91db200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91d4145900 0x7f91d4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91db200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91d40739a0 0x7f91d40b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91db200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d406ead0 con 0x7f91d40b43f0 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91db200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f91d406f390 con 0x7f91d4145900 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91db200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f91d4070830 con 0x7f91d40739a0 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91d4145900 0x7f91d4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91d4145900 0x7f91d4073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49804/0 (socket says 172.21.15.100:49804) 2024-05-09T05:04:28.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 -- 172.21.15.100:0/2384370841 learned_addr learned my addr 172.21.15.100:0/2384370841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3400640 1 --2- 172.21.15.100:0/2384370841 >> v2:172.21.15.133:3300/0 conn(0x7f91d40739a0 0x7f91d40b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 -- 172.21.15.100:0/2384370841 >> v2:172.21.15.133:3300/0 conn(0x7f91d40739a0 msgr2=0x7f91d40b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 --2- 172.21.15.100:0/2384370841 >> v2:172.21.15.133:3300/0 conn(0x7f91d40739a0 0x7f91d40b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 -- 172.21.15.100:0/2384370841 >> v1:172.21.15.100:6789/0 conn(0x7f91d40b43f0 legacy=0x7f91d4163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.325+0000 7f91d3e00640 1 -- 172.21.15.100:0/2384370841 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d406ed40 con 0x7f91d4145900 2024-05-09T05:04:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.326+0000 7f91d3e00640 1 --2- 172.21.15.100:0/2384370841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d4145900 0x7f91d4073460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f91d4162fe0 tx=0x7f91c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288687e10e6c16e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91d2a00640 1 -- 172.21.15.100:0/2384370841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4037070 con 0x7f91d4145900 2024-05-09T05:04:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91d2a00640 1 -- 172.21.15.100:0/2384370841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c4032440 con 0x7f91d4145900 2024-05-09T05:04:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91d2a00640 1 -- 172.21.15.100:0/2384370841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4032810 con 0x7f91d4145900 2024-05-09T05:04:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 -- 172.21.15.100:0/2384370841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d4145900 msgr2=0x7f91d4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 --2- 172.21.15.100:0/2384370841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d4145900 0x7f91d4073460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f91d4162fe0 tx=0x7f91c402a270 comp rx=0 tx=0).stop 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 -- 172.21.15.100:0/2384370841 shutdown_connections 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 --2- 172.21.15.100:0/2384370841 >> v2:172.21.15.133:3300/0 conn(0x7f91d40739a0 0x7f91d40b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 --2- 172.21.15.100:0/2384370841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d4145900 0x7f91d4073460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 -- 172.21.15.100:0/2384370841 >> 172.21.15.100:0/2384370841 conn(0x7f91d40b31e0 msgr2=0x7f91d40d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 -- 172.21.15.100:0/2384370841 shutdown_connections 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.327+0000 7f91db200640 1 -- 172.21.15.100:0/2384370841 wait complete. 2024-05-09T05:04:28.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.329+0000 7f91db200640 1 Processor -- start 2024-05-09T05:04:28.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.330+0000 7f91db200640 1 -- start start 2024-05-09T05:04:28.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91db200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91d40739a0 0x7f91d415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91db200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 0x7f91d40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91db200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91d4145900 0x7f91d41f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91db200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91d40ade90 con 0x7f91d40b43f0 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91db200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4073e70 con 0x7f91d40739a0 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91db200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f91d4145ce0 con 0x7f91d4145900 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 0x7f91d40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 0x7f91d40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49812/0 (socket says 172.21.15.100:49812) 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 -- 172.21.15.100:0/2569098959 learned_addr learned my addr 172.21.15.100:0/2569098959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3e00640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91d40739a0 0x7f91d415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 -- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91d4145900 msgr2=0x7f91d41f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d9200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91d4145900 0x7f91d41f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91d4145900 0x7f91d41f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 -- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91d40739a0 msgr2=0x7f91d415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91d40739a0 0x7f91d415ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3400640 1 -- 172.21.15.100:0/2569098959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d40b0980 con 0x7f91d40b43f0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.331+0000 7f91d3e00640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91d40739a0 0x7f91d415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.332+0000 7f91d3400640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 0x7f91d40afac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c7f0 tx=0x7f91c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.332+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0015070 con 0x7f91d40b43f0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.332+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0004220 con 0x7f91d40b43f0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.332+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d40b03c0 con 0x7f91d40b43f0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.332+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0007620 con 0x7f91d40b43f0 2024-05-09T05:04:28.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.332+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d40ae1b0 con 0x7f91d40b43f0 2024-05-09T05:04:28.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.333+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d4076070 con 0x7f91d40b43f0 2024-05-09T05:04:28.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.334+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f91c00079d0 con 0x7f91d40b43f0 2024-05-09T05:04:28.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.335+0000 7f91cbe00640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f91b40762d0 0x7f91b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.335+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91c0097950 con 0x7f91d40b43f0 2024-05-09T05:04:28.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.335+0000 7f91d3e00640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f91b40762d0 0x7f91b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.336+0000 7f91d3e00640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f91b40762d0 0x7f91b4078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91c4034000 tx=0x7f91c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:28.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.339+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91d40b0980 con 0x7f91d40b43f0 2024-05-09T05:04:28.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.537+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91d40705f0 con 0x7f91b40762d0 2024-05-09T05:04:28.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.560+0000 7f91cbe00640 1 -- 172.21.15.100:0/2569098959 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f91d40705f0 con 0x7f91b40762d0 2024-05-09T05:04:28.564 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:28.565 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:04:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.564+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f91b40762d0 msgr2=0x7f91b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.564+0000 7f91db200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f91b40762d0 0x7f91b4078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91c4034000 tx=0x7f91c402e000 comp rx=0 tx=0).stop 2024-05-09T05:04:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.564+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 msgr2=0x7f91d40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.564+0000 7f91db200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 0x7f91d40afac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c7f0 tx=0x7f91c000ccb0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 shutdown_connections 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f91b40762d0 0x7f91b4078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91d4145900 0x7f91d41f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91d40b43f0 0x7f91d40afac0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 --2- 172.21.15.100:0/2569098959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91d40739a0 0x7f91d415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 >> 172.21.15.100:0/2569098959 conn(0x7f91d40b31e0 msgr2=0x7f91d409df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 shutdown_connections 2024-05-09T05:04:28.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.565+0000 7f91db200640 1 -- 172.21.15.100:0/2569098959 wait complete. 2024-05-09T05:04:28.584 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-09T05:04:27.882691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.755932"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591489+0000","last_change":"2024-05-09T05:04:24.203836+0000","last_active":"2024-05-09T05:04:25.591489+0000","last_peered":"2024-05-09T05:04:25.591489+0000","last_clean":"2024-05-09T05:04:25.591489+0000","last_became_active":"2024-05-09T05:04:24.203523+0000","last_became_peered":"2024-05-09T05:04:24.203523+0000","last_unstale":"2024-05-09T05:04:25.591489+0000","last_undegraded":"2024-05-09T05:04:25.591489+0000","last_fullsized":"2024-05-09T05:04:25.591489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:05.764536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589895+0000","last_change":"2024-05-09T05:04:24.173706+0000","last_active":"2024-05-09T05:04:25.589895+0000","last_peered":"2024-05-09T05:04:25.589895+0000","last_clean":"2024-05-09T05:04:25.589895+0000","last_became_active":"2024-05-09T05:04:24.173342+0000","last_became_peered":"2024-05-09T05:04:24.173342+0000","last_unstale":"2024-05-09T05:04:25.589895+0000","last_undegraded":"2024-05-09T05:04:25.589895+0000","last_fullsized":"2024-05-09T05:04:25.589895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181465+0000","last_change":"2024-05-09T05:04:24.189455+0000","last_active":"2024-05-09T05:04:25.181465+0000","last_peered":"2024-05-09T05:04:25.181465+0000","last_clean":"2024-05-09T05:04:25.181465+0000","last_became_active":"2024-05-09T05:04:24.189189+0000","last_became_peered":"2024-05-09T05:04:24.189189+0000","last_unstale":"2024-05-09T05:04:25.181465+0000","last_undegraded":"2024-05-09T05:04:25.181465+0000","last_fullsized":"2024-05-09T05:04:25.181465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187272+0000","last_change":"2024-05-09T05:04:24.178690+0000","last_active":"2024-05-09T05:04:25.187272+0000","last_peered":"2024-05-09T05:04:25.187272+0000","last_clean":"2024-05-09T05:04:25.187272+0000","last_became_active":"2024-05-09T05:04:24.178347+0000","last_became_peered":"2024-05-09T05:04:24.178347+0000","last_unstale":"2024-05-09T05:04:25.187272+0000","last_undegraded":"2024-05-09T05:04:25.187272+0000","last_fullsized":"2024-05-09T05:04:25.187272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590089+0000","last_change":"2024-05-09T05:04:24.191405+0000","last_active":"2024-05-09T05:04:25.590089+0000","last_peered":"2024-05-09T05:04:25.590089+0000","last_clean":"2024-05-09T05:04:25.590089+0000","last_became_active":"2024-05-09T05:04:24.191098+0000","last_became_peered":"2024-05-09T05:04:24.191098+0000","last_unstale":"2024-05-09T05:04:25.590089+0000","last_undegraded":"2024-05-09T05:04:25.590089+0000","last_fullsized":"2024-05-09T05:04:25.590089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186587+0000","last_change":"2024-05-09T05:04:24.179975+0000","last_active":"2024-05-09T05:04:25.186587+0000","last_peered":"2024-05-09T05:04:25.186587+0000","last_clean":"2024-05-09T05:04:25.186587+0000","last_became_active":"2024-05-09T05:04:24.179691+0000","last_became_peered":"2024-05-09T05:04:24.179691+0000","last_unstale":"2024-05-09T05:04:25.186587+0000","last_undegraded":"2024-05-09T05:04:25.186587+0000","last_fullsized":"2024-05-09T05:04:25.186587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589332+0000","last_change":"2024-05-09T05:04:24.203414+0000","last_active":"2024-05-09T05:04:25.589332+0000","last_peered":"2024-05-09T05:04:25.589332+0000","last_clean":"2024-05-09T05:04:25.589332+0000","last_became_active":"2024-05-09T05:04:24.201938+0000","last_became_peered":"2024-05-09T05:04:24.201938+0000","last_unstale":"2024-05-09T05:04:25.589332+0000","last_undegraded":"2024-05-09T05:04:25.589332+0000","last_fullsized":"2024-05-09T05:04:25.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591210+0000","last_change":"2024-05-09T05:04:24.184991+0000","last_active":"2024-05-09T05:04:25.591210+0000","last_peered":"2024-05-09T05:04:25.591210+0000","last_clean":"2024-05-09T05:04:25.591210+0000","last_became_active":"2024-05-09T05:04:24.184661+0000","last_became_peered":"2024-05-09T05:04:24.184661+0000","last_unstale":"2024-05-09T05:04:25.591210+0000","last_undegraded":"2024-05-09T05:04:25.591210+0000","last_fullsized":"2024-05-09T05:04:25.591210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591708+0000","last_change":"2024-05-09T05:04:24.205483+0000","last_active":"2024-05-09T05:04:25.591708+0000","last_peered":"2024-05-09T05:04:25.591708+0000","last_clean":"2024-05-09T05:04:25.591708+0000","last_became_active":"2024-05-09T05:04:24.205172+0000","last_became_peered":"2024-05-09T05:04:24.205172+0000","last_unstale":"2024-05-09T05:04:25.591708+0000","last_undegraded":"2024-05-09T05:04:25.591708+0000","last_fullsized":"2024-05-09T05:04:25.591708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:42.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590912+0000","last_change":"2024-05-09T05:04:24.189101+0000","last_active":"2024-05-09T05:04:25.590912+0000","last_peered":"2024-05-09T05:04:25.590912+0000","last_clean":"2024-05-09T05:04:25.590912+0000","last_became_active":"2024-05-09T05:04:24.188782+0000","last_became_peered":"2024-05-09T05:04:24.188782+0000","last_unstale":"2024-05-09T05:04:25.590912+0000","last_undegraded":"2024-05-09T05:04:25.590912+0000","last_fullsized":"2024-05-09T05:04:25.590912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590328+0000","last_change":"2024-05-09T05:04:24.194232+0000","last_active":"2024-05-09T05:04:25.590328+0000","last_peered":"2024-05-09T05:04:25.590328+0000","last_clean":"2024-05-09T05:04:25.590328+0000","last_became_active":"2024-05-09T05:04:24.193406+0000","last_became_peered":"2024-05-09T05:04:24.193406+0000","last_unstale":"2024-05-09T05:04:25.590328+0000","last_undegraded":"2024-05-09T05:04:25.590328+0000","last_fullsized":"2024-05-09T05:04:25.590328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185677+0000","last_change":"2024-05-09T05:04:24.191071+0000","last_active":"2024-05-09T05:04:25.185677+0000","last_peered":"2024-05-09T05:04:25.185677+0000","last_clean":"2024-05-09T05:04:25.185677+0000","last_became_active":"2024-05-09T05:04:24.190796+0000","last_became_peered":"2024-05-09T05:04:24.190796+0000","last_unstale":"2024-05-09T05:04:25.185677+0000","last_undegraded":"2024-05-09T05:04:25.185677+0000","last_fullsized":"2024-05-09T05:04:25.185677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:51.000950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591619+0000","last_change":"2024-05-09T05:04:24.181185+0000","last_active":"2024-05-09T05:04:25.591619+0000","last_peered":"2024-05-09T05:04:25.591619+0000","last_clean":"2024-05-09T05:04:25.591619+0000","last_became_active":"2024-05-09T05:04:24.180913+0000","last_became_peered":"2024-05-09T05:04:24.180913+0000","last_unstale":"2024-05-09T05:04:25.591619+0000","last_undegraded":"2024-05-09T05:04:25.591619+0000","last_fullsized":"2024-05-09T05:04:25.591619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181113+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.181113+0000","last_peered":"2024-05-09T05:04:25.181113+0000","last_clean":"2024-05-09T05:04:25.181113+0000","last_became_active":"2024-05-09T05:04:24.167267+0000","last_became_peered":"2024-05-09T05:04:24.167267+0000","last_unstale":"2024-05-09T05:04:25.181113+0000","last_undegraded":"2024-05-09T05:04:25.181113+0000","last_fullsized":"2024-05-09T05:04:25.181113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588520+0000","last_change":"2024-05-09T05:04:24.198074+0000","last_active":"2024-05-09T05:04:25.588520+0000","last_peered":"2024-05-09T05:04:25.588520+0000","last_clean":"2024-05-09T05:04:25.588520+0000","last_became_active":"2024-05-09T05:04:24.197831+0000","last_became_peered":"2024-05-09T05:04:24.197831+0000","last_unstale":"2024-05-09T05:04:25.588520+0000","last_undegraded":"2024-05-09T05:04:25.588520+0000","last_fullsized":"2024-05-09T05:04:25.588520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184408+0000","last_change":"2024-05-09T05:04:24.173451+0000","last_active":"2024-05-09T05:04:25.184408+0000","last_peered":"2024-05-09T05:04:25.184408+0000","last_clean":"2024-05-09T05:04:25.184408+0000","last_became_active":"2024-05-09T05:04:24.172936+0000","last_became_peered":"2024-05-09T05:04:24.172936+0000","last_unstale":"2024-05-09T05:04:25.184408+0000","last_undegraded":"2024-05-09T05:04:25.184408+0000","last_fullsized":"2024-05-09T05:04:25.184408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188372+0000","last_change":"2024-05-09T05:04:24.202382+0000","last_active":"2024-05-09T05:04:25.188372+0000","last_peered":"2024-05-09T05:04:25.188372+0000","last_clean":"2024-05-09T05:04:25.188372+0000","last_became_active":"2024-05-09T05:04:24.201887+0000","last_became_peered":"2024-05-09T05:04:24.201887+0000","last_unstale":"2024-05-09T05:04:25.188372+0000","last_undegraded":"2024-05-09T05:04:25.188372+0000","last_fullsized":"2024-05-09T05:04:25.188372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589079+0000","last_change":"2024-05-09T05:04:24.194414+0000","last_active":"2024-05-09T05:04:25.589079+0000","last_peered":"2024-05-09T05:04:25.589079+0000","last_clean":"2024-05-09T05:04:25.589079+0000","last_became_active":"2024-05-09T05:04:24.194106+0000","last_became_peered":"2024-05-09T05:04:24.194106+0000","last_unstale":"2024-05-09T05:04:25.589079+0000","last_undegraded":"2024-05-09T05:04:25.589079+0000","last_fullsized":"2024-05-09T05:04:25.589079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591114+0000","last_change":"2024-05-09T05:04:24.197967+0000","last_active":"2024-05-09T05:04:25.591114+0000","last_peered":"2024-05-09T05:04:25.591114+0000","last_clean":"2024-05-09T05:04:25.591114+0000","last_became_active":"2024-05-09T05:04:24.197672+0000","last_became_peered":"2024-05-09T05:04:24.197672+0000","last_unstale":"2024-05-09T05:04:25.591114+0000","last_undegraded":"2024-05-09T05:04:25.591114+0000","last_fullsized":"2024-05-09T05:04:25.591114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:16.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589820+0000","last_change":"2024-05-09T05:04:24.203278+0000","last_active":"2024-05-09T05:04:25.589820+0000","last_peered":"2024-05-09T05:04:25.589820+0000","last_clean":"2024-05-09T05:04:25.589820+0000","last_became_active":"2024-05-09T05:04:24.202994+0000","last_became_peered":"2024-05-09T05:04:24.202994+0000","last_unstale":"2024-05-09T05:04:25.589820+0000","last_undegraded":"2024-05-09T05:04:25.589820+0000","last_fullsized":"2024-05-09T05:04:25.589820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180771+0000","last_change":"2024-05-09T05:04:24.199162+0000","last_active":"2024-05-09T05:04:25.180771+0000","last_peered":"2024-05-09T05:04:25.180771+0000","last_clean":"2024-05-09T05:04:25.180771+0000","last_became_active":"2024-05-09T05:04:24.198809+0000","last_became_peered":"2024-05-09T05:04:24.198809+0000","last_unstale":"2024-05-09T05:04:25.180771+0000","last_undegraded":"2024-05-09T05:04:25.180771+0000","last_fullsized":"2024-05-09T05:04:25.180771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:06.638505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187003+0000","last_change":"2024-05-09T05:04:24.193592+0000","last_active":"2024-05-09T05:04:25.187003+0000","last_peered":"2024-05-09T05:04:25.187003+0000","last_clean":"2024-05-09T05:04:25.187003+0000","last_became_active":"2024-05-09T05:04:24.190111+0000","last_became_peered":"2024-05-09T05:04:24.190111+0000","last_unstale":"2024-05-09T05:04:25.187003+0000","last_undegraded":"2024-05-09T05:04:25.187003+0000","last_fullsized":"2024-05-09T05:04:25.187003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591263+0000","last_change":"2024-05-09T05:04:24.195840+0000","last_active":"2024-05-09T05:04:25.591263+0000","last_peered":"2024-05-09T05:04:25.591263+0000","last_clean":"2024-05-09T05:04:25.591263+0000","last_became_active":"2024-05-09T05:04:24.195548+0000","last_became_peered":"2024-05-09T05:04:24.195548+0000","last_unstale":"2024-05-09T05:04:25.591263+0000","last_undegraded":"2024-05-09T05:04:25.591263+0000","last_fullsized":"2024-05-09T05:04:25.591263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184835+0000","last_change":"2024-05-09T05:04:24.177654+0000","last_active":"2024-05-09T05:04:25.184835+0000","last_peered":"2024-05-09T05:04:25.184835+0000","last_clean":"2024-05-09T05:04:25.184835+0000","last_became_active":"2024-05-09T05:04:24.177281+0000","last_became_peered":"2024-05-09T05:04:24.177281+0000","last_unstale":"2024-05-09T05:04:25.184835+0000","last_undegraded":"2024-05-09T05:04:25.184835+0000","last_fullsized":"2024-05-09T05:04:25.184835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592160+0000","last_change":"2024-05-09T05:04:24.194016+0000","last_active":"2024-05-09T05:04:25.592160+0000","last_peered":"2024-05-09T05:04:25.592160+0000","last_clean":"2024-05-09T05:04:25.592160+0000","last_became_active":"2024-05-09T05:04:24.193720+0000","last_became_peered":"2024-05-09T05:04:24.193720+0000","last_unstale":"2024-05-09T05:04:25.592160+0000","last_undegraded":"2024-05-09T05:04:25.592160+0000","last_fullsized":"2024-05-09T05:04:25.592160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591104+0000","last_change":"2024-05-09T05:04:24.189812+0000","last_active":"2024-05-09T05:04:25.591104+0000","last_peered":"2024-05-09T05:04:25.591104+0000","last_clean":"2024-05-09T05:04:25.591104+0000","last_became_active":"2024-05-09T05:04:24.189449+0000","last_became_peered":"2024-05-09T05:04:24.189449+0000","last_unstale":"2024-05-09T05:04:25.591104+0000","last_undegraded":"2024-05-09T05:04:25.591104+0000","last_fullsized":"2024-05-09T05:04:25.591104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590046+0000","last_change":"2024-05-09T05:04:24.176362+0000","last_active":"2024-05-09T05:04:25.590046+0000","last_peered":"2024-05-09T05:04:25.590046+0000","last_clean":"2024-05-09T05:04:25.590046+0000","last_became_active":"2024-05-09T05:04:24.176105+0000","last_became_peered":"2024-05-09T05:04:24.176105+0000","last_unstale":"2024-05-09T05:04:25.590046+0000","last_undegraded":"2024-05-09T05:04:25.590046+0000","last_fullsized":"2024-05-09T05:04:25.590046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592264+0000","last_change":"2024-05-09T05:04:24.202970+0000","last_active":"2024-05-09T05:04:25.592264+0000","last_peered":"2024-05-09T05:04:25.592264+0000","last_clean":"2024-05-09T05:04:25.592264+0000","last_became_active":"2024-05-09T05:04:24.202686+0000","last_became_peered":"2024-05-09T05:04:24.202686+0000","last_unstale":"2024-05-09T05:04:25.592264+0000","last_undegraded":"2024-05-09T05:04:25.592264+0000","last_fullsized":"2024-05-09T05:04:25.592264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180896+0000","last_change":"2024-05-09T05:04:24.174802+0000","last_active":"2024-05-09T05:04:25.180896+0000","last_peered":"2024-05-09T05:04:25.180896+0000","last_clean":"2024-05-09T05:04:25.180896+0000","last_became_active":"2024-05-09T05:04:24.174563+0000","last_became_peered":"2024-05-09T05:04:24.174563+0000","last_unstale":"2024-05-09T05:04:25.180896+0000","last_undegraded":"2024-05-09T05:04:25.180896+0000","last_fullsized":"2024-05-09T05:04:25.180896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.877889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187440+0000","last_change":"2024-05-09T05:04:24.177693+0000","last_active":"2024-05-09T05:04:25.187440+0000","last_peered":"2024-05-09T05:04:25.187440+0000","last_clean":"2024-05-09T05:04:25.187440+0000","last_became_active":"2024-05-09T05:04:24.177378+0000","last_became_peered":"2024-05-09T05:04:24.177378+0000","last_unstale":"2024-05-09T05:04:25.187440+0000","last_undegraded":"2024-05-09T05:04:25.187440+0000","last_fullsized":"2024-05-09T05:04:25.187440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588726+0000","last_change":"2024-05-09T05:04:24.187125+0000","last_active":"2024-05-09T05:04:25.588726+0000","last_peered":"2024-05-09T05:04:25.588726+0000","last_clean":"2024-05-09T05:04:25.588726+0000","last_became_active":"2024-05-09T05:04:24.186891+0000","last_became_peered":"2024-05-09T05:04:24.186891+0000","last_unstale":"2024-05-09T05:04:25.588726+0000","last_undegraded":"2024-05-09T05:04:25.588726+0000","last_fullsized":"2024-05-09T05:04:25.588726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588587+0000","last_change":"2024-05-09T05:04:24.181177+0000","last_active":"2024-05-09T05:04:25.588587+0000","last_peered":"2024-05-09T05:04:25.588587+0000","last_clean":"2024-05-09T05:04:25.588587+0000","last_became_active":"2024-05-09T05:04:24.180833+0000","last_became_peered":"2024-05-09T05:04:24.180833+0000","last_unstale":"2024-05-09T05:04:25.588587+0000","last_undegraded":"2024-05-09T05:04:25.588587+0000","last_fullsized":"2024-05-09T05:04:25.588587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185228+0000","last_change":"2024-05-09T05:04:24.193208+0000","last_active":"2024-05-09T05:04:25.185228+0000","last_peered":"2024-05-09T05:04:25.185228+0000","last_clean":"2024-05-09T05:04:25.185228+0000","last_became_active":"2024-05-09T05:04:24.192925+0000","last_became_peered":"2024-05-09T05:04:24.192925+0000","last_unstale":"2024-05-09T05:04:25.185228+0000","last_undegraded":"2024-05-09T05:04:25.185228+0000","last_fullsized":"2024-05-09T05:04:25.185228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:34.632849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592174+0000","last_change":"2024-05-09T05:04:23.180425+0000","last_active":"2024-05-09T05:04:25.592174+0000","last_peered":"2024-05-09T05:04:25.592174+0000","last_clean":"2024-05-09T05:04:25.592174+0000","last_became_active":"2024-05-09T05:04:23.180148+0000","last_became_peered":"2024-05-09T05:04:23.180148+0000","last_unstale":"2024-05-09T05:04:25.592174+0000","last_undegraded":"2024-05-09T05:04:25.592174+0000","last_fullsized":"2024-05-09T05:04:25.592174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180999+0000","last_change":"2024-05-09T05:04:24.195547+0000","last_active":"2024-05-09T05:04:25.180999+0000","last_peered":"2024-05-09T05:04:25.180999+0000","last_clean":"2024-05-09T05:04:25.180999+0000","last_became_active":"2024-05-09T05:04:24.195230+0000","last_became_peered":"2024-05-09T05:04:24.195230+0000","last_unstale":"2024-05-09T05:04:25.180999+0000","last_undegraded":"2024-05-09T05:04:25.180999+0000","last_fullsized":"2024-05-09T05:04:25.180999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588849+0000","last_change":"2024-05-09T05:04:23.181255+0000","last_active":"2024-05-09T05:04:25.588849+0000","last_peered":"2024-05-09T05:04:25.588849+0000","last_clean":"2024-05-09T05:04:25.588849+0000","last_became_active":"2024-05-09T05:04:23.180998+0000","last_became_peered":"2024-05-09T05:04:23.180998+0000","last_unstale":"2024-05-09T05:04:25.588849+0000","last_undegraded":"2024-05-09T05:04:25.588849+0000","last_fullsized":"2024-05-09T05:04:25.588849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591449+0000","last_change":"2024-05-09T05:04:23.180456+0000","last_active":"2024-05-09T05:04:25.591449+0000","last_peered":"2024-05-09T05:04:25.591449+0000","last_clean":"2024-05-09T05:04:25.591449+0000","last_became_active":"2024-05-09T05:04:23.179393+0000","last_became_peered":"2024-05-09T05:04:23.179393+0000","last_unstale":"2024-05-09T05:04:25.591449+0000","last_undegraded":"2024-05-09T05:04:25.591449+0000","last_fullsized":"2024-05-09T05:04:25.591449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591092+0000","last_change":"2024-05-09T05:04:24.168133+0000","last_active":"2024-05-09T05:04:25.591092+0000","last_peered":"2024-05-09T05:04:25.591092+0000","last_clean":"2024-05-09T05:04:25.591092+0000","last_became_active":"2024-05-09T05:04:24.167871+0000","last_became_peered":"2024-05-09T05:04:24.167871+0000","last_unstale":"2024-05-09T05:04:25.591092+0000","last_undegraded":"2024-05-09T05:04:25.591092+0000","last_fullsized":"2024-05-09T05:04:25.591092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185098+0000","last_change":"2024-05-09T05:04:23.185286+0000","last_active":"2024-05-09T05:04:25.185098+0000","last_peered":"2024-05-09T05:04:25.185098+0000","last_clean":"2024-05-09T05:04:25.185098+0000","last_became_active":"2024-05-09T05:04:23.184998+0000","last_became_peered":"2024-05-09T05:04:23.184998+0000","last_unstale":"2024-05-09T05:04:25.185098+0000","last_undegraded":"2024-05-09T05:04:25.185098+0000","last_fullsized":"2024-05-09T05:04:25.185098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588614+0000","last_change":"2024-05-09T05:04:24.175033+0000","last_active":"2024-05-09T05:04:25.588614+0000","last_peered":"2024-05-09T05:04:25.588614+0000","last_clean":"2024-05-09T05:04:25.588614+0000","last_became_active":"2024-05-09T05:04:24.174753+0000","last_became_peered":"2024-05-09T05:04:24.174753+0000","last_unstale":"2024-05-09T05:04:25.588614+0000","last_undegraded":"2024-05-09T05:04:25.588614+0000","last_fullsized":"2024-05-09T05:04:25.588614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591751+0000","last_change":"2024-05-09T05:04:23.182654+0000","last_active":"2024-05-09T05:04:25.591751+0000","last_peered":"2024-05-09T05:04:25.591751+0000","last_clean":"2024-05-09T05:04:25.591751+0000","last_became_active":"2024-05-09T05:04:23.182087+0000","last_became_peered":"2024-05-09T05:04:23.182087+0000","last_unstale":"2024-05-09T05:04:25.591751+0000","last_undegraded":"2024-05-09T05:04:25.591751+0000","last_fullsized":"2024-05-09T05:04:25.591751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187491+0000","last_change":"2024-05-09T05:04:24.194301+0000","last_active":"2024-05-09T05:04:25.187491+0000","last_peered":"2024-05-09T05:04:25.187491+0000","last_clean":"2024-05-09T05:04:25.187491+0000","last_became_active":"2024-05-09T05:04:24.190096+0000","last_became_peered":"2024-05-09T05:04:24.190096+0000","last_unstale":"2024-05-09T05:04:25.187491+0000","last_undegraded":"2024-05-09T05:04:25.187491+0000","last_fullsized":"2024-05-09T05:04:25.187491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187700+0000","last_change":"2024-05-09T05:04:23.186630+0000","last_active":"2024-05-09T05:04:25.187700+0000","last_peered":"2024-05-09T05:04:25.187700+0000","last_clean":"2024-05-09T05:04:25.187700+0000","last_became_active":"2024-05-09T05:04:23.186214+0000","last_became_peered":"2024-05-09T05:04:23.186214+0000","last_unstale":"2024-05-09T05:04:25.187700+0000","last_undegraded":"2024-05-09T05:04:25.187700+0000","last_fullsized":"2024-05-09T05:04:25.187700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181800+0000","last_change":"2024-05-09T05:04:24.184201+0000","last_active":"2024-05-09T05:04:25.181800+0000","last_peered":"2024-05-09T05:04:25.181800+0000","last_clean":"2024-05-09T05:04:25.181800+0000","last_became_active":"2024-05-09T05:04:24.183907+0000","last_became_peered":"2024-05-09T05:04:24.183907+0000","last_unstale":"2024-05-09T05:04:25.181800+0000","last_undegraded":"2024-05-09T05:04:25.181800+0000","last_fullsized":"2024-05-09T05:04:25.181800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590227+0000","last_change":"2024-05-09T05:04:23.174192+0000","last_active":"2024-05-09T05:04:25.590227+0000","last_peered":"2024-05-09T05:04:25.590227+0000","last_clean":"2024-05-09T05:04:25.590227+0000","last_became_active":"2024-05-09T05:04:23.173954+0000","last_became_peered":"2024-05-09T05:04:23.173954+0000","last_unstale":"2024-05-09T05:04:25.590227+0000","last_undegraded":"2024-05-09T05:04:25.590227+0000","last_fullsized":"2024-05-09T05:04:25.590227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187980+0000","last_change":"2024-05-09T05:04:24.199870+0000","last_active":"2024-05-09T05:04:25.187980+0000","last_peered":"2024-05-09T05:04:25.187980+0000","last_clean":"2024-05-09T05:04:25.187980+0000","last_became_active":"2024-05-09T05:04:24.194765+0000","last_became_peered":"2024-05-09T05:04:24.194765+0000","last_unstale":"2024-05-09T05:04:25.187980+0000","last_undegraded":"2024-05-09T05:04:25.187980+0000","last_fullsized":"2024-05-09T05:04:25.187980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:00.442516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589940+0000","last_change":"2024-05-09T05:04:23.178383+0000","last_active":"2024-05-09T05:04:25.589940+0000","last_peered":"2024-05-09T05:04:25.589940+0000","last_clean":"2024-05-09T05:04:25.589940+0000","last_became_active":"2024-05-09T05:04:23.177752+0000","last_became_peered":"2024-05-09T05:04:23.177752+0000","last_unstale":"2024-05-09T05:04:25.589940+0000","last_undegraded":"2024-05-09T05:04:25.589940+0000","last_fullsized":"2024-05-09T05:04:25.589940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590379+0000","last_change":"2024-05-09T05:04:24.198031+0000","last_active":"2024-05-09T05:04:25.590379+0000","last_peered":"2024-05-09T05:04:25.590379+0000","last_clean":"2024-05-09T05:04:25.590379+0000","last_became_active":"2024-05-09T05:04:24.197675+0000","last_became_peered":"2024-05-09T05:04:24.197675+0000","last_unstale":"2024-05-09T05:04:25.590379+0000","last_undegraded":"2024-05-09T05:04:25.590379+0000","last_fullsized":"2024-05-09T05:04:25.590379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181054+0000","last_change":"2024-05-09T05:04:23.172214+0000","last_active":"2024-05-09T05:04:25.181054+0000","last_peered":"2024-05-09T05:04:25.181054+0000","last_clean":"2024-05-09T05:04:25.181054+0000","last_became_active":"2024-05-09T05:04:23.171697+0000","last_became_peered":"2024-05-09T05:04:23.171697+0000","last_unstale":"2024-05-09T05:04:25.181054+0000","last_undegraded":"2024-05-09T05:04:25.181054+0000","last_fullsized":"2024-05-09T05:04:25.181054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181247+0000","last_change":"2024-05-09T05:04:24.200063+0000","last_active":"2024-05-09T05:04:25.181247+0000","last_peered":"2024-05-09T05:04:25.181247+0000","last_clean":"2024-05-09T05:04:25.181247+0000","last_became_active":"2024-05-09T05:04:24.198772+0000","last_became_peered":"2024-05-09T05:04:24.198772+0000","last_unstale":"2024-05-09T05:04:25.181247+0000","last_undegraded":"2024-05-09T05:04:25.181247+0000","last_fullsized":"2024-05-09T05:04:25.181247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187721+0000","last_change":"2024-05-09T05:04:23.175634+0000","last_active":"2024-05-09T05:04:25.187721+0000","last_peered":"2024-05-09T05:04:25.187721+0000","last_clean":"2024-05-09T05:04:25.187721+0000","last_became_active":"2024-05-09T05:04:23.173526+0000","last_became_peered":"2024-05-09T05:04:23.173526+0000","last_unstale":"2024-05-09T05:04:25.187721+0000","last_undegraded":"2024-05-09T05:04:25.187721+0000","last_fullsized":"2024-05-09T05:04:25.187721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590502+0000","last_change":"2024-05-09T05:04:24.205506+0000","last_active":"2024-05-09T05:04:25.590502+0000","last_peered":"2024-05-09T05:04:25.590502+0000","last_clean":"2024-05-09T05:04:25.590502+0000","last_became_active":"2024-05-09T05:04:24.205221+0000","last_became_peered":"2024-05-09T05:04:24.205221+0000","last_unstale":"2024-05-09T05:04:25.590502+0000","last_undegraded":"2024-05-09T05:04:25.590502+0000","last_fullsized":"2024-05-09T05:04:25.590502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588601+0000","last_change":"2024-05-09T05:04:23.183566+0000","last_active":"2024-05-09T05:04:25.588601+0000","last_peered":"2024-05-09T05:04:25.588601+0000","last_clean":"2024-05-09T05:04:25.588601+0000","last_became_active":"2024-05-09T05:04:23.182348+0000","last_became_peered":"2024-05-09T05:04:23.182348+0000","last_unstale":"2024-05-09T05:04:25.588601+0000","last_undegraded":"2024-05-09T05:04:25.588601+0000","last_fullsized":"2024-05-09T05:04:25.588601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588690+0000","last_change":"2024-05-09T05:04:24.185048+0000","last_active":"2024-05-09T05:04:25.588690+0000","last_peered":"2024-05-09T05:04:25.588690+0000","last_clean":"2024-05-09T05:04:25.588690+0000","last_became_active":"2024-05-09T05:04:24.184774+0000","last_became_peered":"2024-05-09T05:04:24.184774+0000","last_unstale":"2024-05-09T05:04:25.588690+0000","last_undegraded":"2024-05-09T05:04:25.588690+0000","last_fullsized":"2024-05-09T05:04:25.588690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588925+0000","last_change":"2024-05-09T05:04:23.166873+0000","last_active":"2024-05-09T05:04:25.588925+0000","last_peered":"2024-05-09T05:04:25.588925+0000","last_clean":"2024-05-09T05:04:25.588925+0000","last_became_active":"2024-05-09T05:04:23.166497+0000","last_became_peered":"2024-05-09T05:04:23.166497+0000","last_unstale":"2024-05-09T05:04:25.588925+0000","last_undegraded":"2024-05-09T05:04:25.588925+0000","last_fullsized":"2024-05-09T05:04:25.588925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589440+0000","last_change":"2024-05-09T05:04:24.206139+0000","last_active":"2024-05-09T05:04:25.589440+0000","last_peered":"2024-05-09T05:04:25.589440+0000","last_clean":"2024-05-09T05:04:25.589440+0000","last_became_active":"2024-05-09T05:04:24.205511+0000","last_became_peered":"2024-05-09T05:04:24.205511+0000","last_unstale":"2024-05-09T05:04:25.589440+0000","last_undegraded":"2024-05-09T05:04:25.589440+0000","last_fullsized":"2024-05-09T05:04:25.589440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186530+0000","last_change":"2024-05-09T05:04:23.171534+0000","last_active":"2024-05-09T05:04:25.186530+0000","last_peered":"2024-05-09T05:04:25.186530+0000","last_clean":"2024-05-09T05:04:25.186530+0000","last_became_active":"2024-05-09T05:04:23.170897+0000","last_became_peered":"2024-05-09T05:04:23.170897+0000","last_unstale":"2024-05-09T05:04:25.186530+0000","last_undegraded":"2024-05-09T05:04:25.186530+0000","last_fullsized":"2024-05-09T05:04:25.186530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591239+0000","last_change":"2024-05-09T05:04:24.205782+0000","last_active":"2024-05-09T05:04:25.591239+0000","last_peered":"2024-05-09T05:04:25.591239+0000","last_clean":"2024-05-09T05:04:25.591239+0000","last_became_active":"2024-05-09T05:04:24.205206+0000","last_became_peered":"2024-05-09T05:04:24.205206+0000","last_unstale":"2024-05-09T05:04:25.591239+0000","last_undegraded":"2024-05-09T05:04:25.591239+0000","last_fullsized":"2024-05-09T05:04:25.591239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:04.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589468+0000","last_change":"2024-05-09T05:04:23.165788+0000","last_active":"2024-05-09T05:04:25.589468+0000","last_peered":"2024-05-09T05:04:25.589468+0000","last_clean":"2024-05-09T05:04:25.589468+0000","last_became_active":"2024-05-09T05:04:23.165479+0000","last_became_peered":"2024-05-09T05:04:23.165479+0000","last_unstale":"2024-05-09T05:04:25.589468+0000","last_undegraded":"2024-05-09T05:04:25.589468+0000","last_fullsized":"2024-05-09T05:04:25.589468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591882+0000","last_change":"2024-05-09T05:04:24.209039+0000","last_active":"2024-05-09T05:04:25.591882+0000","last_peered":"2024-05-09T05:04:25.591882+0000","last_clean":"2024-05-09T05:04:25.591882+0000","last_became_active":"2024-05-09T05:04:24.208701+0000","last_became_peered":"2024-05-09T05:04:24.208701+0000","last_unstale":"2024-05-09T05:04:25.591882+0000","last_undegraded":"2024-05-09T05:04:25.591882+0000","last_fullsized":"2024-05-09T05:04:25.591882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:08.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590358+0000","last_change":"2024-05-09T05:04:23.180485+0000","last_active":"2024-05-09T05:04:25.590358+0000","last_peered":"2024-05-09T05:04:25.590358+0000","last_clean":"2024-05-09T05:04:25.590358+0000","last_became_active":"2024-05-09T05:04:23.179867+0000","last_became_peered":"2024-05-09T05:04:23.179867+0000","last_unstale":"2024-05-09T05:04:25.590358+0000","last_undegraded":"2024-05-09T05:04:25.590358+0000","last_fullsized":"2024-05-09T05:04:25.590358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188120+0000","last_change":"2024-05-09T05:04:24.178327+0000","last_active":"2024-05-09T05:04:25.188120+0000","last_peered":"2024-05-09T05:04:25.188120+0000","last_clean":"2024-05-09T05:04:25.188120+0000","last_became_active":"2024-05-09T05:04:24.178031+0000","last_became_peered":"2024-05-09T05:04:24.178031+0000","last_unstale":"2024-05-09T05:04:25.188120+0000","last_undegraded":"2024-05-09T05:04:25.188120+0000","last_fullsized":"2024-05-09T05:04:25.188120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589001+0000","last_change":"2024-05-09T05:04:23.178749+0000","last_active":"2024-05-09T05:04:25.589001+0000","last_peered":"2024-05-09T05:04:25.589001+0000","last_clean":"2024-05-09T05:04:25.589001+0000","last_became_active":"2024-05-09T05:04:23.178241+0000","last_became_peered":"2024-05-09T05:04:23.178241+0000","last_unstale":"2024-05-09T05:04:25.589001+0000","last_undegraded":"2024-05-09T05:04:25.589001+0000","last_fullsized":"2024-05-09T05:04:25.589001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590329+0000","last_change":"2024-05-09T05:04:24.201431+0000","last_active":"2024-05-09T05:04:25.590329+0000","last_peered":"2024-05-09T05:04:25.590329+0000","last_clean":"2024-05-09T05:04:25.590329+0000","last_became_active":"2024-05-09T05:04:24.201222+0000","last_became_peered":"2024-05-09T05:04:24.201222+0000","last_unstale":"2024-05-09T05:04:25.590329+0000","last_undegraded":"2024-05-09T05:04:25.590329+0000","last_fullsized":"2024-05-09T05:04:25.590329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589083+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:04:25.589083+0000","last_peered":"2024-05-09T05:04:25.589083+0000","last_clean":"2024-05-09T05:04:25.589083+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:04:25.589083+0000","last_undegraded":"2024-05-09T05:04:25.589083+0000","last_fullsized":"2024-05-09T05:04:25.589083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187511+0000","last_change":"2024-05-09T05:04:23.172824+0000","last_active":"2024-05-09T05:04:25.187511+0000","last_peered":"2024-05-09T05:04:25.187511+0000","last_clean":"2024-05-09T05:04:25.187511+0000","last_became_active":"2024-05-09T05:04:23.170516+0000","last_became_peered":"2024-05-09T05:04:23.170516+0000","last_unstale":"2024-05-09T05:04:25.187511+0000","last_undegraded":"2024-05-09T05:04:25.187511+0000","last_fullsized":"2024-05-09T05:04:25.187511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591314+0000","last_change":"2024-05-09T05:04:24.190284+0000","last_active":"2024-05-09T05:04:25.591314+0000","last_peered":"2024-05-09T05:04:25.591314+0000","last_clean":"2024-05-09T05:04:25.591314+0000","last_became_active":"2024-05-09T05:04:24.189965+0000","last_became_peered":"2024-05-09T05:04:24.189965+0000","last_unstale":"2024-05-09T05:04:25.591314+0000","last_undegraded":"2024-05-09T05:04:25.591314+0000","last_fullsized":"2024-05-09T05:04:25.591314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589150+0000","last_change":"2024-05-09T05:04:23.190598+0000","last_active":"2024-05-09T05:04:25.589150+0000","last_peered":"2024-05-09T05:04:25.589150+0000","last_clean":"2024-05-09T05:04:25.589150+0000","last_became_active":"2024-05-09T05:04:23.190004+0000","last_became_peered":"2024-05-09T05:04:23.190004+0000","last_unstale":"2024-05-09T05:04:25.589150+0000","last_undegraded":"2024-05-09T05:04:25.589150+0000","last_fullsized":"2024-05-09T05:04:25.589150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180906+0000","last_change":"2024-05-09T05:04:24.188115+0000","last_active":"2024-05-09T05:04:25.180906+0000","last_peered":"2024-05-09T05:04:25.180906+0000","last_clean":"2024-05-09T05:04:25.180906+0000","last_became_active":"2024-05-09T05:04:24.187747+0000","last_became_peered":"2024-05-09T05:04:24.187747+0000","last_unstale":"2024-05-09T05:04:25.180906+0000","last_undegraded":"2024-05-09T05:04:25.180906+0000","last_fullsized":"2024-05-09T05:04:25.180906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:16.303467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589266+0000","last_change":"2024-05-09T05:04:23.167656+0000","last_active":"2024-05-09T05:04:25.589266+0000","last_peered":"2024-05-09T05:04:25.589266+0000","last_clean":"2024-05-09T05:04:25.589266+0000","last_became_active":"2024-05-09T05:04:23.167341+0000","last_became_peered":"2024-05-09T05:04:23.167341+0000","last_unstale":"2024-05-09T05:04:25.589266+0000","last_undegraded":"2024-05-09T05:04:25.589266+0000","last_fullsized":"2024-05-09T05:04:25.589266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588789+0000","last_change":"2024-05-09T05:04:24.193106+0000","last_active":"2024-05-09T05:04:25.588789+0000","last_peered":"2024-05-09T05:04:25.588789+0000","last_clean":"2024-05-09T05:04:25.588789+0000","last_became_active":"2024-05-09T05:04:24.191023+0000","last_became_peered":"2024-05-09T05:04:24.191023+0000","last_unstale":"2024-05-09T05:04:25.588789+0000","last_undegraded":"2024-05-09T05:04:25.588789+0000","last_fullsized":"2024-05-09T05:04:25.588789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187924+0000","last_change":"2024-05-09T05:04:23.166039+0000","last_active":"2024-05-09T05:04:25.187924+0000","last_peered":"2024-05-09T05:04:25.187924+0000","last_clean":"2024-05-09T05:04:25.187924+0000","last_became_active":"2024-05-09T05:04:23.165410+0000","last_became_peered":"2024-05-09T05:04:23.165410+0000","last_unstale":"2024-05-09T05:04:25.187924+0000","last_undegraded":"2024-05-09T05:04:25.187924+0000","last_fullsized":"2024-05-09T05:04:25.187924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185765+0000","last_change":"2024-05-09T05:04:24.201881+0000","last_active":"2024-05-09T05:04:25.185765+0000","last_peered":"2024-05-09T05:04:25.185765+0000","last_clean":"2024-05-09T05:04:25.185765+0000","last_became_active":"2024-05-09T05:04:24.197108+0000","last_became_peered":"2024-05-09T05:04:24.197108+0000","last_unstale":"2024-05-09T05:04:25.185765+0000","last_undegraded":"2024-05-09T05:04:25.185765+0000","last_fullsized":"2024-05-09T05:04:25.185765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589619+0000","last_change":"2024-05-09T05:04:23.167664+0000","last_active":"2024-05-09T05:04:25.589619+0000","last_peered":"2024-05-09T05:04:25.589619+0000","last_clean":"2024-05-09T05:04:25.589619+0000","last_became_active":"2024-05-09T05:04:23.167332+0000","last_became_peered":"2024-05-09T05:04:23.167332+0000","last_unstale":"2024-05-09T05:04:25.589619+0000","last_undegraded":"2024-05-09T05:04:25.589619+0000","last_fullsized":"2024-05-09T05:04:25.589619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188219+0000","last_change":"2024-05-09T05:04:24.176401+0000","last_active":"2024-05-09T05:04:25.188219+0000","last_peered":"2024-05-09T05:04:25.188219+0000","last_clean":"2024-05-09T05:04:25.188219+0000","last_became_active":"2024-05-09T05:04:24.176054+0000","last_became_peered":"2024-05-09T05:04:24.176054+0000","last_unstale":"2024-05-09T05:04:25.188219+0000","last_undegraded":"2024-05-09T05:04:25.188219+0000","last_fullsized":"2024-05-09T05:04:25.188219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591454+0000","last_change":"2024-05-09T05:04:23.190670+0000","last_active":"2024-05-09T05:04:25.591454+0000","last_peered":"2024-05-09T05:04:25.591454+0000","last_clean":"2024-05-09T05:04:25.591454+0000","last_became_active":"2024-05-09T05:04:23.190356+0000","last_became_peered":"2024-05-09T05:04:23.190356+0000","last_unstale":"2024-05-09T05:04:25.591454+0000","last_undegraded":"2024-05-09T05:04:25.591454+0000","last_fullsized":"2024-05-09T05:04:25.591454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:15.288068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589390+0000","last_change":"2024-05-09T05:04:24.190440+0000","last_active":"2024-05-09T05:04:25.589390+0000","last_peered":"2024-05-09T05:04:25.589390+0000","last_clean":"2024-05-09T05:04:25.589390+0000","last_became_active":"2024-05-09T05:04:24.190123+0000","last_became_peered":"2024-05-09T05:04:24.190123+0000","last_unstale":"2024-05-09T05:04:25.589390+0000","last_undegraded":"2024-05-09T05:04:25.589390+0000","last_fullsized":"2024-05-09T05:04:25.589390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:26.165909+0000","last_change":"2024-05-09T05:04:23.180222+0000","last_active":"2024-05-09T05:04:26.165909+0000","last_peered":"2024-05-09T05:04:26.165909+0000","last_clean":"2024-05-09T05:04:26.165909+0000","last_became_active":"2024-05-09T05:04:23.179880+0000","last_became_peered":"2024-05-09T05:04:23.179880+0000","last_unstale":"2024-05-09T05:04:26.165909+0000","last_undegraded":"2024-05-09T05:04:26.165909+0000","last_fullsized":"2024-05-09T05:04:26.165909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592374+0000","last_change":"2024-05-09T05:04:24.200883+0000","last_active":"2024-05-09T05:04:25.592374+0000","last_peered":"2024-05-09T05:04:25.592374+0000","last_clean":"2024-05-09T05:04:25.592374+0000","last_became_active":"2024-05-09T05:04:24.200559+0000","last_became_peered":"2024-05-09T05:04:24.200559+0000","last_unstale":"2024-05-09T05:04:25.592374+0000","last_undegraded":"2024-05-09T05:04:25.592374+0000","last_fullsized":"2024-05-09T05:04:25.592374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591990+0000","last_change":"2024-05-09T05:04:23.187164+0000","last_active":"2024-05-09T05:04:25.591990+0000","last_peered":"2024-05-09T05:04:25.591990+0000","last_clean":"2024-05-09T05:04:25.591990+0000","last_became_active":"2024-05-09T05:04:23.186835+0000","last_became_peered":"2024-05-09T05:04:23.186835+0000","last_unstale":"2024-05-09T05:04:25.591990+0000","last_undegraded":"2024-05-09T05:04:25.591990+0000","last_fullsized":"2024-05-09T05:04:25.591990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181677+0000","last_change":"2024-05-09T05:04:24.169643+0000","last_active":"2024-05-09T05:04:25.181677+0000","last_peered":"2024-05-09T05:04:25.181677+0000","last_clean":"2024-05-09T05:04:25.181677+0000","last_became_active":"2024-05-09T05:04:24.169348+0000","last_became_peered":"2024-05-09T05:04:24.169348+0000","last_unstale":"2024-05-09T05:04:25.181677+0000","last_undegraded":"2024-05-09T05:04:25.181677+0000","last_fullsized":"2024-05-09T05:04:25.181677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588730+0000","last_change":"2024-05-09T05:04:23.190850+0000","last_active":"2024-05-09T05:04:25.588730+0000","last_peered":"2024-05-09T05:04:25.588730+0000","last_clean":"2024-05-09T05:04:25.588730+0000","last_became_active":"2024-05-09T05:04:23.190358+0000","last_became_peered":"2024-05-09T05:04:23.190358+0000","last_unstale":"2024-05-09T05:04:25.588730+0000","last_undegraded":"2024-05-09T05:04:25.588730+0000","last_fullsized":"2024-05-09T05:04:25.588730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186764+0000","last_change":"2024-05-09T05:04:24.186871+0000","last_active":"2024-05-09T05:04:25.186764+0000","last_peered":"2024-05-09T05:04:25.186764+0000","last_clean":"2024-05-09T05:04:25.186764+0000","last_became_active":"2024-05-09T05:04:24.186416+0000","last_became_peered":"2024-05-09T05:04:24.186416+0000","last_unstale":"2024-05-09T05:04:25.186764+0000","last_undegraded":"2024-05-09T05:04:25.186764+0000","last_fullsized":"2024-05-09T05:04:25.186764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589253+0000","last_change":"2024-05-09T05:04:23.187287+0000","last_active":"2024-05-09T05:04:25.589253+0000","last_peered":"2024-05-09T05:04:25.589253+0000","last_clean":"2024-05-09T05:04:25.589253+0000","last_became_active":"2024-05-09T05:04:23.187041+0000","last_became_peered":"2024-05-09T05:04:23.187041+0000","last_unstale":"2024-05-09T05:04:25.589253+0000","last_undegraded":"2024-05-09T05:04:25.589253+0000","last_fullsized":"2024-05-09T05:04:25.589253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591503+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.591503+0000","last_peered":"2024-05-09T05:04:25.591503+0000","last_clean":"2024-05-09T05:04:25.591503+0000","last_became_active":"2024-05-09T05:04:24.167271+0000","last_became_peered":"2024-05-09T05:04:24.167271+0000","last_unstale":"2024-05-09T05:04:25.591503+0000","last_undegraded":"2024-05-09T05:04:25.591503+0000","last_fullsized":"2024-05-09T05:04:25.591503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590044+0000","last_change":"2024-05-09T05:04:23.161771+0000","last_active":"2024-05-09T05:04:25.590044+0000","last_peered":"2024-05-09T05:04:25.590044+0000","last_clean":"2024-05-09T05:04:25.590044+0000","last_became_active":"2024-05-09T05:04:23.160931+0000","last_became_peered":"2024-05-09T05:04:23.160931+0000","last_unstale":"2024-05-09T05:04:25.590044+0000","last_undegraded":"2024-05-09T05:04:25.590044+0000","last_fullsized":"2024-05-09T05:04:25.590044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592043+0000","last_change":"2024-05-09T05:04:24.167833+0000","last_active":"2024-05-09T05:04:25.592043+0000","last_peered":"2024-05-09T05:04:25.592043+0000","last_clean":"2024-05-09T05:04:25.592043+0000","last_became_active":"2024-05-09T05:04:24.166426+0000","last_became_peered":"2024-05-09T05:04:24.166426+0000","last_unstale":"2024-05-09T05:04:25.592043+0000","last_undegraded":"2024-05-09T05:04:25.592043+0000","last_fullsized":"2024-05-09T05:04:25.592043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591026+0000","last_change":"2024-05-09T05:04:23.188260+0000","last_active":"2024-05-09T05:04:25.591026+0000","last_peered":"2024-05-09T05:04:25.591026+0000","last_clean":"2024-05-09T05:04:25.591026+0000","last_became_active":"2024-05-09T05:04:23.187636+0000","last_became_peered":"2024-05-09T05:04:23.187636+0000","last_unstale":"2024-05-09T05:04:25.591026+0000","last_undegraded":"2024-05-09T05:04:25.591026+0000","last_fullsized":"2024-05-09T05:04:25.591026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:48.016720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588905+0000","last_change":"2024-05-09T05:04:24.198809+0000","last_active":"2024-05-09T05:04:25.588905+0000","last_peered":"2024-05-09T05:04:25.588905+0000","last_clean":"2024-05-09T05:04:25.588905+0000","last_became_active":"2024-05-09T05:04:24.198483+0000","last_became_peered":"2024-05-09T05:04:24.198483+0000","last_unstale":"2024-05-09T05:04:25.588905+0000","last_undegraded":"2024-05-09T05:04:25.588905+0000","last_fullsized":"2024-05-09T05:04:25.588905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187176+0000","last_change":"2024-05-09T05:04:24.191311+0000","last_active":"2024-05-09T05:04:25.187176+0000","last_peered":"2024-05-09T05:04:25.187176+0000","last_clean":"2024-05-09T05:04:25.187176+0000","last_became_active":"2024-05-09T05:04:24.190802+0000","last_became_peered":"2024-05-09T05:04:24.190802+0000","last_unstale":"2024-05-09T05:04:25.187176+0000","last_undegraded":"2024-05-09T05:04:25.187176+0000","last_fullsized":"2024-05-09T05:04:25.187176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590353+0000","last_change":"2024-05-09T05:04:23.190173+0000","last_active":"2024-05-09T05:04:25.590353+0000","last_peered":"2024-05-09T05:04:25.590353+0000","last_clean":"2024-05-09T05:04:25.590353+0000","last_became_active":"2024-05-09T05:04:23.188510+0000","last_became_peered":"2024-05-09T05:04:23.188510+0000","last_unstale":"2024-05-09T05:04:25.590353+0000","last_undegraded":"2024-05-09T05:04:25.590353+0000","last_fullsized":"2024-05-09T05:04:25.590353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:59.427116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187677+0000","last_change":"2024-05-09T05:04:24.203886+0000","last_active":"2024-05-09T05:04:25.187677+0000","last_peered":"2024-05-09T05:04:25.187677+0000","last_clean":"2024-05-09T05:04:25.187677+0000","last_became_active":"2024-05-09T05:04:24.203038+0000","last_became_peered":"2024-05-09T05:04:24.203038+0000","last_unstale":"2024-05-09T05:04:25.187677+0000","last_undegraded":"2024-05-09T05:04:25.187677+0000","last_fullsized":"2024-05-09T05:04:25.187677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590697+0000","last_change":"2024-05-09T05:04:23.190286+0000","last_active":"2024-05-09T05:04:25.590697+0000","last_peered":"2024-05-09T05:04:25.590697+0000","last_clean":"2024-05-09T05:04:25.590697+0000","last_became_active":"2024-05-09T05:04:23.189891+0000","last_became_peered":"2024-05-09T05:04:23.189891+0000","last_unstale":"2024-05-09T05:04:25.590697+0000","last_undegraded":"2024-05-09T05:04:25.590697+0000","last_fullsized":"2024-05-09T05:04:25.590697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:05.623105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181794+0000","last_change":"2024-05-09T05:04:24.184658+0000","last_active":"2024-05-09T05:04:25.181794+0000","last_peered":"2024-05-09T05:04:25.181794+0000","last_clean":"2024-05-09T05:04:25.181794+0000","last_became_active":"2024-05-09T05:04:24.184274+0000","last_became_peered":"2024-05-09T05:04:24.184274+0000","last_unstale":"2024-05-09T05:04:25.181794+0000","last_undegraded":"2024-05-09T05:04:25.181794+0000","last_fullsized":"2024-05-09T05:04:25.181794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592066+0000","last_change":"2024-05-09T05:04:23.163738+0000","last_active":"2024-05-09T05:04:25.592066+0000","last_peered":"2024-05-09T05:04:25.592066+0000","last_clean":"2024-05-09T05:04:25.592066+0000","last_became_active":"2024-05-09T05:04:23.163417+0000","last_became_peered":"2024-05-09T05:04:23.163417+0000","last_unstale":"2024-05-09T05:04:25.592066+0000","last_undegraded":"2024-05-09T05:04:25.592066+0000","last_fullsized":"2024-05-09T05:04:25.592066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592380+0000","last_change":"2024-05-09T05:04:24.188177+0000","last_active":"2024-05-09T05:04:25.592380+0000","last_peered":"2024-05-09T05:04:25.592380+0000","last_clean":"2024-05-09T05:04:25.592380+0000","last_became_active":"2024-05-09T05:04:24.187292+0000","last_became_peered":"2024-05-09T05:04:24.187292+0000","last_unstale":"2024-05-09T05:04:25.592380+0000","last_undegraded":"2024-05-09T05:04:25.592380+0000","last_fullsized":"2024-05-09T05:04:25.592380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181957+0000","last_change":"2024-05-09T05:04:23.181472+0000","last_active":"2024-05-09T05:04:25.181957+0000","last_peered":"2024-05-09T05:04:25.181957+0000","last_clean":"2024-05-09T05:04:25.181957+0000","last_became_active":"2024-05-09T05:04:23.181154+0000","last_became_peered":"2024-05-09T05:04:23.181154+0000","last_unstale":"2024-05-09T05:04:25.181957+0000","last_undegraded":"2024-05-09T05:04:25.181957+0000","last_fullsized":"2024-05-09T05:04:25.181957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:04:28.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:04:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.827+0000 7faf0ec00640 1 Processor -- start 2024-05-09T05:04:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.827+0000 7faf0ec00640 1 -- start start 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faf080b4530 0x7faf080b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ec00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf080d2120 0x7faf080d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ec00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf080d2f80 con 0x7faf080d3660 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7faf080b6190 con 0x7faf080b4530 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ec00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7faf080d25f0 con 0x7faf080d2120 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faf080d3660 0x7faf080d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40228/0 (socket says 172.21.15.100:40228) 2024-05-09T05:04:28.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0ce00640 1 -- 172.21.15.100:0/1085804706 learned_addr learned my addr 172.21.15.100:0/1085804706 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0d800640 1 --2- 172.21.15.100:0/1085804706 >> v2:172.21.15.100:3300/0 conn(0x7faf080b4530 0x7faf080b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0e200640 1 --2- 172.21.15.100:0/1085804706 >> v2:172.21.15.133:3300/0 conn(0x7faf080d2120 0x7faf080d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf07e00640 1 -- 172.21.15.100:0/1085804706 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657626283 0 0) 0x7faf080d2f80 con 0x7faf080d3660 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf07e00640 1 -- 172.21.15.100:0/1085804706 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faef0003520 con 0x7faf080d3660 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.829+0000 7faf0d800640 1 -- 172.21.15.100:0/1085804706 >> v2:172.21.15.133:3300/0 conn(0x7faf080d2120 msgr2=0x7faf080d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.830+0000 7faf0d800640 1 --2- 172.21.15.100:0/1085804706 >> v2:172.21.15.133:3300/0 conn(0x7faf080d2120 0x7faf080d3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.830+0000 7faf0d800640 1 -- 172.21.15.100:0/1085804706 >> v1:172.21.15.100:6789/0 conn(0x7faf080d3660 legacy=0x7faf080d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.830+0000 7faf0d800640 1 -- 172.21.15.100:0/1085804706 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf080b51e0 con 0x7faf080b4530 2024-05-09T05:04:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.831+0000 7faf0d800640 1 --2- 172.21.15.100:0/1085804706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080b4530 0x7faf080b5c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf08162e50 tx=0x7faefc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2125179592801f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.831+0000 7faf07e00640 1 -- 172.21.15.100:0/1085804706 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc037070 con 0x7faf080b4530 2024-05-09T05:04:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.831+0000 7faf07e00640 1 -- 172.21.15.100:0/1085804706 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc032440 con 0x7faf080b4530 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.831+0000 7faf07e00640 1 -- 172.21.15.100:0/1085804706 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc032810 con 0x7faf080b4530 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 -- 172.21.15.100:0/1085804706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080b4530 msgr2=0x7faf080b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 --2- 172.21.15.100:0/1085804706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080b4530 0x7faf080b5c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf08162e50 tx=0x7faefc02a1a0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 -- 172.21.15.100:0/1085804706 shutdown_connections 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 --2- 172.21.15.100:0/1085804706 >> v2:172.21.15.133:3300/0 conn(0x7faf080d2120 0x7faf080d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 --2- 172.21.15.100:0/1085804706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080b4530 0x7faf080b5c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 -- 172.21.15.100:0/1085804706 >> 172.21.15.100:0/1085804706 conn(0x7faf0808eb30 msgr2=0x7faf0809e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 -- 172.21.15.100:0/1085804706 shutdown_connections 2024-05-09T05:04:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.832+0000 7faf0ec00640 1 -- 172.21.15.100:0/1085804706 wait complete. 2024-05-09T05:04:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.833+0000 7faf0ec00640 1 Processor -- start 2024-05-09T05:04:28.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.834+0000 7faf0ec00640 1 -- start start 2024-05-09T05:04:28.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.834+0000 7faf0ec00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf080b4530 0x7faf080a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.834+0000 7faf0ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080d2120 0x7faf081f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.834+0000 7faf0ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 0x7faf080ba540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faf080d28d0 con 0x7faf080d3660 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faf080b5730 con 0x7faf080d2120 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0ec00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7faf080b4910 con 0x7faf080b4530 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 0x7faf080ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 0x7faf080ba540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49834/0 (socket says 172.21.15.100:49834) 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 -- 172.21.15.100:0/395956045 learned_addr learned my addr 172.21.15.100:0/395956045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0d800640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf080b4530 0x7faf080a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0ce00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080d2120 0x7faf081f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 -- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf080b4530 msgr2=0x7faf080a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf080b4530 0x7faf080a0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 -- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080d2120 msgr2=0x7faf081f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080d2120 0x7faf081f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 -- 172.21.15.100:0/395956045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf080a1610 con 0x7faf080d3660 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0ce00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080d2120 0x7faf081f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.835+0000 7faf0e200640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 0x7faf080ba540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf00007e70 tx=0x7faf0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.836+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00014420 con 0x7faf080d3660 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.836+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf00019070 con 0x7faf080d3660 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.836+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf081f5eb0 con 0x7faf080d3660 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.836+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf00014820 con 0x7faf080d3660 2024-05-09T05:04:28.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.836+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf080a1330 con 0x7faf080d3660 2024-05-09T05:04:28.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.837+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0806a550 con 0x7faf080d3660 2024-05-09T05:04:28.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.838+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faf000149c0 con 0x7faf080d3660 2024-05-09T05:04:28.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.839+0000 7faf05600640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faee80762d0 0x7faee8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:28.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.839+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faf00097f80 con 0x7faf080d3660 2024-05-09T05:04:28.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.839+0000 7faf0d800640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faee80762d0 0x7faee8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:28.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.840+0000 7faf0d800640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faee80762d0 0x7faee8078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faefc034000 tx=0x7faefc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:28.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:28.843+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faf081f5eb0 con 0x7faf080d3660 2024-05-09T05:04:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.046+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf080b4bd0 con 0x7faee80762d0 2024-05-09T05:04:29.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.059+0000 7faf05600640 1 -- 172.21.15.100:0/395956045 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7faf080b4bd0 con 0x7faee80762d0 2024-05-09T05:04:29.063 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:04:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.063+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faee80762d0 msgr2=0x7faee8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.063+0000 7faf0ec00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faee80762d0 0x7faee8078790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faefc034000 tx=0x7faefc02e000 comp rx=0 tx=0).stop 2024-05-09T05:04:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 msgr2=0x7faf080ba540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 0x7faf080ba540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf00007e70 tx=0x7faf0000e4b0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 shutdown_connections 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faee80762d0 0x7faee8078790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf080d3660 0x7faf080ba540 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080d2120 0x7faf081f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 --2- 172.21.15.100:0/395956045 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf080b4530 0x7faf080a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 >> 172.21.15.100:0/395956045 conn(0x7faf0808eb30 msgr2=0x7faf0806d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 shutdown_connections 2024-05-09T05:04:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.064+0000 7faf0ec00640 1 -- 172.21.15.100:0/395956045 wait complete. 2024-05-09T05:04:29.084 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-09T05:04:27.882691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.755932"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591489+0000","last_change":"2024-05-09T05:04:24.203836+0000","last_active":"2024-05-09T05:04:25.591489+0000","last_peered":"2024-05-09T05:04:25.591489+0000","last_clean":"2024-05-09T05:04:25.591489+0000","last_became_active":"2024-05-09T05:04:24.203523+0000","last_became_peered":"2024-05-09T05:04:24.203523+0000","last_unstale":"2024-05-09T05:04:25.591489+0000","last_undegraded":"2024-05-09T05:04:25.591489+0000","last_fullsized":"2024-05-09T05:04:25.591489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:05.764536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589895+0000","last_change":"2024-05-09T05:04:24.173706+0000","last_active":"2024-05-09T05:04:25.589895+0000","last_peered":"2024-05-09T05:04:25.589895+0000","last_clean":"2024-05-09T05:04:25.589895+0000","last_became_active":"2024-05-09T05:04:24.173342+0000","last_became_peered":"2024-05-09T05:04:24.173342+0000","last_unstale":"2024-05-09T05:04:25.589895+0000","last_undegraded":"2024-05-09T05:04:25.589895+0000","last_fullsized":"2024-05-09T05:04:25.589895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181465+0000","last_change":"2024-05-09T05:04:24.189455+0000","last_active":"2024-05-09T05:04:25.181465+0000","last_peered":"2024-05-09T05:04:25.181465+0000","last_clean":"2024-05-09T05:04:25.181465+0000","last_became_active":"2024-05-09T05:04:24.189189+0000","last_became_peered":"2024-05-09T05:04:24.189189+0000","last_unstale":"2024-05-09T05:04:25.181465+0000","last_undegraded":"2024-05-09T05:04:25.181465+0000","last_fullsized":"2024-05-09T05:04:25.181465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187272+0000","last_change":"2024-05-09T05:04:24.178690+0000","last_active":"2024-05-09T05:04:25.187272+0000","last_peered":"2024-05-09T05:04:25.187272+0000","last_clean":"2024-05-09T05:04:25.187272+0000","last_became_active":"2024-05-09T05:04:24.178347+0000","last_became_peered":"2024-05-09T05:04:24.178347+0000","last_unstale":"2024-05-09T05:04:25.187272+0000","last_undegraded":"2024-05-09T05:04:25.187272+0000","last_fullsized":"2024-05-09T05:04:25.187272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590089+0000","last_change":"2024-05-09T05:04:24.191405+0000","last_active":"2024-05-09T05:04:25.590089+0000","last_peered":"2024-05-09T05:04:25.590089+0000","last_clean":"2024-05-09T05:04:25.590089+0000","last_became_active":"2024-05-09T05:04:24.191098+0000","last_became_peered":"2024-05-09T05:04:24.191098+0000","last_unstale":"2024-05-09T05:04:25.590089+0000","last_undegraded":"2024-05-09T05:04:25.590089+0000","last_fullsized":"2024-05-09T05:04:25.590089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186587+0000","last_change":"2024-05-09T05:04:24.179975+0000","last_active":"2024-05-09T05:04:25.186587+0000","last_peered":"2024-05-09T05:04:25.186587+0000","last_clean":"2024-05-09T05:04:25.186587+0000","last_became_active":"2024-05-09T05:04:24.179691+0000","last_became_peered":"2024-05-09T05:04:24.179691+0000","last_unstale":"2024-05-09T05:04:25.186587+0000","last_undegraded":"2024-05-09T05:04:25.186587+0000","last_fullsized":"2024-05-09T05:04:25.186587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589332+0000","last_change":"2024-05-09T05:04:24.203414+0000","last_active":"2024-05-09T05:04:25.589332+0000","last_peered":"2024-05-09T05:04:25.589332+0000","last_clean":"2024-05-09T05:04:25.589332+0000","last_became_active":"2024-05-09T05:04:24.201938+0000","last_became_peered":"2024-05-09T05:04:24.201938+0000","last_unstale":"2024-05-09T05:04:25.589332+0000","last_undegraded":"2024-05-09T05:04:25.589332+0000","last_fullsized":"2024-05-09T05:04:25.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591210+0000","last_change":"2024-05-09T05:04:24.184991+0000","last_active":"2024-05-09T05:04:25.591210+0000","last_peered":"2024-05-09T05:04:25.591210+0000","last_clean":"2024-05-09T05:04:25.591210+0000","last_became_active":"2024-05-09T05:04:24.184661+0000","last_became_peered":"2024-05-09T05:04:24.184661+0000","last_unstale":"2024-05-09T05:04:25.591210+0000","last_undegraded":"2024-05-09T05:04:25.591210+0000","last_fullsized":"2024-05-09T05:04:25.591210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591708+0000","last_change":"2024-05-09T05:04:24.205483+0000","last_active":"2024-05-09T05:04:25.591708+0000","last_peered":"2024-05-09T05:04:25.591708+0000","last_clean":"2024-05-09T05:04:25.591708+0000","last_became_active":"2024-05-09T05:04:24.205172+0000","last_became_peered":"2024-05-09T05:04:24.205172+0000","last_unstale":"2024-05-09T05:04:25.591708+0000","last_undegraded":"2024-05-09T05:04:25.591708+0000","last_fullsized":"2024-05-09T05:04:25.591708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:42.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590912+0000","last_change":"2024-05-09T05:04:24.189101+0000","last_active":"2024-05-09T05:04:25.590912+0000","last_peered":"2024-05-09T05:04:25.590912+0000","last_clean":"2024-05-09T05:04:25.590912+0000","last_became_active":"2024-05-09T05:04:24.188782+0000","last_became_peered":"2024-05-09T05:04:24.188782+0000","last_unstale":"2024-05-09T05:04:25.590912+0000","last_undegraded":"2024-05-09T05:04:25.590912+0000","last_fullsized":"2024-05-09T05:04:25.590912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590328+0000","last_change":"2024-05-09T05:04:24.194232+0000","last_active":"2024-05-09T05:04:25.590328+0000","last_peered":"2024-05-09T05:04:25.590328+0000","last_clean":"2024-05-09T05:04:25.590328+0000","last_became_active":"2024-05-09T05:04:24.193406+0000","last_became_peered":"2024-05-09T05:04:24.193406+0000","last_unstale":"2024-05-09T05:04:25.590328+0000","last_undegraded":"2024-05-09T05:04:25.590328+0000","last_fullsized":"2024-05-09T05:04:25.590328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185677+0000","last_change":"2024-05-09T05:04:24.191071+0000","last_active":"2024-05-09T05:04:25.185677+0000","last_peered":"2024-05-09T05:04:25.185677+0000","last_clean":"2024-05-09T05:04:25.185677+0000","last_became_active":"2024-05-09T05:04:24.190796+0000","last_became_peered":"2024-05-09T05:04:24.190796+0000","last_unstale":"2024-05-09T05:04:25.185677+0000","last_undegraded":"2024-05-09T05:04:25.185677+0000","last_fullsized":"2024-05-09T05:04:25.185677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:51.000950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591619+0000","last_change":"2024-05-09T05:04:24.181185+0000","last_active":"2024-05-09T05:04:25.591619+0000","last_peered":"2024-05-09T05:04:25.591619+0000","last_clean":"2024-05-09T05:04:25.591619+0000","last_became_active":"2024-05-09T05:04:24.180913+0000","last_became_peered":"2024-05-09T05:04:24.180913+0000","last_unstale":"2024-05-09T05:04:25.591619+0000","last_undegraded":"2024-05-09T05:04:25.591619+0000","last_fullsized":"2024-05-09T05:04:25.591619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181113+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.181113+0000","last_peered":"2024-05-09T05:04:25.181113+0000","last_clean":"2024-05-09T05:04:25.181113+0000","last_became_active":"2024-05-09T05:04:24.167267+0000","last_became_peered":"2024-05-09T05:04:24.167267+0000","last_unstale":"2024-05-09T05:04:25.181113+0000","last_undegraded":"2024-05-09T05:04:25.181113+0000","last_fullsized":"2024-05-09T05:04:25.181113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588520+0000","last_change":"2024-05-09T05:04:24.198074+0000","last_active":"2024-05-09T05:04:25.588520+0000","last_peered":"2024-05-09T05:04:25.588520+0000","last_clean":"2024-05-09T05:04:25.588520+0000","last_became_active":"2024-05-09T05:04:24.197831+0000","last_became_peered":"2024-05-09T05:04:24.197831+0000","last_unstale":"2024-05-09T05:04:25.588520+0000","last_undegraded":"2024-05-09T05:04:25.588520+0000","last_fullsized":"2024-05-09T05:04:25.588520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184408+0000","last_change":"2024-05-09T05:04:24.173451+0000","last_active":"2024-05-09T05:04:25.184408+0000","last_peered":"2024-05-09T05:04:25.184408+0000","last_clean":"2024-05-09T05:04:25.184408+0000","last_became_active":"2024-05-09T05:04:24.172936+0000","last_became_peered":"2024-05-09T05:04:24.172936+0000","last_unstale":"2024-05-09T05:04:25.184408+0000","last_undegraded":"2024-05-09T05:04:25.184408+0000","last_fullsized":"2024-05-09T05:04:25.184408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188372+0000","last_change":"2024-05-09T05:04:24.202382+0000","last_active":"2024-05-09T05:04:25.188372+0000","last_peered":"2024-05-09T05:04:25.188372+0000","last_clean":"2024-05-09T05:04:25.188372+0000","last_became_active":"2024-05-09T05:04:24.201887+0000","last_became_peered":"2024-05-09T05:04:24.201887+0000","last_unstale":"2024-05-09T05:04:25.188372+0000","last_undegraded":"2024-05-09T05:04:25.188372+0000","last_fullsized":"2024-05-09T05:04:25.188372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589079+0000","last_change":"2024-05-09T05:04:24.194414+0000","last_active":"2024-05-09T05:04:25.589079+0000","last_peered":"2024-05-09T05:04:25.589079+0000","last_clean":"2024-05-09T05:04:25.589079+0000","last_became_active":"2024-05-09T05:04:24.194106+0000","last_became_peered":"2024-05-09T05:04:24.194106+0000","last_unstale":"2024-05-09T05:04:25.589079+0000","last_undegraded":"2024-05-09T05:04:25.589079+0000","last_fullsized":"2024-05-09T05:04:25.589079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591114+0000","last_change":"2024-05-09T05:04:24.197967+0000","last_active":"2024-05-09T05:04:25.591114+0000","last_peered":"2024-05-09T05:04:25.591114+0000","last_clean":"2024-05-09T05:04:25.591114+0000","last_became_active":"2024-05-09T05:04:24.197672+0000","last_became_peered":"2024-05-09T05:04:24.197672+0000","last_unstale":"2024-05-09T05:04:25.591114+0000","last_undegraded":"2024-05-09T05:04:25.591114+0000","last_fullsized":"2024-05-09T05:04:25.591114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:16.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589820+0000","last_change":"2024-05-09T05:04:24.203278+0000","last_active":"2024-05-09T05:04:25.589820+0000","last_peered":"2024-05-09T05:04:25.589820+0000","last_clean":"2024-05-09T05:04:25.589820+0000","last_became_active":"2024-05-09T05:04:24.202994+0000","last_became_peered":"2024-05-09T05:04:24.202994+0000","last_unstale":"2024-05-09T05:04:25.589820+0000","last_undegraded":"2024-05-09T05:04:25.589820+0000","last_fullsized":"2024-05-09T05:04:25.589820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180771+0000","last_change":"2024-05-09T05:04:24.199162+0000","last_active":"2024-05-09T05:04:25.180771+0000","last_peered":"2024-05-09T05:04:25.180771+0000","last_clean":"2024-05-09T05:04:25.180771+0000","last_became_active":"2024-05-09T05:04:24.198809+0000","last_became_peered":"2024-05-09T05:04:24.198809+0000","last_unstale":"2024-05-09T05:04:25.180771+0000","last_undegraded":"2024-05-09T05:04:25.180771+0000","last_fullsized":"2024-05-09T05:04:25.180771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:06.638505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187003+0000","last_change":"2024-05-09T05:04:24.193592+0000","last_active":"2024-05-09T05:04:25.187003+0000","last_peered":"2024-05-09T05:04:25.187003+0000","last_clean":"2024-05-09T05:04:25.187003+0000","last_became_active":"2024-05-09T05:04:24.190111+0000","last_became_peered":"2024-05-09T05:04:24.190111+0000","last_unstale":"2024-05-09T05:04:25.187003+0000","last_undegraded":"2024-05-09T05:04:25.187003+0000","last_fullsized":"2024-05-09T05:04:25.187003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591263+0000","last_change":"2024-05-09T05:04:24.195840+0000","last_active":"2024-05-09T05:04:25.591263+0000","last_peered":"2024-05-09T05:04:25.591263+0000","last_clean":"2024-05-09T05:04:25.591263+0000","last_became_active":"2024-05-09T05:04:24.195548+0000","last_became_peered":"2024-05-09T05:04:24.195548+0000","last_unstale":"2024-05-09T05:04:25.591263+0000","last_undegraded":"2024-05-09T05:04:25.591263+0000","last_fullsized":"2024-05-09T05:04:25.591263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184835+0000","last_change":"2024-05-09T05:04:24.177654+0000","last_active":"2024-05-09T05:04:25.184835+0000","last_peered":"2024-05-09T05:04:25.184835+0000","last_clean":"2024-05-09T05:04:25.184835+0000","last_became_active":"2024-05-09T05:04:24.177281+0000","last_became_peered":"2024-05-09T05:04:24.177281+0000","last_unstale":"2024-05-09T05:04:25.184835+0000","last_undegraded":"2024-05-09T05:04:25.184835+0000","last_fullsized":"2024-05-09T05:04:25.184835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592160+0000","last_change":"2024-05-09T05:04:24.194016+0000","last_active":"2024-05-09T05:04:25.592160+0000","last_peered":"2024-05-09T05:04:25.592160+0000","last_clean":"2024-05-09T05:04:25.592160+0000","last_became_active":"2024-05-09T05:04:24.193720+0000","last_became_peered":"2024-05-09T05:04:24.193720+0000","last_unstale":"2024-05-09T05:04:25.592160+0000","last_undegraded":"2024-05-09T05:04:25.592160+0000","last_fullsized":"2024-05-09T05:04:25.592160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591104+0000","last_change":"2024-05-09T05:04:24.189812+0000","last_active":"2024-05-09T05:04:25.591104+0000","last_peered":"2024-05-09T05:04:25.591104+0000","last_clean":"2024-05-09T05:04:25.591104+0000","last_became_active":"2024-05-09T05:04:24.189449+0000","last_became_peered":"2024-05-09T05:04:24.189449+0000","last_unstale":"2024-05-09T05:04:25.591104+0000","last_undegraded":"2024-05-09T05:04:25.591104+0000","last_fullsized":"2024-05-09T05:04:25.591104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590046+0000","last_change":"2024-05-09T05:04:24.176362+0000","last_active":"2024-05-09T05:04:25.590046+0000","last_peered":"2024-05-09T05:04:25.590046+0000","last_clean":"2024-05-09T05:04:25.590046+0000","last_became_active":"2024-05-09T05:04:24.176105+0000","last_became_peered":"2024-05-09T05:04:24.176105+0000","last_unstale":"2024-05-09T05:04:25.590046+0000","last_undegraded":"2024-05-09T05:04:25.590046+0000","last_fullsized":"2024-05-09T05:04:25.590046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592264+0000","last_change":"2024-05-09T05:04:24.202970+0000","last_active":"2024-05-09T05:04:25.592264+0000","last_peered":"2024-05-09T05:04:25.592264+0000","last_clean":"2024-05-09T05:04:25.592264+0000","last_became_active":"2024-05-09T05:04:24.202686+0000","last_became_peered":"2024-05-09T05:04:24.202686+0000","last_unstale":"2024-05-09T05:04:25.592264+0000","last_undegraded":"2024-05-09T05:04:25.592264+0000","last_fullsized":"2024-05-09T05:04:25.592264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180896+0000","last_change":"2024-05-09T05:04:24.174802+0000","last_active":"2024-05-09T05:04:25.180896+0000","last_peered":"2024-05-09T05:04:25.180896+0000","last_clean":"2024-05-09T05:04:25.180896+0000","last_became_active":"2024-05-09T05:04:24.174563+0000","last_became_peered":"2024-05-09T05:04:24.174563+0000","last_unstale":"2024-05-09T05:04:25.180896+0000","last_undegraded":"2024-05-09T05:04:25.180896+0000","last_fullsized":"2024-05-09T05:04:25.180896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.877889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187440+0000","last_change":"2024-05-09T05:04:24.177693+0000","last_active":"2024-05-09T05:04:25.187440+0000","last_peered":"2024-05-09T05:04:25.187440+0000","last_clean":"2024-05-09T05:04:25.187440+0000","last_became_active":"2024-05-09T05:04:24.177378+0000","last_became_peered":"2024-05-09T05:04:24.177378+0000","last_unstale":"2024-05-09T05:04:25.187440+0000","last_undegraded":"2024-05-09T05:04:25.187440+0000","last_fullsized":"2024-05-09T05:04:25.187440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588726+0000","last_change":"2024-05-09T05:04:24.187125+0000","last_active":"2024-05-09T05:04:25.588726+0000","last_peered":"2024-05-09T05:04:25.588726+0000","last_clean":"2024-05-09T05:04:25.588726+0000","last_became_active":"2024-05-09T05:04:24.186891+0000","last_became_peered":"2024-05-09T05:04:24.186891+0000","last_unstale":"2024-05-09T05:04:25.588726+0000","last_undegraded":"2024-05-09T05:04:25.588726+0000","last_fullsized":"2024-05-09T05:04:25.588726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588587+0000","last_change":"2024-05-09T05:04:24.181177+0000","last_active":"2024-05-09T05:04:25.588587+0000","last_peered":"2024-05-09T05:04:25.588587+0000","last_clean":"2024-05-09T05:04:25.588587+0000","last_became_active":"2024-05-09T05:04:24.180833+0000","last_became_peered":"2024-05-09T05:04:24.180833+0000","last_unstale":"2024-05-09T05:04:25.588587+0000","last_undegraded":"2024-05-09T05:04:25.588587+0000","last_fullsized":"2024-05-09T05:04:25.588587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185228+0000","last_change":"2024-05-09T05:04:24.193208+0000","last_active":"2024-05-09T05:04:25.185228+0000","last_peered":"2024-05-09T05:04:25.185228+0000","last_clean":"2024-05-09T05:04:25.185228+0000","last_became_active":"2024-05-09T05:04:24.192925+0000","last_became_peered":"2024-05-09T05:04:24.192925+0000","last_unstale":"2024-05-09T05:04:25.185228+0000","last_undegraded":"2024-05-09T05:04:25.185228+0000","last_fullsized":"2024-05-09T05:04:25.185228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:34.632849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592174+0000","last_change":"2024-05-09T05:04:23.180425+0000","last_active":"2024-05-09T05:04:25.592174+0000","last_peered":"2024-05-09T05:04:25.592174+0000","last_clean":"2024-05-09T05:04:25.592174+0000","last_became_active":"2024-05-09T05:04:23.180148+0000","last_became_peered":"2024-05-09T05:04:23.180148+0000","last_unstale":"2024-05-09T05:04:25.592174+0000","last_undegraded":"2024-05-09T05:04:25.592174+0000","last_fullsized":"2024-05-09T05:04:25.592174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180999+0000","last_change":"2024-05-09T05:04:24.195547+0000","last_active":"2024-05-09T05:04:25.180999+0000","last_peered":"2024-05-09T05:04:25.180999+0000","last_clean":"2024-05-09T05:04:25.180999+0000","last_became_active":"2024-05-09T05:04:24.195230+0000","last_became_peered":"2024-05-09T05:04:24.195230+0000","last_unstale":"2024-05-09T05:04:25.180999+0000","last_undegraded":"2024-05-09T05:04:25.180999+0000","last_fullsized":"2024-05-09T05:04:25.180999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588849+0000","last_change":"2024-05-09T05:04:23.181255+0000","last_active":"2024-05-09T05:04:25.588849+0000","last_peered":"2024-05-09T05:04:25.588849+0000","last_clean":"2024-05-09T05:04:25.588849+0000","last_became_active":"2024-05-09T05:04:23.180998+0000","last_became_peered":"2024-05-09T05:04:23.180998+0000","last_unstale":"2024-05-09T05:04:25.588849+0000","last_undegraded":"2024-05-09T05:04:25.588849+0000","last_fullsized":"2024-05-09T05:04:25.588849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591449+0000","last_change":"2024-05-09T05:04:23.180456+0000","last_active":"2024-05-09T05:04:25.591449+0000","last_peered":"2024-05-09T05:04:25.591449+0000","last_clean":"2024-05-09T05:04:25.591449+0000","last_became_active":"2024-05-09T05:04:23.179393+0000","last_became_peered":"2024-05-09T05:04:23.179393+0000","last_unstale":"2024-05-09T05:04:25.591449+0000","last_undegraded":"2024-05-09T05:04:25.591449+0000","last_fullsized":"2024-05-09T05:04:25.591449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591092+0000","last_change":"2024-05-09T05:04:24.168133+0000","last_active":"2024-05-09T05:04:25.591092+0000","last_peered":"2024-05-09T05:04:25.591092+0000","last_clean":"2024-05-09T05:04:25.591092+0000","last_became_active":"2024-05-09T05:04:24.167871+0000","last_became_peered":"2024-05-09T05:04:24.167871+0000","last_unstale":"2024-05-09T05:04:25.591092+0000","last_undegraded":"2024-05-09T05:04:25.591092+0000","last_fullsized":"2024-05-09T05:04:25.591092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185098+0000","last_change":"2024-05-09T05:04:23.185286+0000","last_active":"2024-05-09T05:04:25.185098+0000","last_peered":"2024-05-09T05:04:25.185098+0000","last_clean":"2024-05-09T05:04:25.185098+0000","last_became_active":"2024-05-09T05:04:23.184998+0000","last_became_peered":"2024-05-09T05:04:23.184998+0000","last_unstale":"2024-05-09T05:04:25.185098+0000","last_undegraded":"2024-05-09T05:04:25.185098+0000","last_fullsized":"2024-05-09T05:04:25.185098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588614+0000","last_change":"2024-05-09T05:04:24.175033+0000","last_active":"2024-05-09T05:04:25.588614+0000","last_peered":"2024-05-09T05:04:25.588614+0000","last_clean":"2024-05-09T05:04:25.588614+0000","last_became_active":"2024-05-09T05:04:24.174753+0000","last_became_peered":"2024-05-09T05:04:24.174753+0000","last_unstale":"2024-05-09T05:04:25.588614+0000","last_undegraded":"2024-05-09T05:04:25.588614+0000","last_fullsized":"2024-05-09T05:04:25.588614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591751+0000","last_change":"2024-05-09T05:04:23.182654+0000","last_active":"2024-05-09T05:04:25.591751+0000","last_peered":"2024-05-09T05:04:25.591751+0000","last_clean":"2024-05-09T05:04:25.591751+0000","last_became_active":"2024-05-09T05:04:23.182087+0000","last_became_peered":"2024-05-09T05:04:23.182087+0000","last_unstale":"2024-05-09T05:04:25.591751+0000","last_undegraded":"2024-05-09T05:04:25.591751+0000","last_fullsized":"2024-05-09T05:04:25.591751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187491+0000","last_change":"2024-05-09T05:04:24.194301+0000","last_active":"2024-05-09T05:04:25.187491+0000","last_peered":"2024-05-09T05:04:25.187491+0000","last_clean":"2024-05-09T05:04:25.187491+0000","last_became_active":"2024-05-09T05:04:24.190096+0000","last_became_peered":"2024-05-09T05:04:24.190096+0000","last_unstale":"2024-05-09T05:04:25.187491+0000","last_undegraded":"2024-05-09T05:04:25.187491+0000","last_fullsized":"2024-05-09T05:04:25.187491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187700+0000","last_change":"2024-05-09T05:04:23.186630+0000","last_active":"2024-05-09T05:04:25.187700+0000","last_peered":"2024-05-09T05:04:25.187700+0000","last_clean":"2024-05-09T05:04:25.187700+0000","last_became_active":"2024-05-09T05:04:23.186214+0000","last_became_peered":"2024-05-09T05:04:23.186214+0000","last_unstale":"2024-05-09T05:04:25.187700+0000","last_undegraded":"2024-05-09T05:04:25.187700+0000","last_fullsized":"2024-05-09T05:04:25.187700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181800+0000","last_change":"2024-05-09T05:04:24.184201+0000","last_active":"2024-05-09T05:04:25.181800+0000","last_peered":"2024-05-09T05:04:25.181800+0000","last_clean":"2024-05-09T05:04:25.181800+0000","last_became_active":"2024-05-09T05:04:24.183907+0000","last_became_peered":"2024-05-09T05:04:24.183907+0000","last_unstale":"2024-05-09T05:04:25.181800+0000","last_undegraded":"2024-05-09T05:04:25.181800+0000","last_fullsized":"2024-05-09T05:04:25.181800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590227+0000","last_change":"2024-05-09T05:04:23.174192+0000","last_active":"2024-05-09T05:04:25.590227+0000","last_peered":"2024-05-09T05:04:25.590227+0000","last_clean":"2024-05-09T05:04:25.590227+0000","last_became_active":"2024-05-09T05:04:23.173954+0000","last_became_peered":"2024-05-09T05:04:23.173954+0000","last_unstale":"2024-05-09T05:04:25.590227+0000","last_undegraded":"2024-05-09T05:04:25.590227+0000","last_fullsized":"2024-05-09T05:04:25.590227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187980+0000","last_change":"2024-05-09T05:04:24.199870+0000","last_active":"2024-05-09T05:04:25.187980+0000","last_peered":"2024-05-09T05:04:25.187980+0000","last_clean":"2024-05-09T05:04:25.187980+0000","last_became_active":"2024-05-09T05:04:24.194765+0000","last_became_peered":"2024-05-09T05:04:24.194765+0000","last_unstale":"2024-05-09T05:04:25.187980+0000","last_undegraded":"2024-05-09T05:04:25.187980+0000","last_fullsized":"2024-05-09T05:04:25.187980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:00.442516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589940+0000","last_change":"2024-05-09T05:04:23.178383+0000","last_active":"2024-05-09T05:04:25.589940+0000","last_peered":"2024-05-09T05:04:25.589940+0000","last_clean":"2024-05-09T05:04:25.589940+0000","last_became_active":"2024-05-09T05:04:23.177752+0000","last_became_peered":"2024-05-09T05:04:23.177752+0000","last_unstale":"2024-05-09T05:04:25.589940+0000","last_undegraded":"2024-05-09T05:04:25.589940+0000","last_fullsized":"2024-05-09T05:04:25.589940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590379+0000","last_change":"2024-05-09T05:04:24.198031+0000","last_active":"2024-05-09T05:04:25.590379+0000","last_peered":"2024-05-09T05:04:25.590379+0000","last_clean":"2024-05-09T05:04:25.590379+0000","last_became_active":"2024-05-09T05:04:24.197675+0000","last_became_peered":"2024-05-09T05:04:24.197675+0000","last_unstale":"2024-05-09T05:04:25.590379+0000","last_undegraded":"2024-05-09T05:04:25.590379+0000","last_fullsized":"2024-05-09T05:04:25.590379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181054+0000","last_change":"2024-05-09T05:04:23.172214+0000","last_active":"2024-05-09T05:04:25.181054+0000","last_peered":"2024-05-09T05:04:25.181054+0000","last_clean":"2024-05-09T05:04:25.181054+0000","last_became_active":"2024-05-09T05:04:23.171697+0000","last_became_peered":"2024-05-09T05:04:23.171697+0000","last_unstale":"2024-05-09T05:04:25.181054+0000","last_undegraded":"2024-05-09T05:04:25.181054+0000","last_fullsized":"2024-05-09T05:04:25.181054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181247+0000","last_change":"2024-05-09T05:04:24.200063+0000","last_active":"2024-05-09T05:04:25.181247+0000","last_peered":"2024-05-09T05:04:25.181247+0000","last_clean":"2024-05-09T05:04:25.181247+0000","last_became_active":"2024-05-09T05:04:24.198772+0000","last_became_peered":"2024-05-09T05:04:24.198772+0000","last_unstale":"2024-05-09T05:04:25.181247+0000","last_undegraded":"2024-05-09T05:04:25.181247+0000","last_fullsized":"2024-05-09T05:04:25.181247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187721+0000","last_change":"2024-05-09T05:04:23.175634+0000","last_active":"2024-05-09T05:04:25.187721+0000","last_peered":"2024-05-09T05:04:25.187721+0000","last_clean":"2024-05-09T05:04:25.187721+0000","last_became_active":"2024-05-09T05:04:23.173526+0000","last_became_peered":"2024-05-09T05:04:23.173526+0000","last_unstale":"2024-05-09T05:04:25.187721+0000","last_undegraded":"2024-05-09T05:04:25.187721+0000","last_fullsized":"2024-05-09T05:04:25.187721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590502+0000","last_change":"2024-05-09T05:04:24.205506+0000","last_active":"2024-05-09T05:04:25.590502+0000","last_peered":"2024-05-09T05:04:25.590502+0000","last_clean":"2024-05-09T05:04:25.590502+0000","last_became_active":"2024-05-09T05:04:24.205221+0000","last_became_peered":"2024-05-09T05:04:24.205221+0000","last_unstale":"2024-05-09T05:04:25.590502+0000","last_undegraded":"2024-05-09T05:04:25.590502+0000","last_fullsized":"2024-05-09T05:04:25.590502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588601+0000","last_change":"2024-05-09T05:04:23.183566+0000","last_active":"2024-05-09T05:04:25.588601+0000","last_peered":"2024-05-09T05:04:25.588601+0000","last_clean":"2024-05-09T05:04:25.588601+0000","last_became_active":"2024-05-09T05:04:23.182348+0000","last_became_peered":"2024-05-09T05:04:23.182348+0000","last_unstale":"2024-05-09T05:04:25.588601+0000","last_undegraded":"2024-05-09T05:04:25.588601+0000","last_fullsized":"2024-05-09T05:04:25.588601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588690+0000","last_change":"2024-05-09T05:04:24.185048+0000","last_active":"2024-05-09T05:04:25.588690+0000","last_peered":"2024-05-09T05:04:25.588690+0000","last_clean":"2024-05-09T05:04:25.588690+0000","last_became_active":"2024-05-09T05:04:24.184774+0000","last_became_peered":"2024-05-09T05:04:24.184774+0000","last_unstale":"2024-05-09T05:04:25.588690+0000","last_undegraded":"2024-05-09T05:04:25.588690+0000","last_fullsized":"2024-05-09T05:04:25.588690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588925+0000","last_change":"2024-05-09T05:04:23.166873+0000","last_active":"2024-05-09T05:04:25.588925+0000","last_peered":"2024-05-09T05:04:25.588925+0000","last_clean":"2024-05-09T05:04:25.588925+0000","last_became_active":"2024-05-09T05:04:23.166497+0000","last_became_peered":"2024-05-09T05:04:23.166497+0000","last_unstale":"2024-05-09T05:04:25.588925+0000","last_undegraded":"2024-05-09T05:04:25.588925+0000","last_fullsized":"2024-05-09T05:04:25.588925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589440+0000","last_change":"2024-05-09T05:04:24.206139+0000","last_active":"2024-05-09T05:04:25.589440+0000","last_peered":"2024-05-09T05:04:25.589440+0000","last_clean":"2024-05-09T05:04:25.589440+0000","last_became_active":"2024-05-09T05:04:24.205511+0000","last_became_peered":"2024-05-09T05:04:24.205511+0000","last_unstale":"2024-05-09T05:04:25.589440+0000","last_undegraded":"2024-05-09T05:04:25.589440+0000","last_fullsized":"2024-05-09T05:04:25.589440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186530+0000","last_change":"2024-05-09T05:04:23.171534+0000","last_active":"2024-05-09T05:04:25.186530+0000","last_peered":"2024-05-09T05:04:25.186530+0000","last_clean":"2024-05-09T05:04:25.186530+0000","last_became_active":"2024-05-09T05:04:23.170897+0000","last_became_peered":"2024-05-09T05:04:23.170897+0000","last_unstale":"2024-05-09T05:04:25.186530+0000","last_undegraded":"2024-05-09T05:04:25.186530+0000","last_fullsized":"2024-05-09T05:04:25.186530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591239+0000","last_change":"2024-05-09T05:04:24.205782+0000","last_active":"2024-05-09T05:04:25.591239+0000","last_peered":"2024-05-09T05:04:25.591239+0000","last_clean":"2024-05-09T05:04:25.591239+0000","last_became_active":"2024-05-09T05:04:24.205206+0000","last_became_peered":"2024-05-09T05:04:24.205206+0000","last_unstale":"2024-05-09T05:04:25.591239+0000","last_undegraded":"2024-05-09T05:04:25.591239+0000","last_fullsized":"2024-05-09T05:04:25.591239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:04.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589468+0000","last_change":"2024-05-09T05:04:23.165788+0000","last_active":"2024-05-09T05:04:25.589468+0000","last_peered":"2024-05-09T05:04:25.589468+0000","last_clean":"2024-05-09T05:04:25.589468+0000","last_became_active":"2024-05-09T05:04:23.165479+0000","last_became_peered":"2024-05-09T05:04:23.165479+0000","last_unstale":"2024-05-09T05:04:25.589468+0000","last_undegraded":"2024-05-09T05:04:25.589468+0000","last_fullsized":"2024-05-09T05:04:25.589468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591882+0000","last_change":"2024-05-09T05:04:24.209039+0000","last_active":"2024-05-09T05:04:25.591882+0000","last_peered":"2024-05-09T05:04:25.591882+0000","last_clean":"2024-05-09T05:04:25.591882+0000","last_became_active":"2024-05-09T05:04:24.208701+0000","last_became_peered":"2024-05-09T05:04:24.208701+0000","last_unstale":"2024-05-09T05:04:25.591882+0000","last_undegraded":"2024-05-09T05:04:25.591882+0000","last_fullsized":"2024-05-09T05:04:25.591882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:08.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590358+0000","last_change":"2024-05-09T05:04:23.180485+0000","last_active":"2024-05-09T05:04:25.590358+0000","last_peered":"2024-05-09T05:04:25.590358+0000","last_clean":"2024-05-09T05:04:25.590358+0000","last_became_active":"2024-05-09T05:04:23.179867+0000","last_became_peered":"2024-05-09T05:04:23.179867+0000","last_unstale":"2024-05-09T05:04:25.590358+0000","last_undegraded":"2024-05-09T05:04:25.590358+0000","last_fullsized":"2024-05-09T05:04:25.590358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188120+0000","last_change":"2024-05-09T05:04:24.178327+0000","last_active":"2024-05-09T05:04:25.188120+0000","last_peered":"2024-05-09T05:04:25.188120+0000","last_clean":"2024-05-09T05:04:25.188120+0000","last_became_active":"2024-05-09T05:04:24.178031+0000","last_became_peered":"2024-05-09T05:04:24.178031+0000","last_unstale":"2024-05-09T05:04:25.188120+0000","last_undegraded":"2024-05-09T05:04:25.188120+0000","last_fullsized":"2024-05-09T05:04:25.188120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589001+0000","last_change":"2024-05-09T05:04:23.178749+0000","last_active":"2024-05-09T05:04:25.589001+0000","last_peered":"2024-05-09T05:04:25.589001+0000","last_clean":"2024-05-09T05:04:25.589001+0000","last_became_active":"2024-05-09T05:04:23.178241+0000","last_became_peered":"2024-05-09T05:04:23.178241+0000","last_unstale":"2024-05-09T05:04:25.589001+0000","last_undegraded":"2024-05-09T05:04:25.589001+0000","last_fullsized":"2024-05-09T05:04:25.589001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590329+0000","last_change":"2024-05-09T05:04:24.201431+0000","last_active":"2024-05-09T05:04:25.590329+0000","last_peered":"2024-05-09T05:04:25.590329+0000","last_clean":"2024-05-09T05:04:25.590329+0000","last_became_active":"2024-05-09T05:04:24.201222+0000","last_became_peered":"2024-05-09T05:04:24.201222+0000","last_unstale":"2024-05-09T05:04:25.590329+0000","last_undegraded":"2024-05-09T05:04:25.590329+0000","last_fullsized":"2024-05-09T05:04:25.590329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589083+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:04:25.589083+0000","last_peered":"2024-05-09T05:04:25.589083+0000","last_clean":"2024-05-09T05:04:25.589083+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:04:25.589083+0000","last_undegraded":"2024-05-09T05:04:25.589083+0000","last_fullsized":"2024-05-09T05:04:25.589083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187511+0000","last_change":"2024-05-09T05:04:23.172824+0000","last_active":"2024-05-09T05:04:25.187511+0000","last_peered":"2024-05-09T05:04:25.187511+0000","last_clean":"2024-05-09T05:04:25.187511+0000","last_became_active":"2024-05-09T05:04:23.170516+0000","last_became_peered":"2024-05-09T05:04:23.170516+0000","last_unstale":"2024-05-09T05:04:25.187511+0000","last_undegraded":"2024-05-09T05:04:25.187511+0000","last_fullsized":"2024-05-09T05:04:25.187511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591314+0000","last_change":"2024-05-09T05:04:24.190284+0000","last_active":"2024-05-09T05:04:25.591314+0000","last_peered":"2024-05-09T05:04:25.591314+0000","last_clean":"2024-05-09T05:04:25.591314+0000","last_became_active":"2024-05-09T05:04:24.189965+0000","last_became_peered":"2024-05-09T05:04:24.189965+0000","last_unstale":"2024-05-09T05:04:25.591314+0000","last_undegraded":"2024-05-09T05:04:25.591314+0000","last_fullsized":"2024-05-09T05:04:25.591314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589150+0000","last_change":"2024-05-09T05:04:23.190598+0000","last_active":"2024-05-09T05:04:25.589150+0000","last_peered":"2024-05-09T05:04:25.589150+0000","last_clean":"2024-05-09T05:04:25.589150+0000","last_became_active":"2024-05-09T05:04:23.190004+0000","last_became_peered":"2024-05-09T05:04:23.190004+0000","last_unstale":"2024-05-09T05:04:25.589150+0000","last_undegraded":"2024-05-09T05:04:25.589150+0000","last_fullsized":"2024-05-09T05:04:25.589150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180906+0000","last_change":"2024-05-09T05:04:24.188115+0000","last_active":"2024-05-09T05:04:25.180906+0000","last_peered":"2024-05-09T05:04:25.180906+0000","last_clean":"2024-05-09T05:04:25.180906+0000","last_became_active":"2024-05-09T05:04:24.187747+0000","last_became_peered":"2024-05-09T05:04:24.187747+0000","last_unstale":"2024-05-09T05:04:25.180906+0000","last_undegraded":"2024-05-09T05:04:25.180906+0000","last_fullsized":"2024-05-09T05:04:25.180906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:16.303467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589266+0000","last_change":"2024-05-09T05:04:23.167656+0000","last_active":"2024-05-09T05:04:25.589266+0000","last_peered":"2024-05-09T05:04:25.589266+0000","last_clean":"2024-05-09T05:04:25.589266+0000","last_became_active":"2024-05-09T05:04:23.167341+0000","last_became_peered":"2024-05-09T05:04:23.167341+0000","last_unstale":"2024-05-09T05:04:25.589266+0000","last_undegraded":"2024-05-09T05:04:25.589266+0000","last_fullsized":"2024-05-09T05:04:25.589266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588789+0000","last_change":"2024-05-09T05:04:24.193106+0000","last_active":"2024-05-09T05:04:25.588789+0000","last_peered":"2024-05-09T05:04:25.588789+0000","last_clean":"2024-05-09T05:04:25.588789+0000","last_became_active":"2024-05-09T05:04:24.191023+0000","last_became_peered":"2024-05-09T05:04:24.191023+0000","last_unstale":"2024-05-09T05:04:25.588789+0000","last_undegraded":"2024-05-09T05:04:25.588789+0000","last_fullsized":"2024-05-09T05:04:25.588789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187924+0000","last_change":"2024-05-09T05:04:23.166039+0000","last_active":"2024-05-09T05:04:25.187924+0000","last_peered":"2024-05-09T05:04:25.187924+0000","last_clean":"2024-05-09T05:04:25.187924+0000","last_became_active":"2024-05-09T05:04:23.165410+0000","last_became_peered":"2024-05-09T05:04:23.165410+0000","last_unstale":"2024-05-09T05:04:25.187924+0000","last_undegraded":"2024-05-09T05:04:25.187924+0000","last_fullsized":"2024-05-09T05:04:25.187924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185765+0000","last_change":"2024-05-09T05:04:24.201881+0000","last_active":"2024-05-09T05:04:25.185765+0000","last_peered":"2024-05-09T05:04:25.185765+0000","last_clean":"2024-05-09T05:04:25.185765+0000","last_became_active":"2024-05-09T05:04:24.197108+0000","last_became_peered":"2024-05-09T05:04:24.197108+0000","last_unstale":"2024-05-09T05:04:25.185765+0000","last_undegraded":"2024-05-09T05:04:25.185765+0000","last_fullsized":"2024-05-09T05:04:25.185765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589619+0000","last_change":"2024-05-09T05:04:23.167664+0000","last_active":"2024-05-09T05:04:25.589619+0000","last_peered":"2024-05-09T05:04:25.589619+0000","last_clean":"2024-05-09T05:04:25.589619+0000","last_became_active":"2024-05-09T05:04:23.167332+0000","last_became_peered":"2024-05-09T05:04:23.167332+0000","last_unstale":"2024-05-09T05:04:25.589619+0000","last_undegraded":"2024-05-09T05:04:25.589619+0000","last_fullsized":"2024-05-09T05:04:25.589619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188219+0000","last_change":"2024-05-09T05:04:24.176401+0000","last_active":"2024-05-09T05:04:25.188219+0000","last_peered":"2024-05-09T05:04:25.188219+0000","last_clean":"2024-05-09T05:04:25.188219+0000","last_became_active":"2024-05-09T05:04:24.176054+0000","last_became_peered":"2024-05-09T05:04:24.176054+0000","last_unstale":"2024-05-09T05:04:25.188219+0000","last_undegraded":"2024-05-09T05:04:25.188219+0000","last_fullsized":"2024-05-09T05:04:25.188219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591454+0000","last_change":"2024-05-09T05:04:23.190670+0000","last_active":"2024-05-09T05:04:25.591454+0000","last_peered":"2024-05-09T05:04:25.591454+0000","last_clean":"2024-05-09T05:04:25.591454+0000","last_became_active":"2024-05-09T05:04:23.190356+0000","last_became_peered":"2024-05-09T05:04:23.190356+0000","last_unstale":"2024-05-09T05:04:25.591454+0000","last_undegraded":"2024-05-09T05:04:25.591454+0000","last_fullsized":"2024-05-09T05:04:25.591454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:15.288068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589390+0000","last_change":"2024-05-09T05:04:24.190440+0000","last_active":"2024-05-09T05:04:25.589390+0000","last_peered":"2024-05-09T05:04:25.589390+0000","last_clean":"2024-05-09T05:04:25.589390+0000","last_became_active":"2024-05-09T05:04:24.190123+0000","last_became_peered":"2024-05-09T05:04:24.190123+0000","last_unstale":"2024-05-09T05:04:25.589390+0000","last_undegraded":"2024-05-09T05:04:25.589390+0000","last_fullsized":"2024-05-09T05:04:25.589390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:26.165909+0000","last_change":"2024-05-09T05:04:23.180222+0000","last_active":"2024-05-09T05:04:26.165909+0000","last_peered":"2024-05-09T05:04:26.165909+0000","last_clean":"2024-05-09T05:04:26.165909+0000","last_became_active":"2024-05-09T05:04:23.179880+0000","last_became_peered":"2024-05-09T05:04:23.179880+0000","last_unstale":"2024-05-09T05:04:26.165909+0000","last_undegraded":"2024-05-09T05:04:26.165909+0000","last_fullsized":"2024-05-09T05:04:26.165909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592374+0000","last_change":"2024-05-09T05:04:24.200883+0000","last_active":"2024-05-09T05:04:25.592374+0000","last_peered":"2024-05-09T05:04:25.592374+0000","last_clean":"2024-05-09T05:04:25.592374+0000","last_became_active":"2024-05-09T05:04:24.200559+0000","last_became_peered":"2024-05-09T05:04:24.200559+0000","last_unstale":"2024-05-09T05:04:25.592374+0000","last_undegraded":"2024-05-09T05:04:25.592374+0000","last_fullsized":"2024-05-09T05:04:25.592374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591990+0000","last_change":"2024-05-09T05:04:23.187164+0000","last_active":"2024-05-09T05:04:25.591990+0000","last_peered":"2024-05-09T05:04:25.591990+0000","last_clean":"2024-05-09T05:04:25.591990+0000","last_became_active":"2024-05-09T05:04:23.186835+0000","last_became_peered":"2024-05-09T05:04:23.186835+0000","last_unstale":"2024-05-09T05:04:25.591990+0000","last_undegraded":"2024-05-09T05:04:25.591990+0000","last_fullsized":"2024-05-09T05:04:25.591990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181677+0000","last_change":"2024-05-09T05:04:24.169643+0000","last_active":"2024-05-09T05:04:25.181677+0000","last_peered":"2024-05-09T05:04:25.181677+0000","last_clean":"2024-05-09T05:04:25.181677+0000","last_became_active":"2024-05-09T05:04:24.169348+0000","last_became_peered":"2024-05-09T05:04:24.169348+0000","last_unstale":"2024-05-09T05:04:25.181677+0000","last_undegraded":"2024-05-09T05:04:25.181677+0000","last_fullsized":"2024-05-09T05:04:25.181677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588730+0000","last_change":"2024-05-09T05:04:23.190850+0000","last_active":"2024-05-09T05:04:25.588730+0000","last_peered":"2024-05-09T05:04:25.588730+0000","last_clean":"2024-05-09T05:04:25.588730+0000","last_became_active":"2024-05-09T05:04:23.190358+0000","last_became_peered":"2024-05-09T05:04:23.190358+0000","last_unstale":"2024-05-09T05:04:25.588730+0000","last_undegraded":"2024-05-09T05:04:25.588730+0000","last_fullsized":"2024-05-09T05:04:25.588730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186764+0000","last_change":"2024-05-09T05:04:24.186871+0000","last_active":"2024-05-09T05:04:25.186764+0000","last_peered":"2024-05-09T05:04:25.186764+0000","last_clean":"2024-05-09T05:04:25.186764+0000","last_became_active":"2024-05-09T05:04:24.186416+0000","last_became_peered":"2024-05-09T05:04:24.186416+0000","last_unstale":"2024-05-09T05:04:25.186764+0000","last_undegraded":"2024-05-09T05:04:25.186764+0000","last_fullsized":"2024-05-09T05:04:25.186764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589253+0000","last_change":"2024-05-09T05:04:23.187287+0000","last_active":"2024-05-09T05:04:25.589253+0000","last_peered":"2024-05-09T05:04:25.589253+0000","last_clean":"2024-05-09T05:04:25.589253+0000","last_became_active":"2024-05-09T05:04:23.187041+0000","last_became_peered":"2024-05-09T05:04:23.187041+0000","last_unstale":"2024-05-09T05:04:25.589253+0000","last_undegraded":"2024-05-09T05:04:25.589253+0000","last_fullsized":"2024-05-09T05:04:25.589253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591503+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.591503+0000","last_peered":"2024-05-09T05:04:25.591503+0000","last_clean":"2024-05-09T05:04:25.591503+0000","last_became_active":"2024-05-09T05:04:24.167271+0000","last_became_peered":"2024-05-09T05:04:24.167271+0000","last_unstale":"2024-05-09T05:04:25.591503+0000","last_undegraded":"2024-05-09T05:04:25.591503+0000","last_fullsized":"2024-05-09T05:04:25.591503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590044+0000","last_change":"2024-05-09T05:04:23.161771+0000","last_active":"2024-05-09T05:04:25.590044+0000","last_peered":"2024-05-09T05:04:25.590044+0000","last_clean":"2024-05-09T05:04:25.590044+0000","last_became_active":"2024-05-09T05:04:23.160931+0000","last_became_peered":"2024-05-09T05:04:23.160931+0000","last_unstale":"2024-05-09T05:04:25.590044+0000","last_undegraded":"2024-05-09T05:04:25.590044+0000","last_fullsized":"2024-05-09T05:04:25.590044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592043+0000","last_change":"2024-05-09T05:04:24.167833+0000","last_active":"2024-05-09T05:04:25.592043+0000","last_peered":"2024-05-09T05:04:25.592043+0000","last_clean":"2024-05-09T05:04:25.592043+0000","last_became_active":"2024-05-09T05:04:24.166426+0000","last_became_peered":"2024-05-09T05:04:24.166426+0000","last_unstale":"2024-05-09T05:04:25.592043+0000","last_undegraded":"2024-05-09T05:04:25.592043+0000","last_fullsized":"2024-05-09T05:04:25.592043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591026+0000","last_change":"2024-05-09T05:04:23.188260+0000","last_active":"2024-05-09T05:04:25.591026+0000","last_peered":"2024-05-09T05:04:25.591026+0000","last_clean":"2024-05-09T05:04:25.591026+0000","last_became_active":"2024-05-09T05:04:23.187636+0000","last_became_peered":"2024-05-09T05:04:23.187636+0000","last_unstale":"2024-05-09T05:04:25.591026+0000","last_undegraded":"2024-05-09T05:04:25.591026+0000","last_fullsized":"2024-05-09T05:04:25.591026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:48.016720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588905+0000","last_change":"2024-05-09T05:04:24.198809+0000","last_active":"2024-05-09T05:04:25.588905+0000","last_peered":"2024-05-09T05:04:25.588905+0000","last_clean":"2024-05-09T05:04:25.588905+0000","last_became_active":"2024-05-09T05:04:24.198483+0000","last_became_peered":"2024-05-09T05:04:24.198483+0000","last_unstale":"2024-05-09T05:04:25.588905+0000","last_undegraded":"2024-05-09T05:04:25.588905+0000","last_fullsized":"2024-05-09T05:04:25.588905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187176+0000","last_change":"2024-05-09T05:04:24.191311+0000","last_active":"2024-05-09T05:04:25.187176+0000","last_peered":"2024-05-09T05:04:25.187176+0000","last_clean":"2024-05-09T05:04:25.187176+0000","last_became_active":"2024-05-09T05:04:24.190802+0000","last_became_peered":"2024-05-09T05:04:24.190802+0000","last_unstale":"2024-05-09T05:04:25.187176+0000","last_undegraded":"2024-05-09T05:04:25.187176+0000","last_fullsized":"2024-05-09T05:04:25.187176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590353+0000","last_change":"2024-05-09T05:04:23.190173+0000","last_active":"2024-05-09T05:04:25.590353+0000","last_peered":"2024-05-09T05:04:25.590353+0000","last_clean":"2024-05-09T05:04:25.590353+0000","last_became_active":"2024-05-09T05:04:23.188510+0000","last_became_peered":"2024-05-09T05:04:23.188510+0000","last_unstale":"2024-05-09T05:04:25.590353+0000","last_undegraded":"2024-05-09T05:04:25.590353+0000","last_fullsized":"2024-05-09T05:04:25.590353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:59.427116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187677+0000","last_change":"2024-05-09T05:04:24.203886+0000","last_active":"2024-05-09T05:04:25.187677+0000","last_peered":"2024-05-09T05:04:25.187677+0000","last_clean":"2024-05-09T05:04:25.187677+0000","last_became_active":"2024-05-09T05:04:24.203038+0000","last_became_peered":"2024-05-09T05:04:24.203038+0000","last_unstale":"2024-05-09T05:04:25.187677+0000","last_undegraded":"2024-05-09T05:04:25.187677+0000","last_fullsized":"2024-05-09T05:04:25.187677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590697+0000","last_change":"2024-05-09T05:04:23.190286+0000","last_active":"2024-05-09T05:04:25.590697+0000","last_peered":"2024-05-09T05:04:25.590697+0000","last_clean":"2024-05-09T05:04:25.590697+0000","last_became_active":"2024-05-09T05:04:23.189891+0000","last_became_peered":"2024-05-09T05:04:23.189891+0000","last_unstale":"2024-05-09T05:04:25.590697+0000","last_undegraded":"2024-05-09T05:04:25.590697+0000","last_fullsized":"2024-05-09T05:04:25.590697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:05.623105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181794+0000","last_change":"2024-05-09T05:04:24.184658+0000","last_active":"2024-05-09T05:04:25.181794+0000","last_peered":"2024-05-09T05:04:25.181794+0000","last_clean":"2024-05-09T05:04:25.181794+0000","last_became_active":"2024-05-09T05:04:24.184274+0000","last_became_peered":"2024-05-09T05:04:24.184274+0000","last_unstale":"2024-05-09T05:04:25.181794+0000","last_undegraded":"2024-05-09T05:04:25.181794+0000","last_fullsized":"2024-05-09T05:04:25.181794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592066+0000","last_change":"2024-05-09T05:04:23.163738+0000","last_active":"2024-05-09T05:04:25.592066+0000","last_peered":"2024-05-09T05:04:25.592066+0000","last_clean":"2024-05-09T05:04:25.592066+0000","last_became_active":"2024-05-09T05:04:23.163417+0000","last_became_peered":"2024-05-09T05:04:23.163417+0000","last_unstale":"2024-05-09T05:04:25.592066+0000","last_undegraded":"2024-05-09T05:04:25.592066+0000","last_fullsized":"2024-05-09T05:04:25.592066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592380+0000","last_change":"2024-05-09T05:04:24.188177+0000","last_active":"2024-05-09T05:04:25.592380+0000","last_peered":"2024-05-09T05:04:25.592380+0000","last_clean":"2024-05-09T05:04:25.592380+0000","last_became_active":"2024-05-09T05:04:24.187292+0000","last_became_peered":"2024-05-09T05:04:24.187292+0000","last_unstale":"2024-05-09T05:04:25.592380+0000","last_undegraded":"2024-05-09T05:04:25.592380+0000","last_fullsized":"2024-05-09T05:04:25.592380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181957+0000","last_change":"2024-05-09T05:04:23.181472+0000","last_active":"2024-05-09T05:04:25.181957+0000","last_peered":"2024-05-09T05:04:25.181957+0000","last_clean":"2024-05-09T05:04:25.181957+0000","last_became_active":"2024-05-09T05:04:23.181154+0000","last_became_peered":"2024-05-09T05:04:23.181154+0000","last_unstale":"2024-05-09T05:04:25.181957+0000","last_undegraded":"2024-05-09T05:04:25.181957+0000","last_fullsized":"2024-05-09T05:04:25.181957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:04:29.088 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:04:29.088 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T05:04:29.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-09T05:04:29.089 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-09T05:04:29.089 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-09T05:04:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.328+0000 7f578ee00640 1 Processor -- start 2024-05-09T05:04:29.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.329+0000 7f578ee00640 1 -- start start 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f578ee00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57880d4e40 0x7f57880d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f578ee00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f57880d27b0 0x7f57880b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f578ee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57880d3da0 con 0x7f578815f420 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f578ee00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f57880d4080 con 0x7f57880d27b0 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f578ee00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f57880d4360 con 0x7f57880d4e40 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f5787e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f578815f420 0x7f57880d33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40238/0 (socket says 172.21.15.100:40238) 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.330+0000 7f5787e00640 1 -- 172.21.15.100:0/2296642399 learned_addr learned my addr 172.21.15.100:0/2296642399 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:29.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f578ce00640 1 --2- 172.21.15.100:0/2296642399 >> v2:172.21.15.100:3300/0 conn(0x7f57880d27b0 0x7f57880b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f5787400640 1 --2- 172.21.15.100:0/2296642399 >> v2:172.21.15.133:3300/0 conn(0x7f57880d4e40 0x7f57880d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f5786a00640 1 -- 172.21.15.100:0/2296642399 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767305169 0 0) 0x7f57880d3da0 con 0x7f578815f420 2024-05-09T05:04:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f5786a00640 1 -- 172.21.15.100:0/2296642399 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f576c003520 con 0x7f578815f420 2024-05-09T05:04:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f578ce00640 1 -- 172.21.15.100:0/2296642399 >> v2:172.21.15.133:3300/0 conn(0x7f57880d4e40 msgr2=0x7f57880d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f578ce00640 1 --2- 172.21.15.100:0/2296642399 >> v2:172.21.15.133:3300/0 conn(0x7f57880d4e40 0x7f57880d2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f578ce00640 1 -- 172.21.15.100:0/2296642399 >> v1:172.21.15.100:6789/0 conn(0x7f578815f420 legacy=0x7f57880d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f578ce00640 1 -- 172.21.15.100:0/2296642399 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57880d4640 con 0x7f57880d27b0 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.331+0000 7f5787400640 1 --2- 172.21.15.100:0/2296642399 >> v2:172.21.15.133:3300/0 conn(0x7f57880d4e40 0x7f57880d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.332+0000 7f578ce00640 1 --2- 172.21.15.100:0/2296642399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f57880b8440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57880d1a40 tx=0x7f578002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be001fc4fc53725 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.333+0000 7f5786a00640 1 -- 172.21.15.100:0/2296642399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780037070 con 0x7f57880d27b0 2024-05-09T05:04:29.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.333+0000 7f5786a00640 1 -- 172.21.15.100:0/2296642399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5780032440 con 0x7f57880d27b0 2024-05-09T05:04:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.333+0000 7f5786a00640 1 -- 172.21.15.100:0/2296642399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578002ae60 con 0x7f57880d27b0 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.333+0000 7f578ee00640 1 -- 172.21.15.100:0/2296642399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 msgr2=0x7f57880b8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.333+0000 7f578ee00640 1 --2- 172.21.15.100:0/2296642399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f57880b8440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57880d1a40 tx=0x7f578002a110 comp rx=0 tx=0).stop 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.334+0000 7f578ee00640 1 -- 172.21.15.100:0/2296642399 shutdown_connections 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.334+0000 7f578ee00640 1 --2- 172.21.15.100:0/2296642399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f57880b8440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.334+0000 7f578ee00640 1 --2- 172.21.15.100:0/2296642399 >> v2:172.21.15.133:3300/0 conn(0x7f57880d4e40 0x7f57880d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.334+0000 7f578ee00640 1 -- 172.21.15.100:0/2296642399 >> 172.21.15.100:0/2296642399 conn(0x7f5788073f20 msgr2=0x7f5788074330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.334+0000 7f578ee00640 1 -- 172.21.15.100:0/2296642399 shutdown_connections 2024-05-09T05:04:29.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.334+0000 7f578ee00640 1 -- 172.21.15.100:0/2296642399 wait complete. 2024-05-09T05:04:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.335+0000 7f578ee00640 1 Processor -- start 2024-05-09T05:04:29.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.336+0000 7f578ee00640 1 -- start start 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f578815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ee00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57880d4e40 0x7f5788160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ee00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578815f420 0x7f5788161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f578815f800 con 0x7f57880d27b0 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ee00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f57880d3ac0 con 0x7f578815f420 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ee00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f57880cfb00 con 0x7f57880d4e40 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f578815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f578815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49848/0 (socket says 172.21.15.100:49848) 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 -- 172.21.15.100:0/3283694119 learned_addr learned my addr 172.21.15.100:0/3283694119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787400640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57880d4e40 0x7f5788160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 -- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57880d4e40 msgr2=0x7f5788160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57880d4e40 0x7f5788160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f578ce00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578815f420 0x7f5788161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 -- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578815f420 msgr2=0x7f5788161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578815f420 0x7f5788161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.337+0000 7f5787e00640 1 -- 172.21.15.100:0/3283694119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57880cd550 con 0x7f57880d27b0 2024-05-09T05:04:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.338+0000 7f5787e00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f578815ca60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f577800cbc0 tx=0x7f577800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.338+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577800ad40 con 0x7f57880d27b0 2024-05-09T05:04:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.338+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5778012400 con 0x7f57880d27b0 2024-05-09T05:04:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.338+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57780127b0 con 0x7f57880d27b0 2024-05-09T05:04:29.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.338+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57880cd830 con 0x7f57880d27b0 2024-05-09T05:04:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.338+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57880d03c0 con 0x7f57880d27b0 2024-05-09T05:04:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.339+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578806a5c0 con 0x7f57880d27b0 2024-05-09T05:04:29.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.341+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5778012950 con 0x7f57880d27b0 2024-05-09T05:04:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.342+0000 7f577fe00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f57680762d0 0x7f5768078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.342+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5778097d10 con 0x7f57880d27b0 2024-05-09T05:04:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.342+0000 7f5787400640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f57680762d0 0x7f5768078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.343+0000 7f5787400640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f57680762d0 0x7f5768078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5774006fd0 tx=0x7f5774008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:29.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.347+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f577809d020 con 0x7f57880d27b0 2024-05-09T05:04:29.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.605+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f57880ba860 con 0x7f57880d27b0 2024-05-09T05:04:29.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.609+0000 7f577fe00640 1 -- 172.21.15.100:0/3283694119 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189528 (secure 0 0 0) 0x7f57780615d0 con 0x7f57880d27b0 2024-05-09T05:04:29.612 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:29.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f57680762d0 msgr2=0x7f5768078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f57680762d0 0x7f5768078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5774006fd0 tx=0x7f5774008040 comp rx=0 tx=0).stop 2024-05-09T05:04:29.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 msgr2=0x7f578815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f578815ca60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f577800cbc0 tx=0x7f577800a430 comp rx=0 tx=0).stop 2024-05-09T05:04:29.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 shutdown_connections 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f57680762d0 0x7f5768078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f578815f420 0x7f5788161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57880d4e40 0x7f5788160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 --2- 172.21.15.100:0/3283694119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57880d27b0 0x7f578815ca60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.613+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 >> 172.21.15.100:0/3283694119 conn(0x7f5788073f20 msgr2=0x7f57880c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.614+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 shutdown_connections 2024-05-09T05:04:29.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.614+0000 7f578ee00640 1 -- 172.21.15.100:0/3283694119 wait complete. 2024-05-09T05:04:29.632 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1219178136},{"type":"v1","addr":"172.21.15.100:6833","nonce":1219178136}]},"active_addr":"172.21.15.100:6833/1219178136","active_change":"2024-05-09T05:04:03.857697+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3872004040}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3397596740}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1688881806}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1306008003}]}]} 2024-05-09T05:04:29.636 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-09T05:04:29.636 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-09T05:04:29.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:29.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.830+0000 7feee5800640 1 Processor -- start 2024-05-09T05:04:29.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.830+0000 7feee5800640 1 -- start start 2024-05-09T05:04:29.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feee5800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feee01562f0 0x7feee00af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feee5800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feee00cdc20 0x7feee00ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feee5800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee01566d0 con 0x7feee0162e30 2024-05-09T05:04:29.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feee5800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7feee00ce5d0 con 0x7feee00cdc20 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feee5800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7feee00ceee0 con 0x7feee01562f0 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feed7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feee00cdc20 0x7feee00ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feed7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feee00cdc20 0x7feee00ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49860/0 (socket says 172.21.15.100:49860) 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.832+0000 7feed7400640 1 -- 172.21.15.100:0/248227021 learned_addr learned my addr 172.21.15.100:0/248227021 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feed7400640 1 -- 172.21.15.100:0/248227021 >> v2:172.21.15.133:3300/0 conn(0x7feee01562f0 msgr2=0x7feee00af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feedfe00640 1 --2- 172.21.15.100:0/248227021 >> v2:172.21.15.133:3300/0 conn(0x7feee01562f0 0x7feee00af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feed7400640 1 --2- 172.21.15.100:0/248227021 >> v2:172.21.15.133:3300/0 conn(0x7feee01562f0 0x7feee00af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feed7400640 1 -- 172.21.15.100:0/248227021 >> v1:172.21.15.100:6789/0 conn(0x7feee0162e30 legacy=0x7feee01632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feedf400640 1 -- 172.21.15.100:0/248227021 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627923888 0 0) 0x7feee01566d0 con 0x7feee0162e30 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feed7400640 1 -- 172.21.15.100:0/248227021 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee00cf130 con 0x7feee00cdc20 2024-05-09T05:04:29.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.833+0000 7feedfe00640 1 --2- 172.21.15.100:0/248227021 >> v2:172.21.15.133:3300/0 conn(0x7feee01562f0 0x7feee00af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:29.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.834+0000 7feed7400640 1 --2- 172.21.15.100:0/248227021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee00cdc20 0x7feee00ce090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feee00cf060 tx=0x7feec802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b475fd588ac24b61 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.834+0000 7feedf400640 1 -- 172.21.15.100:0/248227021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8037070 con 0x7feee00cdc20 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.834+0000 7feedf400640 1 -- 172.21.15.100:0/248227021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec8032440 con 0x7feee00cdc20 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.834+0000 7feedf400640 1 -- 172.21.15.100:0/248227021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8032810 con 0x7feee00cdc20 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 -- 172.21.15.100:0/248227021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee00cdc20 msgr2=0x7feee00ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 --2- 172.21.15.100:0/248227021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee00cdc20 0x7feee00ce090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feee00cf060 tx=0x7feec802a270 comp rx=0 tx=0).stop 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 -- 172.21.15.100:0/248227021 shutdown_connections 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 --2- 172.21.15.100:0/248227021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee00cdc20 0x7feee00ce090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 --2- 172.21.15.100:0/248227021 >> v2:172.21.15.133:3300/0 conn(0x7feee01562f0 0x7feee00af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 -- 172.21.15.100:0/248227021 >> 172.21.15.100:0/248227021 conn(0x7feee006c7f0 msgr2=0x7feee006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 -- 172.21.15.100:0/248227021 shutdown_connections 2024-05-09T05:04:29.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.835+0000 7feee5800640 1 -- 172.21.15.100:0/248227021 wait complete. 2024-05-09T05:04:29.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.837+0000 7feee5800640 1 Processor -- start 2024-05-09T05:04:29.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.837+0000 7feee5800640 1 -- start start 2024-05-09T05:04:29.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee5800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feee00cdc20 0x7feee015e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee5800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feee01562f0 0x7feee014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 0x7feee015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee5800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feee00cf6f0 con 0x7feee0162e30 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee5800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7feee00cfd40 con 0x7feee00cdc20 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee5800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7feee00cf9d0 con 0x7feee01562f0 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 0x7feee015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 0x7feee015a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49862/0 (socket says 172.21.15.100:49862) 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 -- 172.21.15.100:0/2914884978 learned_addr learned my addr 172.21.15.100:0/2914884978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feed7400640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feee01562f0 0x7feee014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feedfe00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feee00cdc20 0x7feee015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 -- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feee01562f0 msgr2=0x7feee014ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feee01562f0 0x7feee014ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 -- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feee00cdc20 msgr2=0x7feee015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:29.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feee00cdc20 0x7feee015e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feee4e00640 1 -- 172.21.15.100:0/2914884978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01504f0 con 0x7feee0162e30 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.838+0000 7feed7400640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feee01562f0 0x7feee014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.839+0000 7feee4e00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 0x7feee015a760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feed800c730 tx=0x7feed800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.839+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8003b70 con 0x7feee0162e30 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.839+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8003d10 con 0x7feee0162e30 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.839+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee015ea00 con 0x7feee0162e30 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.839+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8005290 con 0x7feee0162e30 2024-05-09T05:04:29.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.839+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee00b0b90 con 0x7feee0162e30 2024-05-09T05:04:29.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.840+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee00b1360 con 0x7feee0162e30 2024-05-09T05:04:29.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.841+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feed8005430 con 0x7feee0162e30 2024-05-09T05:04:29.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.842+0000 7feedcc00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feebc0762d0 0x7feebc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:29.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.842+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feed8097440 con 0x7feee0162e30 2024-05-09T05:04:29.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.842+0000 7feedfe00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feebc0762d0 0x7feebc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:29.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.843+0000 7feedfe00640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feebc0762d0 0x7feebc078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feed0008850 tx=0x7feed0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:29.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:29.847+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feed8005720 con 0x7feee0162e30 2024-05-09T05:04:30.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.050+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee006a550 con 0x7feee0162e30 2024-05-09T05:04:30.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.054+0000 7feedcc00640 1 -- 172.21.15.100:0/2914884978 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7feed8060d90 con 0x7feee0162e30 2024-05-09T05:04:30.054 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:30.055 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feebc0762d0 msgr2=0x7feebc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feebc0762d0 0x7feebc078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feed0008850 tx=0x7feed0008040 comp rx=0 tx=0).stop 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 msgr2=0x7feee015a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 0x7feee015a760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feed800c730 tx=0x7feed800cb30 comp rx=0 tx=0).stop 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 shutdown_connections 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feebc0762d0 0x7feebc078790 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0162e30 0x7feee015a760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feee01562f0 0x7feee014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 --2- 172.21.15.100:0/2914884978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feee00cdc20 0x7feee015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 >> 172.21.15.100:0/2914884978 conn(0x7feee006c7f0 msgr2=0x7feee006f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.056+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 shutdown_connections 2024-05-09T05:04:30.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.057+0000 7feee5800640 1 -- 172.21.15.100:0/2914884978 wait complete. 2024-05-09T05:04:30.076 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-09T05:04:30.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:30.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.274+0000 7f0662400640 1 Processor -- start 2024-05-09T05:04:30.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.274+0000 7f0662400640 1 -- start start 2024-05-09T05:04:30.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.275+0000 7f0662400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f065c145900 0x7f065c073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.275+0000 7f0662400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f065c0739a0 0x7f065c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f0662400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f065c06ead0 con 0x7f065c0b43f0 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f0662400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f065c06f390 con 0x7f065c145900 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f0662400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f065c070830 con 0x7f065c0739a0 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f065c145900 0x7f065c073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f065c145900 0x7f065c073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49876/0 (socket says 172.21.15.100:49876) 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 -- 172.21.15.100:0/2229695119 learned_addr learned my addr 172.21.15.100:0/2229695119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 -- 172.21.15.100:0/2229695119 >> v2:172.21.15.133:3300/0 conn(0x7f065c0739a0 msgr2=0x7f065c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 --2- 172.21.15.100:0/2229695119 >> v2:172.21.15.133:3300/0 conn(0x7f065c0739a0 0x7f065c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 -- 172.21.15.100:0/2229695119 >> v1:172.21.15.133:6789/0 conn(0x7f065c0b43f0 legacy=0x7f065c163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.276+0000 7f065b400640 1 -- 172.21.15.100:0/2229695119 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c06ed40 con 0x7f065c145900 2024-05-09T05:04:30.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.277+0000 7f065b400640 1 --2- 172.21.15.100:0/2229695119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c145900 0x7f065c073460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f065c162fe0 tx=0x7f064c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccd67126f20af3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f065a000640 1 -- 172.21.15.100:0/2229695119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c037070 con 0x7f065c145900 2024-05-09T05:04:30.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f065a000640 1 -- 172.21.15.100:0/2229695119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064c032440 con 0x7f065c145900 2024-05-09T05:04:30.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f065a000640 1 -- 172.21.15.100:0/2229695119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c032810 con 0x7f065c145900 2024-05-09T05:04:30.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f0662400640 1 -- 172.21.15.100:0/2229695119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c145900 msgr2=0x7f065c073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f0662400640 1 --2- 172.21.15.100:0/2229695119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c145900 0x7f065c073460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f065c162fe0 tx=0x7f064c02a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f0662400640 1 -- 172.21.15.100:0/2229695119 shutdown_connections 2024-05-09T05:04:30.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f0662400640 1 --2- 172.21.15.100:0/2229695119 >> v2:172.21.15.133:3300/0 conn(0x7f065c0739a0 0x7f065c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f0662400640 1 --2- 172.21.15.100:0/2229695119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c145900 0x7f065c073460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.278+0000 7f0662400640 1 -- 172.21.15.100:0/2229695119 >> 172.21.15.100:0/2229695119 conn(0x7f065c0b31e0 msgr2=0x7f065c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.279+0000 7f0662400640 1 -- 172.21.15.100:0/2229695119 shutdown_connections 2024-05-09T05:04:30.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.279+0000 7f0662400640 1 -- 172.21.15.100:0/2229695119 wait complete. 2024-05-09T05:04:30.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.280+0000 7f0662400640 1 Processor -- start 2024-05-09T05:04:30.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.281+0000 7f0662400640 1 -- start start 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f0662400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0739a0 0x7f065c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f0662400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 0x7f065c1409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f0662400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065c145900 0x7f065c09e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f0662400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f065c0ade90 con 0x7f065c0b43f0 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f0662400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f065c073e70 con 0x7f065c0739a0 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f0662400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f065c145ce0 con 0x7f065c145900 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 0x7f065c1409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 0x7f065c1409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49880/0 (socket says 172.21.15.100:49880) 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 -- 172.21.15.100:0/499579286 learned_addr learned my addr 172.21.15.100:0/499579286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065b400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0739a0 0x7f065c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065be00640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065c145900 0x7f065c09e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 -- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065c145900 msgr2=0x7f065c09e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065c145900 0x7f065c09e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 -- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0739a0 msgr2=0x7f065c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0739a0 0x7f065c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.282+0000 7f065aa00640 1 -- 172.21.15.100:0/499579286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c0cba30 con 0x7f065c0b43f0 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.283+0000 7f065aa00640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 0x7f065c1409b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f064800b450 tx=0x7f064800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.283+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648015020 con 0x7f065c0b43f0 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.283+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0648011890 con 0x7f065c0b43f0 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.283+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c0ca830 con 0x7f065c0b43f0 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.283+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648011c80 con 0x7f065c0b43f0 2024-05-09T05:04:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.283+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c0cadf0 con 0x7f065c0b43f0 2024-05-09T05:04:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.285+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c076070 con 0x7f065c0b43f0 2024-05-09T05:04:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.285+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0648018020 con 0x7f065c0b43f0 2024-05-09T05:04:30.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.286+0000 7f0653400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f063c076320 0x7f063c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.286+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06480975c0 con 0x7f065c0b43f0 2024-05-09T05:04:30.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.287+0000 7f065b400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f063c076320 0x7f063c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.287+0000 7f065b400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f063c076320 0x7f063c0787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f064c034000 tx=0x7f064c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.291+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f064801f020 con 0x7f065c0b43f0 2024-05-09T05:04:30.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.499+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f065c144e70 con 0x7f065c0b43f0 2024-05-09T05:04:30.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.501+0000 7f0653400640 1 -- 172.21.15.100:0/499579286 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f064800d040 con 0x7f065c0b43f0 2024-05-09T05:04:30.502 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:30.502 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:30.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f063c076320 msgr2=0x7f063c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f063c076320 0x7f063c0787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f064c034000 tx=0x7f064c02e000 comp rx=0 tx=0).stop 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 msgr2=0x7f065c1409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 0x7f065c1409b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f064800b450 tx=0x7f064800b910 comp rx=0 tx=0).stop 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 shutdown_connections 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f063c076320 0x7f063c0787e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f065c145900 0x7f065c09e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f065c0b43f0 0x7f065c1409b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 --2- 172.21.15.100:0/499579286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0739a0 0x7f065c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 >> 172.21.15.100:0/499579286 conn(0x7f065c0b31e0 msgr2=0x7f065c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 shutdown_connections 2024-05-09T05:04:30.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.504+0000 7f0662400640 1 -- 172.21.15.100:0/499579286 wait complete. 2024-05-09T05:04:30.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-09T05:04:30.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-09T05:04:30.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-09T05:04:30.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-09T05:04:30.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-09T05:04:30.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-09T05:04:30.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-09T05:04:30.526 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-09T05:04:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.807+0000 7f424d800640 1 Processor -- start 2024-05-09T05:04:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.808+0000 7f424d800640 1 -- start start 2024-05-09T05:04:30.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.810+0000 7f424d800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4248162a20 0x7f42480b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.810+0000 7f424d800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f42480d07b0 0x7f42480d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.810+0000 7f424d800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480b4c20 con 0x7f42480d17c0 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.810+0000 7f424d800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f42480b49d0 con 0x7f42480d07b0 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.810+0000 7f424d800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f42480b4f00 con 0x7f4248162a20 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f42480d07b0 0x7f42480d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f42480d07b0 0x7f42480d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49882/0 (socket says 172.21.15.100:49882) 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 -- 172.21.15.100:0/54687236 learned_addr learned my addr 172.21.15.100:0/54687236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246a00640 1 --2- 172.21.15.100:0/54687236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4248162a20 0x7f42480b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 -- 172.21.15.100:0/54687236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4248162a20 msgr2=0x7f42480b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 --2- 172.21.15.100:0/54687236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4248162a20 0x7f42480b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 -- 172.21.15.100:0/54687236 >> v1:172.21.15.133:6789/0 conn(0x7f42480d17c0 legacy=0x7f42480b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.811+0000 7f4246000640 1 -- 172.21.15.100:0/54687236 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42480b51e0 con 0x7f42480d07b0 2024-05-09T05:04:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f4246000640 1 --2- 172.21.15.100:0/54687236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42480d07b0 0x7f42480d0c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4234009870 tx=0x7f423402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0d5503ac5ec262 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f9e93000640 1 Processor -- start 2024-05-09T05:04:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f4245600640 1 -- 172.21.15.100:0/54687236 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234037070 con 0x7f42480d07b0 2024-05-09T05:04:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f4245600640 1 -- 172.21.15.100:0/54687236 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4234032440 con 0x7f42480d07b0 2024-05-09T05:04:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f4245600640 1 -- 172.21.15.100:0/54687236 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340327f0 con 0x7f42480d07b0 2024-05-09T05:04:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f9532400640 1 Processor -- start 2024-05-09T05:04:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.815+0000 7f424d800640 1 -- 172.21.15.100:0/54687236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42480d07b0 msgr2=0x7f42480d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.815+0000 7f424d800640 1 --2- 172.21.15.100:0/54687236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42480d07b0 0x7f42480d0c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4234009870 tx=0x7f423402a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.815+0000 7f7b28600640 1 Processor -- start 2024-05-09T05:04:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.815+0000 7f7b28600640 1 -- start start 2024-05-09T05:04:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.813+0000 7f9e93000640 1 -- start start 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e93000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e84054890 0x7f9e84054cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e93000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e8403c350 0x7f9e8403c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e93000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e840e7e20 con 0x7f9e840e7a40 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e93000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8403b590 con 0x7f9e8403c350 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e93000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8403b870 con 0x7f9e84054890 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.814+0000 7f9532400640 1 -- start start 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9532400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f952403e830 0x7f9524053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9532400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9524058560 con 0x7f95240e30b0 2024-05-09T05:04:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9532400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9524058840 con 0x7f9524054120 2024-05-09T05:04:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9532400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9524058b20 con 0x7f952403e830 2024-05-09T05:04:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e8be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9e840e7a40 0x7f9e84049b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40280/0 (socket says 172.21.15.100:40280) 2024-05-09T05:04:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.816+0000 7f9e8be00640 1 -- 172.21.15.100:0/1878229148 learned_addr learned my addr 172.21.15.100:0/1878229148 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f9e8b400640 1 --2- 172.21.15.100:0/1878229148 >> v2:172.21.15.133:3300/0 conn(0x7f9e84054890 0x7f9e84054cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f7b28600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b2015f570 0x7f7b200d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f7b28600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b200d08c0 0x7f7b200d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f7b28600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b200d2f40 con 0x7f7b200b4120 2024-05-09T05:04:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f7b28600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7b200d3220 con 0x7f7b2015f570 2024-05-09T05:04:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f7b28600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f7b200d00c0 con 0x7f7b200d08c0 2024-05-09T05:04:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f9e91000640 1 --2- 172.21.15.100:0/1878229148 >> v2:172.21.15.100:3300/0 conn(0x7f9e8403c350 0x7f9e8403c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f952b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f95240e30b0 0x7f9524057d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40270/0 (socket says 172.21.15.100:40270) 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f952b400640 1 -- 172.21.15.100:0/3637971296 learned_addr learned my addr 172.21.15.100:0/3637971296 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.817+0000 7f952aa00640 1 --2- 172.21.15.100:0/3637971296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f952403e830 0x7f9524053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f424d800640 1 -- 172.21.15.100:0/54687236 shutdown_connections 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f424d800640 1 --2- 172.21.15.100:0/54687236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42480d07b0 0x7f42480d0c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f424d800640 1 --2- 172.21.15.100:0/54687236 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4248162a20 0x7f42480b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f424d800640 1 -- 172.21.15.100:0/54687236 >> 172.21.15.100:0/54687236 conn(0x7f42480d5090 msgr2=0x7f42480d54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f9e8b400640 1 -- 172.21.15.100:0/1878229148 >> v2:172.21.15.100:3300/0 conn(0x7f9e8403c350 msgr2=0x7f9e8403c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f9e8b400640 1 --2- 172.21.15.100:0/1878229148 >> v2:172.21.15.100:3300/0 conn(0x7f9e8403c350 0x7f9e8403c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f9e8b400640 1 -- 172.21.15.100:0/1878229148 >> v1:172.21.15.100:6789/0 conn(0x7f9e840e7a40 legacy=0x7f9e84049b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f9e8b400640 1 -- 172.21.15.100:0/1878229148 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8403bb50 con 0x7f9e84054890 2024-05-09T05:04:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f7b25c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b2015f570 0x7f7b200d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f9e91000640 1 --2- 172.21.15.100:0/1878229148 >> v2:172.21.15.100:3300/0 conn(0x7f9e8403c350 0x7f9e8403c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f424d800640 1 -- 172.21.15.100:0/54687236 shutdown_connections 2024-05-09T05:04:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f424d800640 1 -- 172.21.15.100:0/54687236 wait complete. 2024-05-09T05:04:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f952aa00640 1 -- 172.21.15.100:0/3637971296 >> v1:172.21.15.133:6789/0 conn(0x7f9524054120 legacy=0x7f95240068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f7b26600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b200d08c0 0x7f7b200d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f7b26600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b200d08c0 0x7f7b200d0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54586/0 (socket says 172.21.15.100:54586) 2024-05-09T05:04:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f7b26600640 1 -- 172.21.15.100:0/2245186541 learned_addr learned my addr 172.21.15.100:0/2245186541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f7b25c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b2015f570 0x7f7b200d5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49888/0 (socket says 172.21.15.100:49888) 2024-05-09T05:04:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f952aa00640 1 -- 172.21.15.100:0/3637971296 >> v1:172.21.15.100:6789/0 conn(0x7f95240e30b0 legacy=0x7f9524057d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.818+0000 7f952aa00640 1 -- 172.21.15.100:0/3637971296 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240063a0 con 0x7f952403e830 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.819+0000 7f7b25c00640 1 -- 172.21.15.100:0/2245186541 >> v2:172.21.15.133:3300/0 conn(0x7f7b200d08c0 msgr2=0x7f7b200d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.819+0000 7f7b25c00640 1 --2- 172.21.15.100:0/2245186541 >> v2:172.21.15.133:3300/0 conn(0x7f7b200d08c0 0x7f7b200d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.819+0000 7f7b25c00640 1 -- 172.21.15.100:0/2245186541 >> v1:172.21.15.133:6789/0 conn(0x7f7b200b4120 legacy=0x7f7b200b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.819+0000 7f7b25c00640 1 -- 172.21.15.100:0/2245186541 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b200d03a0 con 0x7f7b2015f570 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.819+0000 7f7b1fe00640 1 -- 172.21.15.100:0/2245186541 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115988278 0 0) 0x7f7b200d2f40 con 0x7f7b200b4120 2024-05-09T05:04:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.819+0000 7f9e8b400640 1 --2- 172.21.15.100:0/1878229148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84054890 0x7f9e84054cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e840eb4c0 tx=0x7f9e7802a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3226a527c5afec4e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.820+0000 7f9034200640 1 Processor -- start 2024-05-09T05:04:30.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.820+0000 7f9e8aa00640 1 -- 172.21.15.100:0/1878229148 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78037070 con 0x7f9e84054890 2024-05-09T05:04:30.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.820+0000 7f9e8aa00640 1 -- 172.21.15.100:0/1878229148 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7802ad40 con 0x7f9e84054890 2024-05-09T05:04:30.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.820+0000 7f9e8aa00640 1 -- 172.21.15.100:0/1878229148 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78032660 con 0x7f9e84054890 2024-05-09T05:04:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.820+0000 7f424d800640 1 Processor -- start 2024-05-09T05:04:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.820+0000 7f9034200640 1 -- start start 2024-05-09T05:04:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.821+0000 7f952aa00640 1 --2- 172.21.15.100:0/3637971296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f952403e830 0x7f9524053be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95180097d0 tx=0x7f951802a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0d4e879708c883 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.821+0000 7f952a000640 1 -- 172.21.15.100:0/3637971296 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518037070 con 0x7f952403e830 2024-05-09T05:04:30.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.821+0000 7f952a000640 1 -- 172.21.15.100:0/3637971296 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518032440 con 0x7f952403e830 2024-05-09T05:04:30.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.821+0000 7f424d800640 1 -- start start 2024-05-09T05:04:30.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.821+0000 7f7b25c00640 1 --2- 172.21.15.100:0/2245186541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b2015f570 0x7f7b200d5c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b2008d030 tx=0x7f7b1402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e582c67e4387c07 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f7b1fe00640 1 -- 172.21.15.100:0/2245186541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14037070 con 0x7f7b2015f570 2024-05-09T05:04:30.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f424d800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42480d07b0 0x7f42480babb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f424d800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42480d17c0 0x7f42480cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f424d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4248162a20 0x7f42481f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f424d800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4248162e00 con 0x7f4248162a20 2024-05-09T05:04:30.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f424d800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f42480b57a0 con 0x7f42480d07b0 2024-05-09T05:04:30.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f7b1fe00640 1 -- 172.21.15.100:0/2245186541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b14032440 con 0x7f7b2015f570 2024-05-09T05:04:30.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f7b1fe00640 1 -- 172.21.15.100:0/2245186541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402ae60 con 0x7f7b2015f570 2024-05-09T05:04:30.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f424d800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f42480d1c50 con 0x7f42480d17c0 2024-05-09T05:04:30.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f4247400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4248162a20 0x7f42481f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f6441600640 1 Processor -- start 2024-05-09T05:04:30.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f6441600640 1 -- start start 2024-05-09T05:04:30.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f4247400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4248162a20 0x7f42481f92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49900/0 (socket says 172.21.15.100:49900) 2024-05-09T05:04:30.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f4247400640 1 -- 172.21.15.100:0/1621063754 learned_addr learned my addr 172.21.15.100:0/1621063754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f9532400640 1 -- 172.21.15.100:0/3637971296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f952403e830 msgr2=0x7f9524053be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f952a000640 1 -- 172.21.15.100:0/3637971296 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518032810 con 0x7f952403e830 2024-05-09T05:04:30.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f9532400640 1 --2- 172.21.15.100:0/3637971296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f952403e830 0x7f9524053be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95180097d0 tx=0x7f951802a1f0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4246a00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42480d07b0 0x7f42480babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4246000640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42480d17c0 0x7f42480cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f7b28600640 1 -- 172.21.15.100:0/2245186541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b2015f570 msgr2=0x7f7b200d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f7b28600640 1 --2- 172.21.15.100:0/2245186541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b2015f570 0x7f7b200d5c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b2008d030 tx=0x7f7b1402a110 comp rx=0 tx=0).stop 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4247400640 1 -- 172.21.15.100:0/1621063754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42480d17c0 msgr2=0x7f42480cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4247400640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42480d17c0 0x7f42480cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4247400640 1 -- 172.21.15.100:0/1621063754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42480d07b0 msgr2=0x7f42480babb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4247400640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42480d07b0 0x7f42480babb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f4247400640 1 -- 172.21.15.100:0/1621063754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42481fa470 con 0x7f4248162a20 2024-05-09T05:04:30.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f9034200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f902c0b5990 0x7f902c164b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f9034200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c0cff00 0x7f902c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f9034200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902c0b5e40 con 0x7f902c163c10 2024-05-09T05:04:30.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f9034200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f902c165050 con 0x7f902c0b5990 2024-05-09T05:04:30.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.823+0000 7f9034200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f902c0b6120 con 0x7f902c0cff00 2024-05-09T05:04:30.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f9e93000640 1 -- 172.21.15.100:0/1878229148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84054890 msgr2=0x7f9e84054cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.822+0000 7f9e93000640 1 --2- 172.21.15.100:0/1878229148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84054890 0x7f9e84054cd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e840eb4c0 tx=0x7f9e7802a0b0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f7b28600640 1 -- 172.21.15.100:0/2245186541 shutdown_connections 2024-05-09T05:04:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9e93000640 1 -- 172.21.15.100:0/1878229148 shutdown_connections 2024-05-09T05:04:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9e93000640 1 --2- 172.21.15.100:0/1878229148 >> v2:172.21.15.100:3300/0 conn(0x7f9e8403c350 0x7f9e8403c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9e93000640 1 --2- 172.21.15.100:0/1878229148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84054890 0x7f9e84054cd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9e93000640 1 -- 172.21.15.100:0/1878229148 >> 172.21.15.100:0/1878229148 conn(0x7f9e84056cc0 msgr2=0x7f9e840570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f7b28600640 1 --2- 172.21.15.100:0/2245186541 >> v2:172.21.15.133:3300/0 conn(0x7f7b200d08c0 0x7f7b200d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f7b28600640 1 --2- 172.21.15.100:0/2245186541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b2015f570 0x7f7b200d5c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f7b28600640 1 -- 172.21.15.100:0/2245186541 >> 172.21.15.100:0/2245186541 conn(0x7f7b200d5160 msgr2=0x7f7b200d5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9e93000640 1 -- 172.21.15.100:0/1878229148 shutdown_connections 2024-05-09T05:04:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9e93000640 1 -- 172.21.15.100:0/1878229148 wait complete. 2024-05-09T05:04:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9031800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f902c163c10 0x7f902c0b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40284/0 (socket says 172.21.15.100:40284) 2024-05-09T05:04:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f9031800640 1 -- 172.21.15.100:0/2410263771 learned_addr learned my addr 172.21.15.100:0/2410263771 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f4247400640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4248162a20 0x7f42481f92b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f424000c780 tx=0x7f424000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f6441600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f643c0d1da0 0x7f643c0d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f6441600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 0x7f643c0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f6441600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643c0b6ac0 con 0x7f643c0d0e10 2024-05-09T05:04:30.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f6441600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f643c0c8ac0 con 0x7f643c0d1da0 2024-05-09T05:04:30.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.824+0000 7f6441600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f643c0d2a50 con 0x7f643c0d5cc0 2024-05-09T05:04:30.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9532400640 1 -- 172.21.15.100:0/3637971296 shutdown_connections 2024-05-09T05:04:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240004b60 con 0x7f4248162a20 2024-05-09T05:04:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240004d00 con 0x7f4248162a20 2024-05-09T05:04:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424000aa90 con 0x7f4248162a20 2024-05-09T05:04:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f424d800640 1 -- 172.21.15.100:0/1621063754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42481f9b70 con 0x7f4248162a20 2024-05-09T05:04:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9532400640 1 --2- 172.21.15.100:0/3637971296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f952403e830 0x7f9524053be0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9532400640 1 -- 172.21.15.100:0/3637971296 >> 172.21.15.100:0/3637971296 conn(0x7f95240559d0 msgr2=0x7f9524055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9032200640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c0cff00 0x7f902c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91450992 0 0) 0x7f902c0b5e40 con 0x7f902c163c10 2024-05-09T05:04:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9030e00640 1 --2- 172.21.15.100:0/2410263771 >> v2:172.21.15.133:3300/0 conn(0x7f902c0b5990 0x7f902c164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9014003520 con 0x7f902c163c10 2024-05-09T05:04:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f7b28600640 1 -- 172.21.15.100:0/2245186541 shutdown_connections 2024-05-09T05:04:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9532400640 1 -- 172.21.15.100:0/3637971296 shutdown_connections 2024-05-09T05:04:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f9532400640 1 -- 172.21.15.100:0/3637971296 wait complete. 2024-05-09T05:04:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2247546503 0 0) 0x7f9014003520 con 0x7f902c163c10 2024-05-09T05:04:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f424d800640 1 -- 172.21.15.100:0/1621063754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42481fa130 con 0x7f4248162a20 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f7b28600640 1 -- 172.21.15.100:0/2245186541 wait complete. 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f643b400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 0x7f643c0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f643b400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 0x7f643c0c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46116/0 (socket says 172.21.15.100:46116) 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.825+0000 7f643b400640 1 -- 172.21.15.100:0/70643918 learned_addr learned my addr 172.21.15.100:0/70643918 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f643b400640 1 -- 172.21.15.100:0/70643918 >> v2:172.21.15.133:3300/0 conn(0x7f643c0d1da0 msgr2=0x7f643c0d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f643b400640 1 --2- 172.21.15.100:0/70643918 >> v2:172.21.15.133:3300/0 conn(0x7f643c0d1da0 0x7f643c0d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f643b400640 1 -- 172.21.15.100:0/70643918 >> v1:172.21.15.133:6789/0 conn(0x7f643c0d0e10 legacy=0x7f643c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f643b400640 1 -- 172.21.15.100:0/70643918 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c0b67e0 con 0x7f643c0d5cc0 2024-05-09T05:04:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c0cff00 msgr2=0x7f902c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c0cff00 0x7f902c0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 >> v2:172.21.15.133:3300/0 conn(0x7f902c0b5990 msgr2=0x7f902c164b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 --2- 172.21.15.100:0/2410263771 >> v2:172.21.15.133:3300/0 conn(0x7f902c0b5990 0x7f902c164b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.827+0000 7f1b1ae00640 1 Processor -- start 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c164310 con 0x7f902c163c10 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f90200016f0 con 0x7f902c163c10 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 >> v1:172.21.15.100:6789/0 conn(0x7f902c163c10 legacy=0x7f902c0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014003a00 0x7f9014003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9014004800 0x7f9014004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90140051c0 0x7f901400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.827+0000 7f9e93000640 1 Processor -- start 2024-05-09T05:04:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f902c165050 con 0x7f9014004800 2024-05-09T05:04:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0b6120 con 0x7f90140051c0 2024-05-09T05:04:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.826+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f901400c030 con 0x7f9014003a00 2024-05-09T05:04:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.827+0000 7f9030e00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9014004800 0x7f9014004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f9032200640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90140051c0 0x7f901400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f1b1ae00640 1 -- start start 2024-05-09T05:04:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f9031800640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014003a00 0x7f9014003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f643b400640 1 --2- 172.21.15.100:0/70643918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 0x7f643c0c81f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f642c009e50 tx=0x7f642c02a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66e8c634dcf4e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f9030e00640 1 -- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014003a00 msgr2=0x7f9014003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f421c001030 con 0x7f4248162a20 2024-05-09T05:04:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f9e93000640 1 -- start start 2024-05-09T05:04:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.828+0000 7f9030e00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9014003a00 0x7f9014003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f9030e00640 1 -- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90140051c0 msgr2=0x7f901400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f643aa00640 1 -- 172.21.15.100:0/70643918 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c036070 con 0x7f643c0d5cc0 2024-05-09T05:04:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f9030e00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90140051c0 0x7f901400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f9030e00640 1 -- 172.21.15.100:0/2410263771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c164310 con 0x7f9014004800 2024-05-09T05:04:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f643aa00640 1 -- 172.21.15.100:0/70643918 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642c031600 con 0x7f643c0d5cc0 2024-05-09T05:04:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f7b28600640 1 Processor -- start 2024-05-09T05:04:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f7b28600640 1 -- start start 2024-05-09T05:04:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.829+0000 7f9532400640 1 Processor -- start 2024-05-09T05:04:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.830+0000 7f643aa00640 1 -- 172.21.15.100:0/70643918 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c036070 con 0x7f643c0d5cc0 2024-05-09T05:04:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.830+0000 7f1b1ae00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b140b5990 0x7f1b14164b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.830+0000 7f1b1ae00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b140cff00 0x7f1b140d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.830+0000 7f9532400640 1 -- start start 2024-05-09T05:04:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.830+0000 7fd7b3000640 1 Processor -- start 2024-05-09T05:04:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f6441600640 1 -- 172.21.15.100:0/70643918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 msgr2=0x7f643c0c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.830+0000 7f9030e00640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9014004800 0x7f9014004c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9018009a70 tx=0x7f9014005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145e07ba812301f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f9e93000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8403c350 0x7f9e840dc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f6441600640 1 --2- 172.21.15.100:0/70643918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 0x7f643c0c81f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f642c009e50 tx=0x7f642c02a610 comp rx=0 tx=0).stop 2024-05-09T05:04:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b18e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b140cff00 0x7f1b140d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b13e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1b14163c10 0x7f1b140b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:54916/0 (socket says 172.21.15.100:54916) 2024-05-09T05:04:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b13e00640 1 -- 172.21.15.100:0/2929415632 learned_addr learned my addr 172.21.15.100:0/2929415632 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f9e93000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e84054890 0x7f9e84050670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b140b5e40 con 0x7f1b14163c10 2024-05-09T05:04:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1b14165050 con 0x7f1b140cff00 2024-05-09T05:04:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f6441600640 1 -- 172.21.15.100:0/70643918 shutdown_connections 2024-05-09T05:04:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f6441600640 1 --2- 172.21.15.100:0/70643918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d5cc0 0x7f643c0c81f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f6441600640 1 --2- 172.21.15.100:0/70643918 >> v2:172.21.15.133:3300/0 conn(0x7f643c0d1da0 0x7f643c0d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f6441600640 1 -- 172.21.15.100:0/70643918 >> 172.21.15.100:0/70643918 conn(0x7f643c0d51a0 msgr2=0x7f643c0d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7fd7b3000640 1 -- start start 2024-05-09T05:04:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1b140b6120 con 0x7f1b140b5990 2024-05-09T05:04:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f1b13400640 1 --2- 172.21.15.100:0/2929415632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b140b5990 0x7f1b14164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f9e93000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e840e7a40 0x7f9e8404e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f424000ac30 con 0x7f4248162a20 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f9e8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8403c350 0x7f9e840dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8403c350 0x7f9e840dc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54632/0 (socket says 172.21.15.100:54632) 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e8be00640 1 -- 172.21.15.100:0/4288548071 learned_addr learned my addr 172.21.15.100:0/4288548071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e8b400640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e84054890 0x7f9e84050670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e91000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e840e7a40 0x7f9e8404e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8404a260 con 0x7f9e840e7a40 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8404a5a0 con 0x7f9e8403c350 2024-05-09T05:04:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9e84039ca0 con 0x7f9e84054890 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f7b28600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b200b4120 0x7f7b20160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b28600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b200d08c0 0x7f7b20162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b28600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b2015f570 0x7f7b200b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b28600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2015f950 con 0x7f7b200d08c0 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b28600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7b200cfd70 con 0x7f7b2015f570 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b28600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f7b200b2430 con 0x7f7b200b4120 2024-05-09T05:04:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b25c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b200b4120 0x7f7b20160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.831+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018036070 con 0x7f9014004800 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9018031400 con 0x7f9014004800 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f902be00640 1 -- 172.21.15.100:0/2410263771 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018009670 con 0x7f9014004800 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f1b12a00640 1 -- 172.21.15.100:0/2929415632 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186783663 0 0) 0x7f1b140b5e40 con 0x7f1b14163c10 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f1b12a00640 1 -- 172.21.15.100:0/2929415632 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1af8003520 con 0x7f1b14163c10 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f1b13400640 1 -- 172.21.15.100:0/2929415632 >> v2:172.21.15.100:3300/0 conn(0x7f1b140cff00 msgr2=0x7f1b140d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f1b13400640 1 --2- 172.21.15.100:0/2929415632 >> v2:172.21.15.100:3300/0 conn(0x7f1b140cff00 0x7f1b140d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f1b13400640 1 -- 172.21.15.100:0/2929415632 >> v1:172.21.15.133:6789/0 conn(0x7f1b14163c10 legacy=0x7f1b140b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b25c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b200b4120 0x7f7b20160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46152/0 (socket says 172.21.15.100:46152) 2024-05-09T05:04:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f7b25c00640 1 -- 172.21.15.100:0/2409009949 learned_addr learned my addr 172.21.15.100:0/2409009949 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9034200640 1 -- 172.21.15.100:0/2410263771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9014004800 msgr2=0x7f9014004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9034200640 1 --2- 172.21.15.100:0/2410263771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9014004800 0x7f9014004c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9018009a70 tx=0x7f9014005830 comp rx=0 tx=0).stop 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f9032200640 1 -- 172.21.15.100:0/2410263771 reap_dead start 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f7b25200640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b200d08c0 0x7f7b20162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e91000640 1 -- 172.21.15.100:0/4288548071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e84054890 msgr2=0x7f9e84050670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e91000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e84054890 0x7f9e84050670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f9e91000640 1 -- 172.21.15.100:0/4288548071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8403c350 msgr2=0x7f9e840dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f9e91000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8403c350 0x7f9e840dc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7b3000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac164b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f9e91000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e840dcfb0 con 0x7f9e840e7a40 2024-05-09T05:04:30.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.832+0000 7f1b13400640 1 -- 172.21.15.100:0/2929415632 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b14164310 con 0x7f1b140b5990 2024-05-09T05:04:30.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f9034200640 1 -- 172.21.15.100:0/2410263771 shutdown_connections 2024-05-09T05:04:30.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f9034200640 1 -- 172.21.15.100:0/2410263771 >> 172.21.15.100:0/2410263771 conn(0x7f902c0b2c90 msgr2=0x7f902c0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b26600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b2015f570 0x7f7b200b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f9034200640 1 -- 172.21.15.100:0/2410263771 shutdown_connections 2024-05-09T05:04:30.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f9532400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f952403e830 0x7f9524052710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f9034200640 1 -- 172.21.15.100:0/2410263771 wait complete. 2024-05-09T05:04:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f423ea00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f42280762d0 0x7f4228078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42400977b0 con 0x7f4248162a20 2024-05-09T05:04:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f423ea00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7f422807e4f0 0x7f4228080910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 --> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42400079f0 con 0x7f422807e4f0 2024-05-09T05:04:30.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f424009e050 con 0x7f4248162a20 2024-05-09T05:04:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7f9e91000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e840e7a40 0x7f9e8404e7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c06baf0 tx=0x7f9e8c06a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f9532400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9524054120 0x7f952417dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f9532400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95240e30b0 0x7f9524177150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b25200640 1 -- 172.21.15.100:0/2409009949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b200b4120 msgr2=0x7f7b20160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b25200640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b200b4120 0x7f7b20160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b25200640 1 -- 172.21.15.100:0/2409009949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b2015f570 msgr2=0x7f7b200b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b25200640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b2015f570 0x7f7b200b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b25200640 1 -- 172.21.15.100:0/2409009949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b201614d0 con 0x7f7b200d08c0 2024-05-09T05:04:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f7b26600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b2015f570 0x7f7b200b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f6441600640 1 -- 172.21.15.100:0/70643918 shutdown_connections 2024-05-09T05:04:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7f6441600640 1 -- 172.21.15.100:0/70643918 wait complete. 2024-05-09T05:04:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f1b13400640 1 --2- 172.21.15.100:0/2929415632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b140b5990 0x7f1b14164b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b000097a0 tx=0x7f1b0002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d314ab709b8d71 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f7b25200640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b200d08c0 0x7f7b20162570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c3c0 tx=0x7f7b0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f952b400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f952403e830 0x7f9524052710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f952aa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9524054120 0x7f952417dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f952aa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9524054120 0x7f952417dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46172/0 (socket says 172.21.15.100:46172) 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f952aa00640 1 -- 172.21.15.100:0/350427220 learned_addr learned my addr 172.21.15.100:0/350427220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f952be00640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95240e30b0 0x7f9524177150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9524006fd0 con 0x7f95240e30b0 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f1b12a00640 1 -- 172.21.15.100:0/2929415632 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00037070 con 0x7f1b140b5990 2024-05-09T05:04:30.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f1b12a00640 1 -- 172.21.15.100:0/2929415632 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0002ae40 con 0x7f1b140b5990 2024-05-09T05:04:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f1b12a00640 1 -- 172.21.15.100:0/2929415632 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00032660 con 0x7f1b140b5990 2024-05-09T05:04:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f4246000640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7f422807e4f0 0x7f4228080910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c007030 con 0x7f7b200d08c0 2024-05-09T05:04:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0071f0 con 0x7f7b200d08c0 2024-05-09T05:04:30.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0075e0 con 0x7f7b200d08c0 2024-05-09T05:04:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c06d450 con 0x7f9e840e7a40 2024-05-09T05:04:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c06d5f0 con 0x7f9e840e7a40 2024-05-09T05:04:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c06d9e0 con 0x7f9e840e7a40 2024-05-09T05:04:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e840e9c70 con 0x7f9e840e7a40 2024-05-09T05:04:30.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f95240e3490 con 0x7f952403e830 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9524007150 con 0x7f9524054120 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b140b5990 msgr2=0x7f1b14164b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f1b1ae00640 1 --2- 172.21.15.100:0/2929415632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b140b5990 0x7f1b14164b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b000097a0 tx=0x7f1b0002a0f0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 shutdown_connections 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f1b1ae00640 1 --2- 172.21.15.100:0/2929415632 >> v2:172.21.15.100:3300/0 conn(0x7f1b140cff00 0x7f1b140d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f1b1ae00640 1 --2- 172.21.15.100:0/2929415632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b140b5990 0x7f1b14164b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 >> 172.21.15.100:0/2929415632 conn(0x7f1b140b2c90 msgr2=0x7f1b140b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e840ea230 con 0x7f9e840e7a40 2024-05-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f952aa00640 1 -- 172.21.15.100:0/350427220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f952403e830 msgr2=0x7f9524052710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f952aa00640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f952403e830 0x7f9524052710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f952aa00640 1 -- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95240e30b0 msgr2=0x7f9524177150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f952aa00640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95240e30b0 0x7f9524177150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f952aa00640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952417e220 con 0x7f9524054120 2024-05-09T05:04:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f6441600640 1 Processor -- start 2024-05-09T05:04:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 shutdown_connections 2024-05-09T05:04:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2929415632 wait complete. 2024-05-09T05:04:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b201617b0 con 0x7f7b200d08c0 2024-05-09T05:04:30.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b20161d70 con 0x7f7b200d08c0 2024-05-09T05:04:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.837+0000 7f4246000640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7f422807e4f0 0x7f4228080910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.838+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b200d1790 con 0x7f7b200d08c0 2024-05-09T05:04:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.838+0000 7f952aa00640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9524054120 0x7f952417dce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9518000c00 tx=0x7f95180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.838+0000 7f9034200640 1 Processor -- start 2024-05-09T05:04:30.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.838+0000 7f9034200640 1 -- start start 2024-05-09T05:04:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.838+0000 7f6441600640 1 -- start start 2024-05-09T05:04:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7b3000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7ac0b5280 0x7fd7ac0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== osd.0 v2:172.21.15.100:6809/4292247992 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42400079f0 con 0x7f422807e4f0 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7b3000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7ac0b5e40 con 0x7fd7ac0cff00 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7b3000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fd7ac165050 con 0x7fd7ac0b5280 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7b3000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ac0b5c20 con 0x7fd7ac163c10 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7ab400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7ac0b5280 0x7fd7ac0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.833+0000 7fd7ab400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd7ac0b5280 0x7fd7ac0b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54646/0 (socket says 172.21.15.100:54646) 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7fd7ab400640 1 -- 172.21.15.100:0/4216037493 learned_addr learned my addr 172.21.15.100:0/4216037493 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.834+0000 7fd7abe00640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7fd7ab400640 1 -- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 msgr2=0x7fd7ac164b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7fd7ab400640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac164b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7fd7ab400640 1 -- 172.21.15.100:0/4216037493 >> v1:172.21.15.100:6789/0 conn(0x7fd7ac0cff00 legacy=0x7fd7ac1651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.835+0000 7fd7ab400640 1 -- 172.21.15.100:0/4216037493 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0b6120 con 0x7fd7ac0b5280 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.836+0000 7fd7abe00640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac164b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f9034200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f902c0aeb60 0x7f902c09cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f9034200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f902c0aef40 0x7f902c09d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f9034200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c09da20 0x7f902c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f9034200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0cf040 con 0x7f902c0aeb60 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f9034200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f902c163ff0 con 0x7f902c0aef40 2024-05-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f9034200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f902c0d0390 con 0x7f902c09da20 2024-05-09T05:04:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.839+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518037040 con 0x7f9524054120 2024-05-09T05:04:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f9031800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f902c0aeb60 0x7f902c09cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7fd7ab400640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 0x7fd7ac0b56e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009870 tx=0x7fd79c03b1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ca551b600d7bbb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f9031800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f902c0aeb60 0x7f902c09cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49976/0 (socket says 172.21.15.100:49976) 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f9031800640 1 -- 172.21.15.100:0/3758655029 learned_addr learned my addr 172.21.15.100:0/3758655029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f9032200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c09da20 0x7f902c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9524051670 con 0x7f9524054120 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9524051c30 con 0x7f9524054120 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518042070 con 0x7f9524054120 2024-05-09T05:04:30.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518030cc0 con 0x7f9524054120 2024-05-09T05:04:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f6441600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f643c0d0e10 0x7f643c0ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f1b1ae00640 1 Processor -- start 2024-05-09T05:04:30.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f6441600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d1da0 0x7f643c1fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f6441600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f643c0d5cc0 0x7f643c1fd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f6441600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0c9400 con 0x7f643c0d0e10 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9032200640 1 -- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f902c0aef40 msgr2=0x7f902c09d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9032200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f902c0aef40 0x7f902c09d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9032200640 1 -- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f902c0aeb60 msgr2=0x7f902c09cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9032200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f902c0aeb60 0x7f902c09cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9032200640 1 -- 172.21.15.100:0/3758655029 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c09ba10 con 0x7f902c09da20 2024-05-09T05:04:30.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9508001030 con 0x7f9524054120 2024-05-09T05:04:30.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f6441600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0c8730 con 0x7f643c0d5cc0 2024-05-09T05:04:30.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.840+0000 7f6441600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f643c0c9580 con 0x7f643c0d1da0 2024-05-09T05:04:30.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f643be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f643c0d0e10 0x7f643c0ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f643be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f643c0d0e10 0x7f643c0ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49986/0 (socket says 172.21.15.100:49986) 2024-05-09T05:04:30.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f643be00640 1 -- 172.21.15.100:0/3433053957 learned_addr learned my addr 172.21.15.100:0/3433053957 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f9032200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c09da20 0x7f902c0b1820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f902c06fbc0 tx=0x7f9024007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f643b400640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d1da0 0x7f643c1fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f1b1ae00640 1 -- start start 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f1b1ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b140b5990 0x7f1b14155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f1b1ae00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b140cff00 0x7f1b140b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b1ae00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b14163c10 0x7f1b140b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f643be00640 1 -- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d1da0 msgr2=0x7f643c1fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f643be00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f643c0d1da0 0x7f643c1fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f643be00640 1 -- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f643c0d5cc0 msgr2=0x7f643c1fd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f643be00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f643c0d5cc0 0x7f643c1fd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f643be00640 1 -- 172.21.15.100:0/3433053957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c0cec10 con 0x7f643c0d0e10 2024-05-09T05:04:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024003ea0 con 0x7f902c09da20 2024-05-09T05:04:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024019070 con 0x7f902c09da20 2024-05-09T05:04:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024014650 con 0x7f902c09da20 2024-05-09T05:04:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c15c6b0 con 0x7f902c09da20 2024-05-09T05:04:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b1ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b140cf040 con 0x7f1b140b5990 2024-05-09T05:04:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b13400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b140cff00 0x7f1b140b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b1ae00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1b14163ff0 con 0x7f1b140cff00 2024-05-09T05:04:30.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b1ae00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1b141651f0 con 0x7f1b14163c10 2024-05-09T05:04:30.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c09bf90 con 0x7f902c09da20 2024-05-09T05:04:30.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b13e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b140b5990 0x7f1b14155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b13400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b140cff00 0x7f1b140b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54694/0 (socket says 172.21.15.100:54694) 2024-05-09T05:04:30.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f1b18e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b14163c10 0x7f1b140b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b18e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b14163c10 0x7f1b140b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46194/0 (socket says 172.21.15.100:46194) 2024-05-09T05:04:30.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13400640 1 -- 172.21.15.100:0/2924002558 learned_addr learned my addr 172.21.15.100:0/2924002558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.842+0000 7f643be00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f643c0d0e10 0x7f643c0ce6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f643400b410 tx=0x7f643400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434015020 con 0x7f643c0d0e10 2024-05-09T05:04:30.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13e00640 1 -- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b14163c10 msgr2=0x7f1b140b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13e00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b14163c10 0x7f1b140b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13e00640 1 -- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b140cff00 msgr2=0x7f1b140b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13e00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b140cff00 0x7f1b140b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13e00640 1 -- 172.21.15.100:0/2924002558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1409c690 con 0x7f1b140b5990 2024-05-09T05:04:30.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c0cd630 con 0x7f643c0d0e10 2024-05-09T05:04:30.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6434011830 con 0x7f643c0d0e10 2024-05-09T05:04:30.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434011c20 con 0x7f643c0d0e10 2024-05-09T05:04:30.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f1b13e00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b140b5990 0x7f1b14155110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c730 tx=0x7f1b0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c0cdbf0 con 0x7f643c0d0e10 2024-05-09T05:04:30.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e8c06db80 con 0x7f9e840e7a40 2024-05-09T05:04:30.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e840057d0 con 0x7f9e840e7a40 2024-05-09T05:04:30.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b040058b0 con 0x7f1b140b5990 2024-05-09T05:04:30.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.841+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b0c01a020 con 0x7f7b200d08c0 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.843+0000 7f7b1d600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7b00076350 0x7f7b00078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f7b25c00640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7b00076350 0x7f7b00078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7b0c09b060 con 0x7f7b200d08c0 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f902c06a630 con 0x7f902c09da20 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.844+0000 7fd7aaa00640 1 -- 172.21.15.100:0/4216037493 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c048070 con 0x7fd7ac0b5280 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7fd7aaa00640 1 -- 172.21.15.100:0/4216037493 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c043440 con 0x7fd7ac0b5280 2024-05-09T05:04:30.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7fd7aaa00640 1 -- 172.21.15.100:0/4216037493 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c043810 con 0x7fd7ac0b5280 2024-05-09T05:04:30.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f4246a00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f42280762d0 0x7f4228078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f7b1d600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f7b0007e570 0x7f7b00080990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b00081040 con 0x7f7b0007e570 2024-05-09T05:04:30.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7b0c05be00 con 0x7f7b200d08c0 2024-05-09T05:04:30.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1409c970 con 0x7f1b140b5990 2024-05-09T05:04:30.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b14155650 con 0x7f1b140b5990 2024-05-09T05:04:30.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04005a50 con 0x7f1b140b5990 2024-05-09T05:04:30.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04007070 con 0x7f1b140b5990 2024-05-09T05:04:30.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f7b26600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f7b0007e570 0x7f7b00080990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.845+0000 7f9e7fe00640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9e6c076320 0x7f9e6c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.846+0000 7f4246a00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f42280762d0 0x7f4228078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42380079a0 tx=0x7f4238008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.846+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f951803d440 con 0x7f9524054120 2024-05-09T05:04:30.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.846+0000 7f7b26600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f7b0007e570 0x7f7b00080990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.846+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6414001030 con 0x7f643c0d0e10 2024-05-09T05:04:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.847+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1aec001030 con 0x7f1b140b5990 2024-05-09T05:04:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f951f400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95180b8e30 con 0x7f9524054120 2024-05-09T05:04:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b00081040 con 0x7f7b0007e570 2024-05-09T05:04:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9e8be00640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9e6c076320 0x7f9e6c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e8c0d85f0 con 0x7f9e840e7a40 2024-05-09T05:04:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f951f400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f950c07e470 0x7f950c080890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f951802ce50 con 0x7f950c07e470 2024-05-09T05:04:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f95180b9220 con 0x7f9524054120 2024-05-09T05:04:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9e7fe00640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f9e6c07e5a0 0x7f9e6c0809c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e6c081070 con 0x7f9e6c07e5a0 2024-05-09T05:04:30.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c118060 con 0x7f9e840e7a40 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 -- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 msgr2=0x7fd7ac0b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 0x7fd7ac0b56e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009870 tx=0x7fd79c03b1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.847+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9024005d10 con 0x7f902c09da20 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9029600640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f900c0762d0 0x7f900c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f90240988c0 con 0x7f902c09da20 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9029600640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7f900c07e4f0 0x7f900c080910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 --> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f900c080fc0 con 0x7f900c07e4f0 2024-05-09T05:04:30.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.848+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9024098cb0 con 0x7f902c09da20 2024-05-09T05:04:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7f952b400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7f9030e00640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7f900c07e4f0 0x7f900c080910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 -- 172.21.15.100:0/4216037493 shutdown_connections 2024-05-09T05:04:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 0x7fd7ac0b56e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 --2- 172.21.15.100:0/4216037493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac164b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 -- 172.21.15.100:0/4216037493 >> 172.21.15.100:0/4216037493 conn(0x7fd7ac0b2c90 msgr2=0x7fd7ac0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7f9031800640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f900c0762d0 0x7f900c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.849+0000 7fd7b3000640 1 -- 172.21.15.100:0/4216037493 shutdown_connections 2024-05-09T05:04:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7fd7b3000640 1 -- 172.21.15.100:0/4216037493 wait complete. 2024-05-09T05:04:30.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7f952be00640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f950c07e470 0x7f950c080890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7f9e8b400640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f9e6c07e5a0 0x7f9e6c0809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7f9e8be00640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9e6c076320 0x7f9e6c0787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000f60 tx=0x7f9e80000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7f9030e00640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7f900c07e4f0 0x7f900c080910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b04007210 con 0x7f1b140b5990 2024-05-09T05:04:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.851+0000 7f9e8b400640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f9e6c07e5a0 0x7f9e6c0809c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.851+0000 7f1b0be00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1af4076300 0x7f1af40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.851+0000 7fd7b3000640 1 Processor -- start 2024-05-09T05:04:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.852+0000 7fd7b3000640 1 -- start start 2024-05-09T05:04:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.852+0000 7f9031800640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f900c0762d0 0x7f900c078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9020000fb0 tx=0x7f9020009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.850+0000 7f952be00640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f950c07e470 0x7f950c080890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.851+0000 7f952b400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9520000f60 tx=0x7f9520009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.851+0000 7f7b25c00640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7b00076350 0x7f7b00078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009560 tx=0x7f7b1402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.852+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== osd.2 v2:172.21.15.100:6810/752925701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f951802ce50 con 0x7f950c07e470 2024-05-09T05:04:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.852+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b04097a10 con 0x7f1b140b5990 2024-05-09T05:04:30.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7fd7b3000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 0x7fd7ac0adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== osd.1 v2:172.21.15.100:6808/396670832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e6c081070 con 0x7f9e6c07e5a0 2024-05-09T05:04:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7fd7b3000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac0cff00 0x7fd7ac0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7fd7b3000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac09ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== osd.6 v2:172.21.15.133:6824/1215001557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f900c080fc0 con 0x7f900c07e4f0 2024-05-09T05:04:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f1b0be00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1af407e520 0x7f1af4080940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 --> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b04021e50 con 0x7f1af407e520 2024-05-09T05:04:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1b04097e00 con 0x7f1b140b5990 2024-05-09T05:04:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f1b13400640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1af4076300 0x7f1af40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac0cff00 0x7fd7ac0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6434018020 con 0x7f643c0d0e10 2024-05-09T05:04:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.853+0000 7fd7ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac0cff00 0x7fd7ac0b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50004/0 (socket says 172.21.15.100:50004) 2024-05-09T05:04:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.854+0000 7fd7b3000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac163ff0 con 0x7fd7ac0cff00 2024-05-09T05:04:30.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.854+0000 7fd7b3000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ac1645f0 con 0x7fd7ac0b5280 2024-05-09T05:04:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.854+0000 7f1b18e00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1af407e520 0x7f1af4080940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.854+0000 7f1b13400640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1af4076300 0x7f1af40787c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b140cf5c0 tx=0x7f1b0002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.855+0000 7f6433e00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f64180762d0 0x7f6418078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.855+0000 7fd7ab400640 1 -- 172.21.15.100:0/514886193 learned_addr learned my addr 172.21.15.100:0/514886193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.855+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f64340974b0 con 0x7f643c0d0e10 2024-05-09T05:04:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.855+0000 7f6433e00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f641807e4f0 0x7f6418080910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.855+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 --> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6418080fc0 con 0x7f641807e4f0 2024-05-09T05:04:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.855+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f643409e050 con 0x7f643c0d0e10 2024-05-09T05:04:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7b3000640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ac0cf040 con 0x7fd7ac163c10 2024-05-09T05:04:30.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7abe00640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 0x7fd7ac0adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7f643b400640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f64180762d0 0x7f6418078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7ab400640 1 -- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 msgr2=0x7fd7ac09ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7ab400640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd7ac163c10 0x7fd7ac09ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7ab400640 1 -- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 msgr2=0x7fd7ac0adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7ab400640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7ac0b5280 0x7fd7ac0adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7fd7ab400640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ac0ae550 con 0x7fd7ac0cff00 2024-05-09T05:04:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.856+0000 7f1b18e00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1af407e520 0x7f1af4080940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.857+0000 7f643b400640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f64180762d0 0x7f6418078790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f642c033000 tx=0x7f642c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.857+0000 7fd7ab400640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac0cff00 0x7fd7ac0b1790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009870 tx=0x7fd79c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.859+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== osd.7 v2:172.21.15.133:6813/1847228632 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b04021e50 con 0x7f1af407e520 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.860+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c052070 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.860+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79c04d870 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.860+0000 7fd7b3000640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ac0ae830 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.860+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79c048040 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.860+0000 7fd7b3000640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ac0aedf0 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.861+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7ac06a630 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.865+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd79c055070 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.866+0000 7fd7a3e00640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd78c0763a0 0x7fd78c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.866+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd79c0c9570 con 0x7fd7ac0cff00 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.867+0000 7fd7a3e00640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7fd78c07e5c0 0x7fd78c0809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.867+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd79c043440 con 0x7fd78c07e5c0 2024-05-09T05:04:30.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.867+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd79c0c9960 con 0x7fd7ac0cff00 2024-05-09T05:04:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.867+0000 7fd7abe00640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd78c0763a0 0x7fd78c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.868+0000 7fd7b1000640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7fd78c07e5c0 0x7fd78c0809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.868+0000 7f6440c00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f641807e4f0 0x7f6418080910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.869+0000 7fd7abe00640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd78c0763a0 0x7fd78c078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0b49f0 tx=0x7fd7a4009890 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.869+0000 7f6440c00640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f641807e4f0 0x7f6418080910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.869+0000 7fd7b1000640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7fd78c07e5c0 0x7fd78c0809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.872+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== osd.5 v2:172.21.15.133:6808/2703436583 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd79c043440 con 0x7fd78c07e5c0 2024-05-09T05:04:30.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.872+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== osd.4 v2:172.21.15.133:6800/4260847374 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6418080fc0 con 0x7f641807e4f0 2024-05-09T05:04:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.872+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 --> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f421c002dd0 con 0x7f422807e4f0 2024-05-09T05:04:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.874+0000 7f423ea00640 1 -- 172.21.15.100:0/1621063754 <== osd.0 v2:172.21.15.100:6809/4292247992 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f421c002dd0 con 0x7f422807e4f0 2024-05-09T05:04:30.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.874+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7f422807e4f0 msgr2=0x7f4228080910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.874+0000 7f4233e00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7f422807e4f0 0x7f4228080910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f42280762d0 msgr2=0x7f4228078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f42280762d0 0x7f4228078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42380079a0 tx=0x7f4238008040 comp rx=0 tx=0).stop 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4248162a20 msgr2=0x7f42481f92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 --2- 172.21.15.100:0/1621063754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4248162a20 0x7f42481f92b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f424000c780 tx=0x7f424000cc40 comp rx=0 tx=0).stop 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4247400640 1 -- 172.21.15.100:0/1621063754 reap_dead start 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 shutdown_connections 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 >> 172.21.15.100:0/1621063754 conn(0x7f42480d5090 msgr2=0x7f42480b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 shutdown_connections 2024-05-09T05:04:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.875+0000 7f4233e00640 1 -- 172.21.15.100:0/1621063754 wait complete. 2024-05-09T05:04:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.881+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b2014ced0 con 0x7f7b0007e570 2024-05-09T05:04:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.882+0000 7f7b1d600640 1 -- 172.21.15.100:0/2409009949 <== osd.3 v2:172.21.15.100:6800/209630893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7b2014ced0 con 0x7f7b0007e570 2024-05-09T05:04:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.883+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f7b0007e570 msgr2=0x7f7b00080990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.883+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 --> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9508002dd0 con 0x7f950c07e470 2024-05-09T05:04:30.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.883+0000 7f7b28600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f7b0007e570 0x7f7b00080990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7b00076350 msgr2=0x7f7b00078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f951f400640 1 -- 172.21.15.100:0/350427220 <== osd.2 v2:172.21.15.100:6810/752925701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9508002dd0 con 0x7f950c07e470 2024-05-09T05:04:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f7b28600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7b00076350 0x7f7b00078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009560 tx=0x7f7b1402e000 comp rx=0 tx=0).stop 2024-05-09T05:04:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 --> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1aec002dd0 con 0x7f1af407e520 2024-05-09T05:04:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b200d08c0 msgr2=0x7f7b20162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f7b28600640 1 --2- 172.21.15.100:0/2409009949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b200d08c0 0x7f7b20162570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c3c0 tx=0x7f7b0c00c880 comp rx=0 tx=0).stop 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f950c07e470 msgr2=0x7f950c080890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f9532400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f950c07e470 0x7f950c080890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 msgr2=0x7f950c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f9532400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9520000f60 tx=0x7f9520009040 comp rx=0 tx=0).stop 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9524054120 msgr2=0x7f952417dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f9532400640 1 --2- 172.21.15.100:0/350427220 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9524054120 0x7f952417dce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9518000c00 tx=0x7f95180046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f952be00640 1 -- 172.21.15.100:0/350427220 reap_dead start 2024-05-09T05:04:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.885+0000 7f7b26600640 1 -- 172.21.15.100:0/2409009949 reap_dead start 2024-05-09T05:04:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f1b0be00640 1 -- 172.21.15.100:0/2924002558 <== osd.7 v2:172.21.15.133:6813/1847228632 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1aec002dd0 con 0x7f1af407e520 2024-05-09T05:04:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 shutdown_connections 2024-05-09T05:04:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 >> 172.21.15.100:0/2409009949 conn(0x7f7b200d5160 msgr2=0x7f7b2006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 shutdown_connections 2024-05-09T05:04:30.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 >> 172.21.15.100:0/350427220 conn(0x7f95240559d0 msgr2=0x7f9524038140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.886+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 shutdown_connections 2024-05-09T05:04:30.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.887+0000 7f7b28600640 1 -- 172.21.15.100:0/2409009949 wait complete. 2024-05-09T05:04:30.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.887+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 shutdown_connections 2024-05-09T05:04:30.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.887+0000 7f9532400640 1 -- 172.21.15.100:0/350427220 wait complete. 2024-05-09T05:04:30.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.887+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1af407e520 msgr2=0x7f1af4080940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.887+0000 7f1b1ae00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1af407e520 0x7f1af4080940 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.888+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1af4076300 msgr2=0x7f1af40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.888+0000 7f1b1ae00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1af4076300 0x7f1af40787c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1b140cf5c0 tx=0x7f1b0002e000 comp rx=0 tx=0).stop 2024-05-09T05:04:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.888+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b140b5990 msgr2=0x7f1b14155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.888+0000 7f1b1ae00640 1 --2- 172.21.15.100:0/2924002558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b140b5990 0x7f1b14155110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c730 tx=0x7f1b0400cbf0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.888+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 --> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e840578e0 con 0x7f9e6c07e5a0 2024-05-09T05:04:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.888+0000 7f1b18e00640 1 -- 172.21.15.100:0/2924002558 reap_dead start 2024-05-09T05:04:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.889+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 shutdown_connections 2024-05-09T05:04:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.889+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 >> 172.21.15.100:0/2924002558 conn(0x7f1b140b2c90 msgr2=0x7f1b1406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.889+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 shutdown_connections 2024-05-09T05:04:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.889+0000 7f1b1ae00640 1 -- 172.21.15.100:0/2924002558 wait complete. 2024-05-09T05:04:30.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.889+0000 7f9e7fe00640 1 -- 172.21.15.100:0/4288548071 <== osd.1 v2:172.21.15.100:6808/396670832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e840578e0 con 0x7f9e6c07e5a0 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.890+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f9e6c07e5a0 msgr2=0x7f9e6c0809c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.890+0000 7f9e93000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f9e6c07e5a0 0x7f9e6c0809c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.891+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9e6c076320 msgr2=0x7f9e6c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.891+0000 7f9e93000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9e6c076320 0x7f9e6c0787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000f60 tx=0x7f9e80000ed0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.891+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e840e7a40 msgr2=0x7f9e8404e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.891+0000 7f9e93000640 1 --2- 172.21.15.100:0/4288548071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e840e7a40 0x7f9e8404e7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c06baf0 tx=0x7f9e8c06a870 comp rx=0 tx=0).stop 2024-05-09T05:04:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.891+0000 7f9e91000640 1 -- 172.21.15.100:0/4288548071 reap_dead start 2024-05-09T05:04:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.892+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 shutdown_connections 2024-05-09T05:04:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.892+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 >> 172.21.15.100:0/4288548071 conn(0x7f9e84056cc0 msgr2=0x7f9e840e62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.892+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 --> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f902c0b3560 con 0x7f900c07e4f0 2024-05-09T05:04:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.894+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 shutdown_connections 2024-05-09T05:04:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.894+0000 7f9e93000640 1 -- 172.21.15.100:0/4288548071 wait complete. 2024-05-09T05:04:30.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.895+0000 7f9029600640 1 -- 172.21.15.100:0/3758655029 <== osd.6 v2:172.21.15.133:6824/1215001557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f902c0b3560 con 0x7f900c07e4f0 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.896+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7f900c07e4f0 msgr2=0x7f900c080910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.896+0000 7f9034200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7f900c07e4f0 0x7f900c080910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.897+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f900c0762d0 msgr2=0x7f900c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.897+0000 7f9034200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f900c0762d0 0x7f900c078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9020000fb0 tx=0x7f9020009040 comp rx=0 tx=0).stop 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.897+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c09da20 msgr2=0x7f902c0b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.897+0000 7f9034200640 1 --2- 172.21.15.100:0/3758655029 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f902c09da20 0x7f902c0b1820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f902c06fbc0 tx=0x7f9024007700 comp rx=0 tx=0).stop 2024-05-09T05:04:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.897+0000 7f9032200640 1 -- 172.21.15.100:0/3758655029 reap_dead start 2024-05-09T05:04:30.933 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:30.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T05:04:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.898+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 shutdown_connections 2024-05-09T05:04:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.898+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 >> 172.21.15.100:0/3758655029 conn(0x7f902c0b2c90 msgr2=0x7f902c0afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.898+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 shutdown_connections 2024-05-09T05:04:30.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.898+0000 7f9034200640 1 -- 172.21.15.100:0/3758655029 wait complete. 2024-05-09T05:04:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.907+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 --> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7ac0b59a0 con 0x7fd78c07e5c0 2024-05-09T05:04:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.909+0000 7fd7a3e00640 1 -- 172.21.15.100:0/514886193 <== osd.5 v2:172.21.15.133:6808/2703436583 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd7ac0b59a0 con 0x7fd78c07e5c0 2024-05-09T05:04:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.909+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 --> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6414002dd0 con 0x7f641807e4f0 2024-05-09T05:04:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.909+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7fd78c07e5c0 msgr2=0x7fd78c0809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.909+0000 7fd7a1600640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7fd78c07e5c0 0x7fd78c0809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7f6433e00640 1 -- 172.21.15.100:0/3433053957 <== osd.4 v2:172.21.15.133:6800/4260847374 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6414002dd0 con 0x7f641807e4f0 2024-05-09T05:04:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd78c0763a0 msgr2=0x7fd78c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7a1600640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd78c0763a0 0x7fd78c078860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0b49f0 tx=0x7fd7a4009890 comp rx=0 tx=0).stop 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac0cff00 msgr2=0x7fd7ac0b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7a1600640 1 --2- 172.21.15.100:0/514886193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac0cff00 0x7fd7ac0b1790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009870 tx=0x7fd79c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7b1000640 1 -- 172.21.15.100:0/514886193 reap_dead start 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 shutdown_connections 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.910+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 >> 172.21.15.100:0/514886193 conn(0x7fd7ac0b2c90 msgr2=0x7fd7ac0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 shutdown_connections 2024-05-09T05:04:30.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7fd7a1600640 1 -- 172.21.15.100:0/514886193 wait complete. 2024-05-09T05:04:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f641807e4f0 msgr2=0x7f6418080910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6441600640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f641807e4f0 0x7f6418080910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f64180762d0 msgr2=0x7f6418078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6441600640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f64180762d0 0x7f6418078790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f642c033000 tx=0x7f642c009000 comp rx=0 tx=0).stop 2024-05-09T05:04:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f643c0d0e10 msgr2=0x7f643c0ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:30.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6441600640 1 --2- 172.21.15.100:0/3433053957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f643c0d0e10 0x7f643c0ce6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f643400b410 tx=0x7f643400b8d0 comp rx=0 tx=0).stop 2024-05-09T05:04:30.939 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:30.939 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T05:04:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.911+0000 7f6440c00640 1 -- 172.21.15.100:0/3433053957 reap_dead start 2024-05-09T05:04:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.912+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 shutdown_connections 2024-05-09T05:04:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.912+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 >> 172.21.15.100:0/3433053957 conn(0x7f643c0d51a0 msgr2=0x7f643c161620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.912+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 shutdown_connections 2024-05-09T05:04:30.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:30.912+0000 7f6441600640 1 -- 172.21.15.100:0/3433053957 wait complete. 2024-05-09T05:04:30.941 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:30.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T05:04:30.942 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:30.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T05:04:30.943 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:30.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T05:04:30.944 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:30.944 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T05:04:30.945 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:30.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T05:04:30.946 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:30.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T05:04:31.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.251+0000 7f4ad7400640 1 Processor -- start 2024-05-09T05:04:31.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.251+0000 7f4ad7400640 1 -- start start 2024-05-09T05:04:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.253+0000 7f4ad7400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ac8004af0 0x7f4ac80df210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.253+0000 7f4ad7400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4ad7400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac8054630 con 0x7f4ac803ac40 2024-05-09T05:04:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4ad7400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac8054910 con 0x7f4ac8004af0 2024-05-09T05:04:31.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4ad7400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac8054bf0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4ad5400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4ac803ac40 0x7f4ac80e2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:54918/0 (socket says 172.21.15.100:54918) 2024-05-09T05:04:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4ad5400640 1 -- 172.21.15.100:0/2076980627 learned_addr learned my addr 172.21.15.100:0/2076980627 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4acfe00640 1 --2- 172.21.15.100:0/2076980627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.254+0000 7f4ad4a00640 1 --2- 172.21.15.100:0/2076980627 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8004af0 0x7f4ac80df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.255+0000 7f4acfe00640 1 -- 172.21.15.100:0/2076980627 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8004af0 msgr2=0x7f4ac80df210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.255+0000 7f4acfe00640 1 --2- 172.21.15.100:0/2076980627 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8004af0 0x7f4ac80df210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.255+0000 7f4acfe00640 1 -- 172.21.15.100:0/2076980627 >> v1:172.21.15.133:6789/0 conn(0x7f4ac803ac40 legacy=0x7f4ac80e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.255+0000 7f4acfe00640 1 -- 172.21.15.100:0/2076980627 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac80062d0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.258+0000 7f4acfe00640 1 --2- 172.21.15.100:0/2076980627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80533d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40097a0 tx=0x7f4ac40329d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f90f8044ed3676d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.259+0000 7f4acf400640 1 -- 172.21.15.100:0/2076980627 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403b070 con 0x7f4ac803a7e0 2024-05-09T05:04:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.259+0000 7f4acf400640 1 -- 172.21.15.100:0/2076980627 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac4037830 con 0x7f4ac803a7e0 2024-05-09T05:04:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.259+0000 7f4acf400640 1 -- 172.21.15.100:0/2076980627 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4037c40 con 0x7f4ac803a7e0 2024-05-09T05:04:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.260+0000 7f4ad7400640 1 -- 172.21.15.100:0/2076980627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 msgr2=0x7f4ac80533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.260+0000 7f4ad7400640 1 --2- 172.21.15.100:0/2076980627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80533d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40097a0 tx=0x7f4ac40329d0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.260+0000 7f4ad7400640 1 -- 172.21.15.100:0/2076980627 shutdown_connections 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.260+0000 7f4ad7400640 1 --2- 172.21.15.100:0/2076980627 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80533d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.260+0000 7f4ad7400640 1 --2- 172.21.15.100:0/2076980627 >> v2:172.21.15.133:3300/0 conn(0x7f4ac8004af0 0x7f4ac80df210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.260+0000 7f4ad7400640 1 -- 172.21.15.100:0/2076980627 >> 172.21.15.100:0/2076980627 conn(0x7f4ac800a3f0 msgr2=0x7f4ac800a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.261+0000 7f4ad7400640 1 -- 172.21.15.100:0/2076980627 shutdown_connections 2024-05-09T05:04:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.261+0000 7f4ad7400640 1 -- 172.21.15.100:0/2076980627 wait complete. 2024-05-09T05:04:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.263+0000 7f56f1600640 1 Processor -- start 2024-05-09T05:04:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.264+0000 7f4ad7400640 1 Processor -- start 2024-05-09T05:04:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.264+0000 7f56f1600640 1 -- start start 2024-05-09T05:04:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.264+0000 7f4ad7400640 1 -- start start 2024-05-09T05:04:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.266+0000 7f4ad7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac8004af0 0x7f4ac8034ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.266+0000 7f4ad7400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80e0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac803ac40 0x7f4ac8188c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac8004af0 0x7f4ac8034ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac8004af0 0x7f4ac8034ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54720/0 (socket says 172.21.15.100:54720) 2024-05-09T05:04:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad4a00640 1 -- 172.21.15.100:0/1123342894 learned_addr learned my addr 172.21.15.100:0/1123342894 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f56f1600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56e40069e0 0x7f56e4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f56f1600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e4053720 con 0x7f56e40ead00 2024-05-09T05:04:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f56f1600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e4053a00 con 0x7f56e4005e90 2024-05-09T05:04:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f56f1600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f56e4054330 con 0x7f56e40069e0 2024-05-09T05:04:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80e3bd0 con 0x7f4ac803ac40 2024-05-09T05:04:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4acfe00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80e3a50 con 0x7f4ac8004af0 2024-05-09T05:04:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.267+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac8037f60 con 0x7f4ac803a7e0 2024-05-09T05:04:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f56eb400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f56e4005e90 0x7f56e40062d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:54934/0 (socket says 172.21.15.100:54934) 2024-05-09T05:04:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f4ad5400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac803ac40 0x7f4ac8188c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f56eb400640 1 -- 172.21.15.100:0/2849317943 learned_addr learned my addr 172.21.15.100:0/2849317943 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f3b61400640 1 Processor -- start 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f4acfe00640 1 -- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac8004af0 msgr2=0x7f4ac8034ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f4acfe00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac8004af0 0x7f4ac8034ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f4acfe00640 1 -- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac803ac40 msgr2=0x7f4ac8188c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f4acfe00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac803ac40 0x7f4ac8188c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f4acfe00640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac81891c0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.268+0000 7f3b61400640 1 -- start start 2024-05-09T05:04:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.269+0000 7f56f0c00640 1 --2- 172.21.15.100:0/2849317943 >> v2:172.21.15.133:3300/0 conn(0x7f56e40069e0 0x7f56e4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.269+0000 7f4acfe00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80e0690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ac403a000 tx=0x7f4ac40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.269+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858166377 0 0) 0x7f56e4053a00 con 0x7f56e4005e90 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d4003520 con 0x7f56e4005e90 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703435932 0 0) 0x7f56e4053720 con 0x7f56e40ead00 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e4053a00 con 0x7f56e40ead00 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4044020 con 0x7f4ac803a7e0 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac40146b0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403b040 con 0x7f4ac803a7e0 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f3b61400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3b5c0d31c0 0x7f3b5c0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f3b61400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15f8d0 0x7f3b5c0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f3b61400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c0b48a0 con 0x7f3b5c0d3870 2024-05-09T05:04:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f3b61400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0b4b80 con 0x7f3b5c0d31c0 2024-05-09T05:04:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.270+0000 7f3b61400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0b4e60 con 0x7f3b5c15f8d0 2024-05-09T05:04:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.271+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac80351e0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.271+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac80357a0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.271+0000 7f56f0c00640 1 -- 172.21.15.100:0/2849317943 >> v1:172.21.15.133:6789/0 conn(0x7f56e4005e90 legacy=0x7f56e40062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.271+0000 7f56f0c00640 1 -- 172.21.15.100:0/2849317943 >> v1:172.21.15.100:6789/0 conn(0x7f56e40ead00 legacy=0x7f56e404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.271+0000 7f56f0c00640 1 -- 172.21.15.100:0/2849317943 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e4053ce0 con 0x7f56e40069e0 2024-05-09T05:04:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.272+0000 7f3b59e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3b5c0d31c0 0x7f3b5c0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.272+0000 7f3b5a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3b5c0d3870 0x7f3b5c0d3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40328/0 (socket says 172.21.15.100:40328) 2024-05-09T05:04:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.272+0000 7f3b5a800640 1 -- 172.21.15.100:0/2286072893 learned_addr learned my addr 172.21.15.100:0/2286072893 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.272+0000 7f56f0c00640 1 --2- 172.21.15.100:0/2849317943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4006e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0515a0 tx=0x7f56ec0a6b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90d887c0ac3c35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.273+0000 7f3b5b200640 1 --2- 172.21.15.100:0/2286072893 >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15f8d0 0x7f3b5c0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.273+0000 7f3b59e00640 1 -- 172.21.15.100:0/2286072893 >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15f8d0 msgr2=0x7f3b5c0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.273+0000 7f3b59e00640 1 --2- 172.21.15.100:0/2286072893 >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15f8d0 0x7f3b5c0b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.273+0000 7f3b59e00640 1 -- 172.21.15.100:0/2286072893 >> v1:172.21.15.100:6789/0 conn(0x7f3b5c0d3870 legacy=0x7f3b5c0d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.273+0000 7f3b59e00640 1 -- 172.21.15.100:0/2286072893 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0b5140 con 0x7f3b5c0d31c0 2024-05-09T05:04:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.274+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec06e650 con 0x7f56e40069e0 2024-05-09T05:04:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.274+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac005290 con 0x7f4ac803a7e0 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.274+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec06e7f0 con 0x7f56e40069e0 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.274+0000 7f56eaa00640 1 -- 172.21.15.100:0/2849317943 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec06ec60 con 0x7f56e40069e0 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.275+0000 7f56f1600640 1 -- 172.21.15.100:0/2849317943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 msgr2=0x7f56e4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.275+0000 7f56f1600640 1 --2- 172.21.15.100:0/2849317943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4006e50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0515a0 tx=0x7f56ec0a6b00 comp rx=0 tx=0).stop 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.276+0000 7f56f1600640 1 -- 172.21.15.100:0/2849317943 shutdown_connections 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.276+0000 7f56f1600640 1 --2- 172.21.15.100:0/2849317943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4006e50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.276+0000 7f56f1600640 1 -- 172.21.15.100:0/2849317943 >> 172.21.15.100:0/2849317943 conn(0x7f56e4009fb0 msgr2=0x7f56e400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.275+0000 7f3b59e00640 1 --2- 172.21.15.100:0/2286072893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0d08b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c09ece0 tx=0x7f3b4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351b3b83c95479ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.276+0000 7f56f1600640 1 -- 172.21.15.100:0/2849317943 shutdown_connections 2024-05-09T05:04:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.276+0000 7f3b59400640 1 -- 172.21.15.100:0/2286072893 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c037070 con 0x7f3b5c0d31c0 2024-05-09T05:04:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.276+0000 7f56f1600640 1 -- 172.21.15.100:0/2849317943 wait complete. 2024-05-09T05:04:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.277+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4ac4047020 con 0x7f4ac803a7e0 2024-05-09T05:04:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.277+0000 7f3b59400640 1 -- 172.21.15.100:0/2286072893 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c032440 con 0x7f3b5c0d31c0 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.277+0000 7f3b59400640 1 -- 172.21.15.100:0/2286072893 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c032810 con 0x7f3b5c0d31c0 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.278+0000 7f3b61400640 1 -- 172.21.15.100:0/2286072893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c0d31c0 msgr2=0x7f3b5c0d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.278+0000 7f3b61400640 1 --2- 172.21.15.100:0/2286072893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0d08b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c09ece0 tx=0x7f3b4c02a1a0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.279+0000 7f3b61400640 1 -- 172.21.15.100:0/2286072893 shutdown_connections 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.279+0000 7f3b61400640 1 --2- 172.21.15.100:0/2286072893 >> v2:172.21.15.133:3300/0 conn(0x7f3b5c15f8d0 0x7f3b5c0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.279+0000 7f3b61400640 1 --2- 172.21.15.100:0/2286072893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0d08b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.279+0000 7f3b61400640 1 -- 172.21.15.100:0/2286072893 >> 172.21.15.100:0/2286072893 conn(0x7f3b5c09e5d0 msgr2=0x7f3b5c0d5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.279+0000 7f4accc00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ab00763a0 0x7f4ab0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.279+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ac40b89b0 con 0x7f4ac803a7e0 2024-05-09T05:04:31.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f4ad4a00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ab00763a0 0x7f4ab0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f3b61400640 1 -- 172.21.15.100:0/2286072893 shutdown_connections 2024-05-09T05:04:31.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f56f1600640 1 Processor -- start 2024-05-09T05:04:31.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f858c400640 1 Processor -- start 2024-05-09T05:04:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f858c400640 1 -- start start 2024-05-09T05:04:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f56f1600640 1 -- start start 2024-05-09T05:04:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.280+0000 7f3b61400640 1 -- 172.21.15.100:0/2286072893 wait complete. 2024-05-09T05:04:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.281+0000 7f4ad4a00640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ab00763a0 0x7f4ab0078860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80e0f50 tx=0x7f4abc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858c400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8584163b80 0x7f8584168160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858c400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f858406ee90 0x7f85840cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858c400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85840d0000 0x7f85840d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7fda5d000640 1 Processor -- start 2024-05-09T05:04:31.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858c400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f85840d09a0 con 0x7f85840d0000 2024-05-09T05:04:31.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858c400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f858406f2f0 con 0x7f858406ee90 2024-05-09T05:04:31.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858c400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8584167cd0 con 0x7f8584163b80 2024-05-09T05:04:31.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f56f1600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 0x7f56e40def70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858a400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85840d0000 0x7f85840d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.282+0000 7f858a400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f85840d0000 0x7f85840d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50038/0 (socket says 172.21.15.100:50038) 2024-05-09T05:04:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f56f1600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4046870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7fda5d000640 1 -- start start 2024-05-09T05:04:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f858a400640 1 -- 172.21.15.100:0/1668552217 learned_addr learned my addr 172.21.15.100:0/1668552217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f8589000640 1 --2- 172.21.15.100:0/1668552217 >> v2:172.21.15.133:3300/0 conn(0x7f858406ee90 0x7f85840cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f56f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 0x7f56e4046db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f858a400640 1 -- 172.21.15.100:0/1668552217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8584163b80 msgr2=0x7f8584168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f858a400640 1 --2- 172.21.15.100:0/1668552217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8584163b80 0x7f8584168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f56ebe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 0x7f56e40def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f3b61400640 1 Processor -- start 2024-05-09T05:04:31.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f3b61400640 1 -- start start 2024-05-09T05:04:31.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f858a400640 1 -- 172.21.15.100:0/1668552217 >> v2:172.21.15.133:3300/0 conn(0x7f858406ee90 msgr2=0x7f85840cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f858a400640 1 --2- 172.21.15.100:0/1668552217 >> v2:172.21.15.133:3300/0 conn(0x7f858406ee90 0x7f85840cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f858a400640 1 -- 172.21.15.100:0/1668552217 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85840ce310 con 0x7f85840d0000 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.283+0000 7f56ebe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 0x7f56e40def70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46224/0 (socket says 172.21.15.100:46224) 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7fda5d000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda50053e50 0x7fda500542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7fda5d000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda5004f930 0x7fda5004fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7fda5d000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda50050280 con 0x7fda50048100 2024-05-09T05:04:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7fda5d000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fda500e7b90 con 0x7fda50053e50 2024-05-09T05:04:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7fda5d000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fda50006a90 con 0x7fda5004f930 2024-05-09T05:04:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f858a400640 1 --2- 172.21.15.100:0/1668552217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85840d0000 0x7f85840d0460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f858406e080 tx=0x7f857c02a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf2d6c7a230995 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7fda55400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda50053e50 0x7fda500542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7fda56800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda5004f930 0x7fda5004fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7fda56800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda5004f930 0x7fda5004fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54752/0 (socket says 172.21.15.100:54752) 2024-05-09T05:04:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7fda56800640 1 -- 172.21.15.100:0/138010001 learned_addr learned my addr 172.21.15.100:0/138010001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7ff5ffc00640 1 Processor -- start 2024-05-09T05:04:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7ff5ffc00640 1 -- start start 2024-05-09T05:04:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f8583e00640 1 -- 172.21.15.100:0/1668552217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c037070 con 0x7f85840d0000 2024-05-09T05:04:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f8583e00640 1 -- 172.21.15.100:0/1668552217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c02ae30 con 0x7f85840d0000 2024-05-09T05:04:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f8583e00640 1 -- 172.21.15.100:0/1668552217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c032640 con 0x7f85840d0000 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7fda55400640 1 -- 172.21.15.100:0/138010001 >> v2:172.21.15.133:3300/0 conn(0x7fda5004f930 msgr2=0x7fda5004fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 0x7f56e4046db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 0x7f56e4046db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50048/0 (socket says 172.21.15.100:50048) 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56ebe00640 1 -- 172.21.15.100:0/1815469107 learned_addr learned my addr 172.21.15.100:0/1815469107 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56eb400640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4046870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40547c0 con 0x7f56e40ead00 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40501a0 con 0x7f56e40069e0 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.284+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f56e4054940 con 0x7f56e4005e90 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56f0c00640 1 -- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 msgr2=0x7f56e40def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56f0c00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 0x7f56e40def70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56f0c00640 1 -- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 msgr2=0x7f56e4046870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56f0c00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4046870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56f0c00640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e4047430 con 0x7f56e40ead00 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56ebe00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 0x7f56e40def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.285+0000 7f56eb400640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4046870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f3b61400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f3b61400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0d3870 0x7f3b5c1fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f3b61400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c15f8d0 0x7f3b5c1fdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f3b61400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b5ba0 con 0x7f3b5c15f8d0 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f3b61400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0d1000 con 0x7f3b5c0d31c0 2024-05-09T05:04:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f3b61400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b5d20 con 0x7f3b5c0d3870 2024-05-09T05:04:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 -- 172.21.15.100:0/1668552217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85840d0000 msgr2=0x7f85840d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 --2- 172.21.15.100:0/1668552217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85840d0000 0x7f85840d0460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f858406e080 tx=0x7f857c02a0e0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f56f0c00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 0x7f56e4046db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56ec06b320 tx=0x7f56ec06b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 -- 172.21.15.100:0/1668552217 shutdown_connections 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 --2- 172.21.15.100:0/1668552217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85840d0000 0x7f85840d0460 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 --2- 172.21.15.100:0/1668552217 >> v2:172.21.15.133:3300/0 conn(0x7f858406ee90 0x7f85840cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 --2- 172.21.15.100:0/1668552217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8584163b80 0x7f8584168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7f858c400640 1 -- 172.21.15.100:0/1668552217 >> 172.21.15.100:0/1668552217 conn(0x7f85840b2c90 msgr2=0x7f85840b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f8162ac0 0x7ff5f80b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7fda55400640 1 --2- 172.21.15.100:0/138010001 >> v2:172.21.15.133:3300/0 conn(0x7fda5004f930 0x7fda5004fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7fda55400640 1 -- 172.21.15.100:0/138010001 >> v1:172.21.15.133:6789/0 conn(0x7fda50048100 legacy=0x7fda50006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.286+0000 7fda55400640 1 -- 172.21.15.100:0/138010001 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda50005ec0 con 0x7fda50053e50 2024-05-09T05:04:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5ffc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5f80d3f90 0x7ff5f80b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5ffc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f8162ea0 con 0x7ff5f80d33b0 2024-05-09T05:04:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5ffc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f80d26d0 con 0x7ff5f80d3f90 2024-05-09T05:04:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f80b4960 con 0x7ff5f8162ac0 2024-05-09T05:04:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a8b10 con 0x7f56e40ead00 2024-05-09T05:04:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e4043720 con 0x7f56e40ead00 2024-05-09T05:04:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7fda55400640 1 --2- 172.21.15.100:0/138010001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50053e50 0x7fda500542e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda50037af0 tx=0x7fda4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1913e2f9ece5e5a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5fdc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5f80d3f90 0x7ff5f80b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5fd200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f8162ac0 0x7ff5f80b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5fdc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5f80d3f90 0x7ff5f80b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50070/0 (socket says 172.21.15.100:50070) 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7ff5fdc00640 1 -- 172.21.15.100:0/634742965 learned_addr learned my addr 172.21.15.100:0/634742965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f858c400640 1 -- 172.21.15.100:0/1668552217 shutdown_connections 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f3b5b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c15f8d0 0x7f3b5c1fdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f3b5a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f3b5a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0ba8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54760/0 (socket says 172.21.15.100:54760) 2024-05-09T05:04:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f3b5a800640 1 -- 172.21.15.100:0/1309494206 learned_addr learned my addr 172.21.15.100:0/1309494206 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.288+0000 7f858c400640 1 -- 172.21.15.100:0/1668552217 wait complete. 2024-05-09T05:04:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e4043ce0 con 0x7f56e40ead00 2024-05-09T05:04:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f3b59e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0d3870 0x7f3b5c1fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec0a8cb0 con 0x7f56e40ead00 2024-05-09T05:04:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.287+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a8b10 con 0x7f56e40ead00 2024-05-09T05:04:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.288+0000 7ff5fd200640 1 -- 172.21.15.100:0/634742965 >> v2:172.21.15.100:3300/0 conn(0x7ff5f80d3f90 msgr2=0x7ff5f80b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.288+0000 7ff5fd200640 1 --2- 172.21.15.100:0/634742965 >> v2:172.21.15.100:3300/0 conn(0x7ff5f80d3f90 0x7ff5f80b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.288+0000 7ff5fd200640 1 -- 172.21.15.100:0/634742965 >> v1:172.21.15.100:6789/0 conn(0x7ff5f80d33b0 legacy=0x7ff5f80d3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.289+0000 7f3b59e00640 1 -- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c0d31c0 msgr2=0x7f3b5c0ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.289+0000 7f3b59e00640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.289+0000 7f3b59e00640 1 -- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c15f8d0 msgr2=0x7f3b5c1fdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.289+0000 7f3b59e00640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c15f8d0 0x7f3b5c1fdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.289+0000 7f3b59e00640 1 -- 172.21.15.100:0/1309494206 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0cb5f0 con 0x7f3b5c0d3870 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.289+0000 7ff5fd200640 1 -- 172.21.15.100:0/634742965 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f80d1d30 con 0x7ff5f8162ac0 2024-05-09T05:04:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.290+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c8005290 con 0x7f56e40ead00 2024-05-09T05:04:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.290+0000 7fda54a00640 1 -- 172.21.15.100:0/138010001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48037070 con 0x7fda50053e50 2024-05-09T05:04:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.290+0000 7fda54a00640 1 -- 172.21.15.100:0/138010001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda48032440 con 0x7fda50053e50 2024-05-09T05:04:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.290+0000 7fda54a00640 1 -- 172.21.15.100:0/138010001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48032810 con 0x7fda50053e50 2024-05-09T05:04:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.290+0000 7ff5fd200640 1 --2- 172.21.15.100:0/634742965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f8162ac0 0x7ff5f80b40a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d3674538f4664f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.290+0000 7f858c400640 1 Processor -- start 2024-05-09T05:04:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7f858c400640 1 -- start start 2024-05-09T05:04:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7fda5d000640 1 -- 172.21.15.100:0/138010001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50053e50 msgr2=0x7fda500542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7fda5d000640 1 --2- 172.21.15.100:0/138010001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50053e50 0x7fda500542e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fda50037af0 tx=0x7fda4802a1a0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7f523d000640 1 Processor -- start 2024-05-09T05:04:31.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7fda5d000640 1 -- 172.21.15.100:0/138010001 shutdown_connections 2024-05-09T05:04:31.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7fda5d000640 1 --2- 172.21.15.100:0/138010001 >> v2:172.21.15.133:3300/0 conn(0x7fda5004f930 0x7fda5004fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7fda5d000640 1 --2- 172.21.15.100:0/138010001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda50053e50 0x7fda500542e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7fda5d000640 1 -- 172.21.15.100:0/138010001 >> 172.21.15.100:0/138010001 conn(0x7fda50009fe0 msgr2=0x7fda5000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.291+0000 7f523d000640 1 -- start start 2024-05-09T05:04:31.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56ec0b2440 con 0x7f56e40ead00 2024-05-09T05:04:31.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f3b59e00640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0d3870 0x7f3b5c1fd7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c031000 tx=0x7f3b4c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f858c400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858406ee90 0x7f85841590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f858c400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85840d0000 0x7f858409deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7fda5d000640 1 -- 172.21.15.100:0/138010001 shutdown_connections 2024-05-09T05:04:31.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f858c400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 0x7f858409ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f858c400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8584167960 con 0x7f858409e3f0 2024-05-09T05:04:31.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f858c400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8584167680 con 0x7f858406ee90 2024-05-09T05:04:31.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7f858c400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f85840cede0 con 0x7f85840d0000 2024-05-09T05:04:31.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.292+0000 7fda5d000640 1 -- 172.21.15.100:0/138010001 wait complete. 2024-05-09T05:04:31.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f858a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 0x7f858409ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f858a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 0x7f858409ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50076/0 (socket says 172.21.15.100:50076) 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f858a400640 1 -- 172.21.15.100:0/1605234129 learned_addr learned my addr 172.21.15.100:0/1605234129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f8589a00640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858406ee90 0x7f85841590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f8589000640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85840d0000 0x7f858409deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f523d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 0x7f52300eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f523d000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52300e7c00 con 0x7f52300061a0 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f523d000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5230057f20 con 0x7f52300e7820 2024-05-09T05:04:31.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f523d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f52300ebf50 con 0x7f5230038280 2024-05-09T05:04:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.293+0000 7f56dfe00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56cc0764d0 0x7f56cc078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56ec133d10 con 0x7f56e40ead00 2024-05-09T05:04:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f8589a00640 1 -- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85840d0000 msgr2=0x7f858409deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f8589a00640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85840d0000 0x7f858409deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f8589a00640 1 -- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 msgr2=0x7f858409ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f8589a00640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 0x7f858409ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f8589a00640 1 -- 172.21.15.100:0/1605234129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858409c660 con 0x7f858406ee90 2024-05-09T05:04:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f858a400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 0x7f858409ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:04:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f5236a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 0x7f52300eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f5236a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 0x7f52300eba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46264/0 (socket says 172.21.15.100:46264) 2024-05-09T05:04:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f5236a00640 1 -- 172.21.15.100:0/1089225201 learned_addr learned my addr 172.21.15.100:0/1089225201 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f56ebe00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56cc0764d0 0x7f56cc078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c041030 con 0x7f3b5c0d3870 2024-05-09T05:04:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.295+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c030500 con 0x7f3b5c0d3870 2024-05-09T05:04:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.295+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c037040 con 0x7f3b5c0d3870 2024-05-09T05:04:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7ff5f7400640 1 -- 172.21.15.100:0/634742965 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4037070 con 0x7ff5f8162ac0 2024-05-09T05:04:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.294+0000 7ff5f7400640 1 -- 172.21.15.100:0/634742965 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e402add0 con 0x7ff5f8162ac0 2024-05-09T05:04:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.295+0000 7f5236a00640 1 -- 172.21.15.100:0/1089225201 >> v1:172.21.15.133:6789/0 conn(0x7f52300e7820 legacy=0x7f52300eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.295+0000 7f5236a00640 1 -- 172.21.15.100:0/1089225201 >> v1:172.21.15.100:6789/0 conn(0x7f52300061a0 legacy=0x7f5230006630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.295+0000 7f5236a00640 1 -- 172.21.15.100:0/1089225201 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5230058200 con 0x7f5230038280 2024-05-09T05:04:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.295+0000 7ff5f7400640 1 -- 172.21.15.100:0/634742965 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4032660 con 0x7ff5f8162ac0 2024-05-09T05:04:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4ac404e030 con 0x7f4ac803a7e0 2024-05-09T05:04:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7ff5ffc00640 1 -- 172.21.15.100:0/634742965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f8162ac0 msgr2=0x7ff5f80b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/634742965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f8162ac0 0x7ff5f80b40a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402a080 comp rx=0 tx=0).stop 2024-05-09T05:04:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7f56ebe00640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56cc0764d0 0x7f56cc078990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56e0001120 tx=0x7f56e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7fda5d000640 1 Processor -- start 2024-05-09T05:04:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0cb8d0 con 0x7f3b5c0d3870 2024-05-09T05:04:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c0bae00 con 0x7f3b5c0d3870 2024-05-09T05:04:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7fda5d000640 1 -- start start 2024-05-09T05:04:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7f5236a00640 1 --2- 172.21.15.100:0/1089225201 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 0x7f52300eba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52240098a0 tx=0x7f522402a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911cb1dba1519fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7ff5ffc00640 1 -- 172.21.15.100:0/634742965 shutdown_connections 2024-05-09T05:04:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/634742965 >> v2:172.21.15.100:3300/0 conn(0x7ff5f80d3f90 0x7ff5f80b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/634742965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f8162ac0 0x7ff5f80b40a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7ff5ffc00640 1 -- 172.21.15.100:0/634742965 >> 172.21.15.100:0/634742965 conn(0x7ff5f809e5e0 msgr2=0x7ff5f80d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.296+0000 7f8589a00640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858406ee90 0x7f85841590b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f858406d840 tx=0x7f857000b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7ff5ffc00640 1 -- 172.21.15.100:0/634742965 shutdown_connections 2024-05-09T05:04:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570015020 con 0x7f858406ee90 2024-05-09T05:04:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858409c940 con 0x7f858406ee90 2024-05-09T05:04:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841ed400 con 0x7f858406ee90 2024-05-09T05:04:31.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c161320 con 0x7f3b5c0d3870 2024-05-09T05:04:31.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda5d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda50048100 0x7fda500cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7f5236000640 1 -- 172.21.15.100:0/1089225201 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224037070 con 0x7f5230038280 2024-05-09T05:04:31.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7f5236000640 1 -- 172.21.15.100:0/1089225201 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224032640 con 0x7f5230038280 2024-05-09T05:04:31.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda5d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda5004f930 0x7fda500496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda5d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50053e50 0x7fda50049c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda5d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda50006440 con 0x7fda5004f930 2024-05-09T05:04:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda5d000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fda50006160 con 0x7fda50053e50 2024-05-09T05:04:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda5d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fda50006720 con 0x7fda50048100 2024-05-09T05:04:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7f5236000640 1 -- 172.21.15.100:0/1089225201 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224032a10 con 0x7f5230038280 2024-05-09T05:04:31.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858406a630 con 0x7f858406ee90 2024-05-09T05:04:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.299+0000 7f523d000640 1 -- 172.21.15.100:0/1089225201 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 msgr2=0x7f52300eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.299+0000 7f523d000640 1 --2- 172.21.15.100:0/1089225201 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 0x7f52300eba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52240098a0 tx=0x7f522402a2e0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.299+0000 7f523d000640 1 -- 172.21.15.100:0/1089225201 shutdown_connections 2024-05-09T05:04:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.299+0000 7f523d000640 1 --2- 172.21.15.100:0/1089225201 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5230038280 0x7f52300eba10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.299+0000 7f523d000640 1 -- 172.21.15.100:0/1089225201 >> 172.21.15.100:0/1089225201 conn(0x7f52300559e0 msgr2=0x7f5230055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7f523d000640 1 -- 172.21.15.100:0/1089225201 shutdown_connections 2024-05-09T05:04:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.297+0000 7ff5ffc00640 1 -- 172.21.15.100:0/634742965 wait complete. 2024-05-09T05:04:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7ff5ffc00640 1 Processor -- start 2024-05-09T05:04:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8570011830 con 0x7f858406ee90 2024-05-09T05:04:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570011c20 con 0x7f858406ee90 2024-05-09T05:04:31.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda56800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50053e50 0x7fda50049c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda56800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50053e50 0x7fda50049c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54778/0 (socket says 172.21.15.100:54778) 2024-05-09T05:04:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda56800640 1 -- 172.21.15.100:0/1060245422 learned_addr learned my addr 172.21.15.100:0/1060245422 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.298+0000 7fda55400640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda5004f930 0x7fda500496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.299+0000 7fda55e00640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda50048100 0x7fda500cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7ff5ffc00640 1 -- start start 2024-05-09T05:04:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7f523d000640 1 -- 172.21.15.100:0/1089225201 wait complete. 2024-05-09T05:04:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7fda55400640 1 -- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda50048100 msgr2=0x7fda500cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7fda55400640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda50048100 0x7fda500cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7fda55400640 1 -- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50053e50 msgr2=0x7fda50049c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7fda55400640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50053e50 0x7fda50049c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.300+0000 7fda55400640 1 -- 172.21.15.100:0/1060245422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda500d01b0 con 0x7fda5004f930 2024-05-09T05:04:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.301+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5f80d33b0 0x7ff5f80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.301+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 0x7ff5f8158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.301+0000 7ff5ffc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8162ac0 0x7ff5f80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.301+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f80b45e0 con 0x7ff5f8162ac0 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.301+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f80d22f0 con 0x7ff5f80d33b0 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.301+0000 7ff5ffc00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f80b26b0 con 0x7ff5f80d3f90 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7efd85a00640 1 Processor -- start 2024-05-09T05:04:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3b4c044070 con 0x7f3b5c0d3870 2024-05-09T05:04:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7f523d000640 1 Processor -- start 2024-05-09T05:04:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7f523d000640 1 -- start start 2024-05-09T05:04:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 0x7ff5f8158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 0x7ff5f8158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46284/0 (socket says 172.21.15.100:46284) 2024-05-09T05:04:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7ff5f7e00640 1 -- 172.21.15.100:0/1721914864 learned_addr learned my addr 172.21.15.100:0/1721914864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7ff5fdc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8162ac0 0x7ff5f80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.302+0000 7efd85a00640 1 -- start start 2024-05-09T05:04:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7fda55400640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda5004f930 0x7fda500496f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda5000bad0 tx=0x7fda480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7f523d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52300061a0 0x7f523004e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7f523d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 0x7f52300e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56ec0c1060 con 0x7f56e40ead00 2024-05-09T05:04:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7f3b52a00640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3b3c0763a0 0x7f3b3c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b4c0b8570 con 0x7f3b5c0d3870 2024-05-09T05:04:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f523d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52300e7820 0x7f52300ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f523d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52300ec1a0 con 0x7f52300061a0 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f523d000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f52300587c0 con 0x7f5230038280 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7ff5f7e00640 1 -- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5f80d33b0 msgr2=0x7ff5f80c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7ff5f7e00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5f80d33b0 0x7ff5f80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7ff5f7e00640 1 -- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8162ac0 msgr2=0x7ff5f80cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7ff5f7e00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8162ac0 0x7ff5f80cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.303+0000 7ff5f7e00640 1 -- 172.21.15.100:0/1721914864 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f80ca5e0 con 0x7ff5f80d3f90 2024-05-09T05:04:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f523d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5230058ce0 con 0x7f52300e7820 2024-05-09T05:04:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd85a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd800d33b0 0x7efd800d3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd85a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd800d3dc0 0x7efd800b2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd85a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd80162ea0 con 0x7efd80162ac0 2024-05-09T05:04:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd85a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7efd800d26d0 con 0x7efd800d33b0 2024-05-09T05:04:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd85a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7efd800b4960 con 0x7efd800d3dc0 2024-05-09T05:04:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f5236a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 0x7f52300e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f5236a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 0x7f52300e9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:54796/0 (socket says 172.21.15.100:54796) 2024-05-09T05:04:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f5236a00640 1 -- 172.21.15.100:0/1310985079 learned_addr learned my addr 172.21.15.100:0/1310985079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7f5237e00640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52300e7820 0x7f52300ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7ff5f7e00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 0x7ff5f8158ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c450 tx=0x7ff5f000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd7e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd800d33b0 0x7efd800d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.304+0000 7efd7e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd800d33b0 0x7efd800d3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50126/0 (socket says 172.21.15.100:50126) 2024-05-09T05:04:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7efd7e000640 1 -- 172.21.15.100:0/3375065233 learned_addr learned my addr 172.21.15.100:0/3375065233 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48037050 con 0x7fda5004f930 2024-05-09T05:04:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda48043070 con 0x7fda5004f930 2024-05-09T05:04:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda48030b70 con 0x7fda5004f930 2024-05-09T05:04:31.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7efd7f400640 1 --2- 172.21.15.100:0/3375065233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd800d3dc0 0x7efd800b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7f5236a00640 1 -- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52300e7820 msgr2=0x7f52300ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7f5236a00640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52300e7820 0x7f52300ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7f5236a00640 1 -- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52300061a0 msgr2=0x7f523004e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7f5236a00640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52300061a0 0x7f523004e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7f5236a00640 1 -- 172.21.15.100:0/1310985079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523017e6b0 con 0x7f5230038280 2024-05-09T05:04:31.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7efd7e000640 1 -- 172.21.15.100:0/3375065233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd800d3dc0 msgr2=0x7efd800b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7efd7e000640 1 --2- 172.21.15.100:0/3375065233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd800d3dc0 0x7efd800b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7efd7e000640 1 -- 172.21.15.100:0/3375065233 >> v1:172.21.15.100:6789/0 conn(0x7efd80162ac0 legacy=0x7efd800b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.306+0000 7efd7e000640 1 -- 172.21.15.100:0/3375065233 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd800d1d30 con 0x7efd800d33b0 2024-05-09T05:04:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.305+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda50036bb0 con 0x7fda5004f930 2024-05-09T05:04:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.306+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda50037170 con 0x7fda5004f930 2024-05-09T05:04:31.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.306+0000 7f5236a00640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 0x7f52300e9dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5224000c00 tx=0x7f52240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.307+0000 7f3b5a800640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3b3c0763a0 0x7f3b3c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.308+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda500053c0 con 0x7fda5004f930 2024-05-09T05:04:31.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.308+0000 7efd7e000640 1 --2- 172.21.15.100:0/3375065233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d33b0 0x7efd800d3880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009870 tx=0x7efd6c02a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cf7db5394f469a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.308+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8570018020 con 0x7f858406ee90 2024-05-09T05:04:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.309+0000 7f3b5a800640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3b3c0763a0 0x7f3b3c078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000f60 tx=0x7f3b48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.309+0000 7f8581600640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.309+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85700979d0 con 0x7f858406ee90 2024-05-09T05:04:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.309+0000 7f8589000640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.310+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda48030d10 con 0x7fda5004f930 2024-05-09T05:04:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.311+0000 7efd7d600640 1 -- 172.21.15.100:0/3375065233 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c037070 con 0x7efd800d33b0 2024-05-09T05:04:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.311+0000 7efd7d600640 1 -- 172.21.15.100:0/3375065233 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c032440 con 0x7efd800d33b0 2024-05-09T05:04:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.311+0000 7efd7d600640 1 -- 172.21.15.100:0/3375065233 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c032810 con 0x7efd800d33b0 2024-05-09T05:04:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.311+0000 7fda4e000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fda38076320 0x7fda380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.310+0000 7f8589000640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8584163430 tx=0x7f857800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.311+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fda480b80c0 con 0x7fda5004f930 2024-05-09T05:04:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7fda55e00640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fda38076320 0x7fda380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 -- 172.21.15.100:0/3375065233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d33b0 msgr2=0x7efd800d3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 --2- 172.21.15.100:0/3375065233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d33b0 0x7efd800d3880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009870 tx=0x7efd6c02a120 comp rx=0 tx=0).stop 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 -- 172.21.15.100:0/3375065233 shutdown_connections 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 --2- 172.21.15.100:0/3375065233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd800d3dc0 0x7efd800b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 --2- 172.21.15.100:0/3375065233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d33b0 0x7efd800d3880 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 -- 172.21.15.100:0/3375065233 >> 172.21.15.100:0/3375065233 conn(0x7efd8009e5e0 msgr2=0x7efd800d52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 -- 172.21.15.100:0/3375065233 shutdown_connections 2024-05-09T05:04:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.313+0000 7fda55e00640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fda38076320 0x7fda380787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda50171250 tx=0x7fda44007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.312+0000 7efd85a00640 1 -- 172.21.15.100:0/3375065233 wait complete. 2024-05-09T05:04:31.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.315+0000 7efd85a00640 1 Processor -- start 2024-05-09T05:04:31.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.315+0000 7efd85a00640 1 -- start start 2024-05-09T05:04:31.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.316+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0016020 con 0x7ff5f80d3f90 2024-05-09T05:04:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.316+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3b4c082060 con 0x7f3b5c0d3870 2024-05-09T05:04:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0005310 con 0x7ff5f80d3f90 2024-05-09T05:04:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007260 con 0x7ff5f80d3f90 2024-05-09T05:04:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f80ca8c0 con 0x7ff5f80d3f90 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f80c8e70 con 0x7ff5f80d3f90 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7efd85a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800d33b0 0x7efd8015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7efd85a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d3dc0 0x7efd800b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7efd85a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd80162ac0 0x7efd800ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7efd85a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd800b26b0 con 0x7efd800d3dc0 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7efd85a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efd800d22f0 con 0x7efd800d33b0 2024-05-09T05:04:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.317+0000 7efd85a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7efd800b2830 con 0x7efd80162ac0 2024-05-09T05:04:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.318+0000 7efd7f400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd80162ac0 0x7efd800ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.318+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d0005290 con 0x7ff5f80d3f90 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.318+0000 7efd7e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d3dc0 0x7efd800b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.318+0000 7efd7f400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd80162ac0 0x7efd800ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:46304/0 (socket says 172.21.15.100:46304) 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.318+0000 7efd7f400640 1 -- 172.21.15.100:0/1166951047 learned_addr learned my addr 172.21.15.100:0/1166951047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.319+0000 7efd7ea00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800d33b0 0x7efd8015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.319+0000 7efd7e000640 1 -- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd80162ac0 msgr2=0x7efd800ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.319+0000 7efd7e000640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd80162ac0 0x7efd800ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.319+0000 7efd7e000640 1 -- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800d33b0 msgr2=0x7efd8015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.319+0000 7efd7e000640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800d33b0 0x7efd8015fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.319+0000 7efd7e000640 1 -- 172.21.15.100:0/1166951047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd800b4f50 con 0x7efd800d3dc0 2024-05-09T05:04:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.320+0000 7efd7e000640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d3dc0 0x7efd800b63c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd80163070 tx=0x7efd6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.321+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff5f0007400 con 0x7ff5f80d3f90 2024-05-09T05:04:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.321+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c041020 con 0x7efd800d3dc0 2024-05-09T05:04:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.321+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c030780 con 0x7efd800d3dc0 2024-05-09T05:04:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.321+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c037040 con 0x7efd800d3dc0 2024-05-09T05:04:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.322+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda50050280 con 0x7fda5004f930 2024-05-09T05:04:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.323+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224041020 con 0x7f5230038280 2024-05-09T05:04:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.321+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd800b5230 con 0x7efd800d3dc0 2024-05-09T05:04:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.323+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224030a70 con 0x7f5230038280 2024-05-09T05:04:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.323+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224037040 con 0x7f5230038280 2024-05-09T05:04:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.323+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd800b57f0 con 0x7efd800d3dc0 2024-05-09T05:04:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.323+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523017d8f0 con 0x7f5230038280 2024-05-09T05:04:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.323+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523017deb0 con 0x7f5230038280 2024-05-09T05:04:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.324+0000 7ff5f4c00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5d8076320 0x7ff5d80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.325+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f857001f020 con 0x7f858406ee90 2024-05-09T05:04:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.325+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52300057e0 con 0x7f5230038280 2024-05-09T05:04:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.325+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8006a630 con 0x7efd800d3dc0 2024-05-09T05:04:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.324+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f0097be0 con 0x7ff5f80d3f90 2024-05-09T05:04:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.328+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd6c044020 con 0x7efd800d3dc0 2024-05-09T05:04:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.328+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5224044020 con 0x7f5230038280 2024-05-09T05:04:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.329+0000 7f522b400640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52180762d0 0x7f5218078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.330+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f52240b8580 con 0x7f5230038280 2024-05-09T05:04:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.329+0000 7efd76a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efd600763a0 0x7efd60078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.330+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd6c0b7ce0 con 0x7efd800d3dc0 2024-05-09T05:04:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.330+0000 7efd7ea00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efd600763a0 0x7efd60078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.331+0000 7efd7ea00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efd600763a0 0x7efd60078860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd800b6ed0 tx=0x7efd70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.332+0000 7f5237400640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52180762d0 0x7f5218078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.333+0000 7f5237400640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52180762d0 0x7f5218078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f522c0015f0 tx=0x7f522c007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.333+0000 7ff5fd200640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5d8076320 0x7ff5d80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.334+0000 7ff5fd200640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5d8076320 0x7ff5d80787e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.335+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5f0020020 con 0x7ff5f80d3f90 2024-05-09T05:04:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.339+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd6c04b030 con 0x7efd800d3dc0 2024-05-09T05:04:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.343+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f522404b030 con 0x7f5230038280 2024-05-09T05:04:31.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.720+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4aac005850 con 0x7f4ac803a7e0 2024-05-09T05:04:31.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.721+0000 7f4accc00640 1 -- 172.21.15.100:0/1123342894 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ac4082380 con 0x7f4ac803a7e0 2024-05-09T05:04:31.723 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-05-09T05:04:31.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.725+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ab00763a0 msgr2=0x7f4ab0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.725+0000 7f4ad7400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ab00763a0 0x7f4ab0078860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80e0f50 tx=0x7f4abc009190 comp rx=0 tx=0).stop 2024-05-09T05:04:31.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 msgr2=0x7f4ac80e0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80e0690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ac403a000 tx=0x7f4ac40046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 shutdown_connections 2024-05-09T05:04:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ab00763a0 0x7f4ab0078860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac803ac40 0x7f4ac8188c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac803a7e0 0x7f4ac80e0690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 --2- 172.21.15.100:0/1123342894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac8004af0 0x7f4ac8034ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.726+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 >> 172.21.15.100:0/1123342894 conn(0x7f4ac800a3f0 msgr2=0x7f4ac804df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.727+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 shutdown_connections 2024-05-09T05:04:31.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.727+0000 7f4ad7400640 1 -- 172.21.15.100:0/1123342894 wait complete. 2024-05-09T05:04:31.747 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-05-09T05:04:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.743+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f56c8005580 con 0x7f56e40ead00 2024-05-09T05:04:31.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.744+0000 7f56dfe00640 1 -- 172.21.15.100:0/1815469107 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56ec0ae030 con 0x7f56e40ead00 2024-05-09T05:04:31.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.748+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56cc0764d0 msgr2=0x7f56cc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.748+0000 7f56f1600640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56cc0764d0 0x7f56cc078990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56e0001120 tx=0x7f56e0009040 comp rx=0 tx=0).stop 2024-05-09T05:04:31.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.748+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 msgr2=0x7f56e4046db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.748+0000 7f56f1600640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 0x7f56e4046db0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56ec06b320 tx=0x7f56ec06b7c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 shutdown_connections 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56cc0764d0 0x7f56cc078990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56e40ead00 0x7f56e4046db0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56e40069e0 0x7f56e4046870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 --2- 172.21.15.100:0/1815469107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56e4005e90 0x7f56e40def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 >> 172.21.15.100:0/1815469107 conn(0x7f56e4009fb0 msgr2=0x7f56e404a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 shutdown_connections 2024-05-09T05:04:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.749+0000 7f56f1600640 1 -- 172.21.15.100:0/1815469107 wait complete. 2024-05-09T05:04:31.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-05-09T05:04:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.768+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3b5c161150 con 0x7f3b5c0d3870 2024-05-09T05:04:31.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.769+0000 7f3b52a00640 1 -- 172.21.15.100:0/1309494206 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b4c081960 con 0x7f3b5c0d3870 2024-05-09T05:04:31.770 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:31.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.771+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f52300e6500 con 0x7f5230038280 2024-05-09T05:04:31.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.772+0000 7f522b400640 1 -- 172.21.15.100:0/1310985079 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5224081ec0 con 0x7f5230038280 2024-05-09T05:04:31.772 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:31.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.772+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3b3c0763a0 msgr2=0x7f3b3c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.772+0000 7f3b61400640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3b3c0763a0 0x7f3b3c078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000f60 tx=0x7f3b48009040 comp rx=0 tx=0).stop 2024-05-09T05:04:31.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.772+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0d3870 msgr2=0x7f3b5c1fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.772+0000 7f3b61400640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0d3870 0x7f3b5c1fd7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c031000 tx=0x7f3b4c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 shutdown_connections 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3b3c0763a0 0x7f3b3c078860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b5c15f8d0 0x7f3b5c1fdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3b5c0d3870 0x7f3b5c1fd7a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 --2- 172.21.15.100:0/1309494206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b5c0d31c0 0x7f3b5c0ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 >> 172.21.15.100:0/1309494206 conn(0x7f3b5c09e5d0 msgr2=0x7f3b5c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 shutdown_connections 2024-05-09T05:04:31.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f3b61400640 1 -- 172.21.15.100:0/1309494206 wait complete. 2024-05-09T05:04:31.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fda50052850 con 0x7fda5004f930 2024-05-09T05:04:31.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.773+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f85840ce7b0 con 0x7f858406ee90 2024-05-09T05:04:31.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.774+0000 7fda4e000640 1 -- 172.21.15.100:0/1060245422 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda48081440 con 0x7fda5004f930 2024-05-09T05:04:31.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-05-09T05:04:31.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.774+0000 7f8581600640 1 -- 172.21.15.100:0/1605234129 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8570060cc0 con 0x7f858406ee90 2024-05-09T05:04:31.776 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:31.777 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:31.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52180762d0 msgr2=0x7f5218078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52180762d0 0x7f5218078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f522c0015f0 tx=0x7f522c007970 comp rx=0 tx=0).stop 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 msgr2=0x7f52300e9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 0x7f52300e9dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5224000c00 tx=0x7f52240046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 shutdown_connections 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52180762d0 0x7f5218078790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52300e7820 0x7f52300ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5230038280 0x7f52300e9dc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 --2- 172.21.15.100:0/1310985079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52300061a0 0x7f523004e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.775+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 >> 172.21.15.100:0/1310985079 conn(0x7f52300559e0 msgr2=0x7f523003aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.776+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 shutdown_connections 2024-05-09T05:04:31.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.776+0000 7f523d000640 1 -- 172.21.15.100:0/1310985079 wait complete. 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.777+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fda38076320 msgr2=0x7fda380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.777+0000 7fda5d000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fda38076320 0x7fda380787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda50171250 tx=0x7fda44007e30 comp rx=0 tx=0).stop 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda5004f930 msgr2=0x7fda500496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda5004f930 0x7fda500496f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda5000bad0 tx=0x7fda480046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 shutdown_connections 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fda38076320 0x7fda380787e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50053e50 0x7fda50049c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda5004f930 0x7fda500496f0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda5000bad0 tx=0x7fda480046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 --2- 172.21.15.100:0/1060245422 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda50048100 0x7fda500cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 >> 172.21.15.100:0/1060245422 conn(0x7fda50009fe0 msgr2=0x7fda5004c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 shutdown_connections 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.778+0000 7fda5d000640 1 -- 172.21.15.100:0/1060245422 wait complete. 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 msgr2=0x7f8564078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8584163430 tx=0x7f857800b040 comp rx=0 tx=0).stop 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858406ee90 msgr2=0x7f85841590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858406ee90 0x7f85841590b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f858406d840 tx=0x7f857000b800 comp rx=0 tx=0).stop 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 shutdown_connections 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858409e3f0 0x7f858409ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85840d0000 0x7f858409deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 --2- 172.21.15.100:0/1605234129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858406ee90 0x7f85841590b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 >> 172.21.15.100:0/1605234129 conn(0x7f85840b2c90 msgr2=0x7f8584072400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 shutdown_connections 2024-05-09T05:04:31.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.779+0000 7f858c400640 1 -- 172.21.15.100:0/1605234129 wait complete. 2024-05-09T05:04:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.782+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efd800b59c0 con 0x7efd800d3dc0 2024-05-09T05:04:31.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.783+0000 7efd76a00640 1 -- 172.21.15.100:0/1166951047 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd6c080fd0 con 0x7efd800d3dc0 2024-05-09T05:04:31.783 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-05-09T05:04:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.785+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efd600763a0 msgr2=0x7efd60078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.785+0000 7efd85a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efd600763a0 0x7efd60078860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd800b6ed0 tx=0x7efd70009040 comp rx=0 tx=0).stop 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d3dc0 msgr2=0x7efd800b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d3dc0 0x7efd800b63c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd80163070 tx=0x7efd6c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 shutdown_connections 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efd600763a0 0x7efd60078860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd80162ac0 0x7efd800ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd800d3dc0 0x7efd800b63c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 --2- 172.21.15.100:0/1166951047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd800d33b0 0x7efd8015fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 >> 172.21.15.100:0/1166951047 conn(0x7efd8009e5e0 msgr2=0x7efd800d56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 shutdown_connections 2024-05-09T05:04:31.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.786+0000 7efd85a00640 1 -- 172.21.15.100:0/1166951047 wait complete. 2024-05-09T05:04:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.787+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff5d0005850 con 0x7ff5f80d3f90 2024-05-09T05:04:31.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.788+0000 7ff5f4c00640 1 -- 172.21.15.100:0/1721914864 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5f00616b0 con 0x7ff5f80d3f90 2024-05-09T05:04:31.789 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5d8076320 msgr2=0x7ff5d80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5d8076320 0x7ff5d80787e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402c000 comp rx=0 tx=0).stop 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 msgr2=0x7ff5f8158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 0x7ff5f8158ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c450 tx=0x7ff5f000c910 comp rx=0 tx=0).stop 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 shutdown_connections 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5d8076320 0x7ff5d80787e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40097a0 tx=0x7ff5e402c000 comp rx=0 tx=0).stop 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5f8162ac0 0x7ff5f80cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5f80d3f90 0x7ff5f8158ee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 --2- 172.21.15.100:0/1721914864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5f80d33b0 0x7ff5f80c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:31.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.790+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 >> 172.21.15.100:0/1721914864 conn(0x7ff5f809e5e0 msgr2=0x7ff5f8161d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:31.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.793+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 shutdown_connections 2024-05-09T05:04:31.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:31.793+0000 7ff5ffc00640 1 -- 172.21.15.100:0/1721914864 wait complete. 2024-05-09T05:04:31.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-05-09T05:04:31.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-05-09T05:04:31.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-05-09T05:04:31.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-05-09T05:04:31.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-05-09T05:04:31.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-05-09T05:04:32.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-09T05:04:32.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-09T05:04:32.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-09T05:04:32.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-09T05:04:32.807 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-09T05:04:32.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-09T05:04:32.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-09T05:04:32.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-09T05:04:33.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.012+0000 7f3655800640 1 Processor -- start 2024-05-09T05:04:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.013+0000 7f3655800640 1 -- start start 2024-05-09T05:04:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.015+0000 7f3655800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f364803ca70 0x7f3648054ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.015+0000 7f3655800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36480e7e30 con 0x7f36480548a0 2024-05-09T05:04:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.015+0000 7f3655800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f364803b5a0 con 0x7f36480e7a50 2024-05-09T05:04:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.015+0000 7f3655800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f364803b880 con 0x7f364803ca70 2024-05-09T05:04:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.017+0000 7f3654e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f364803ca70 0x7f3648054ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.017+0000 7f364f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f36480548a0 0x7f364803c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56840/0 (socket says 172.21.15.100:56840) 2024-05-09T05:04:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.017+0000 7f364fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f36480e7a50 0x7f3648049b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:34726/0 (socket says 172.21.15.100:34726) 2024-05-09T05:04:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.017+0000 7f364fe00640 1 -- 172.21.15.100:0/1997675351 learned_addr learned my addr 172.21.15.100:0/1997675351 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.017+0000 7f3654e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f364803ca70 0x7f3648054ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:52152/0 (socket says 172.21.15.100:52152) 2024-05-09T05:04:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.018+0000 7f3654e00640 1 -- 172.21.15.100:0/1997675351 >> v1:172.21.15.133:6789/0 conn(0x7f36480e7a50 legacy=0x7f3648049b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.019+0000 7f364ea00640 1 -- 172.21.15.100:0/1997675351 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293942384 0 0) 0x7f364803b5a0 con 0x7f36480e7a50 2024-05-09T05:04:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.019+0000 7f3654e00640 1 -- 172.21.15.100:0/1997675351 >> v1:172.21.15.100:6789/0 conn(0x7f36480548a0 legacy=0x7f364803c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.019+0000 7f3654e00640 1 -- 172.21.15.100:0/1997675351 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364803bb60 con 0x7f364803ca70 2024-05-09T05:04:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.021+0000 7f3654e00640 1 --2- 172.21.15.100:0/1997675351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f3648054ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36500515a0 tx=0x7f36500a6a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fee3e7aa4d97026 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.021+0000 7f364ea00640 1 -- 172.21.15.100:0/1997675351 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500af070 con 0x7f364803ca70 2024-05-09T05:04:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.025+0000 7f364ea00640 1 -- 172.21.15.100:0/1997675351 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36500ab6a0 con 0x7f364803ca70 2024-05-09T05:04:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.025+0000 7f364ea00640 1 -- 172.21.15.100:0/1997675351 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500abad0 con 0x7f364803ca70 2024-05-09T05:04:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.026+0000 7f3655800640 1 -- 172.21.15.100:0/1997675351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 msgr2=0x7f3648054ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.026+0000 7f3655800640 1 --2- 172.21.15.100:0/1997675351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f3648054ce0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f36500515a0 tx=0x7f36500a6a10 comp rx=0 tx=0).stop 2024-05-09T05:04:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.026+0000 7f3655800640 1 -- 172.21.15.100:0/1997675351 shutdown_connections 2024-05-09T05:04:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.026+0000 7f3655800640 1 --2- 172.21.15.100:0/1997675351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f3648054ce0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.027+0000 7f3655800640 1 -- 172.21.15.100:0/1997675351 >> 172.21.15.100:0/1997675351 conn(0x7f3648056cd0 msgr2=0x7f36480570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.027+0000 7f3655800640 1 -- 172.21.15.100:0/1997675351 shutdown_connections 2024-05-09T05:04:33.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.027+0000 7f3655800640 1 -- 172.21.15.100:0/1997675351 wait complete. 2024-05-09T05:04:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.031+0000 7f3655800640 1 Processor -- start 2024-05-09T05:04:33.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.031+0000 7f3655800640 1 -- start start 2024-05-09T05:04:33.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.033+0000 7f3655800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f36480ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.034+0000 7f3655800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36480548a0 0x7f364804a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.034+0000 7f3655800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36480e7a50 0x7f3648007f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.034+0000 7f364fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f36480ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.035+0000 7f364fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f36480ea990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:52162/0 (socket says 172.21.15.100:52162) 2024-05-09T05:04:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.035+0000 7f364fe00640 1 -- 172.21.15.100:0/2075790187 learned_addr learned my addr 172.21.15.100:0/2075790187 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.036+0000 7f3654e00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36480e7a50 0x7f3648007f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.036+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f364804a270 con 0x7f36480548a0 2024-05-09T05:04:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.036+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f364804a5b0 con 0x7f364803ca70 2024-05-09T05:04:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.036+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3648039cb0 con 0x7f36480e7a50 2024-05-09T05:04:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.036+0000 7f364f400640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36480548a0 0x7f364804a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.037+0000 7f3654e00640 1 -- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 msgr2=0x7f36480ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.037+0000 7f3654e00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f36480ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.037+0000 7f3654e00640 1 -- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36480548a0 msgr2=0x7f364804a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.037+0000 7f3654e00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36480548a0 0x7f364804a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.038+0000 7f3654e00640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364804d4f0 con 0x7f36480e7a50 2024-05-09T05:04:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.038+0000 7f364f400640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36480548a0 0x7f364804a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.039+0000 7f3654e00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36480e7a50 0x7f3648007f80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3650051a60 tx=0x7f365006b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.039+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500af040 con 0x7f36480e7a50 2024-05-09T05:04:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.040+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36500ace30 con 0x7f36480e7a50 2024-05-09T05:04:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.040+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364804d7d0 con 0x7f36480e7a50 2024-05-09T05:04:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.040+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500be610 con 0x7f36480e7a50 2024-05-09T05:04:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.042+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36480db900 con 0x7f36480e7a50 2024-05-09T05:04:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.043+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36480057e0 con 0x7f36480e7a50 2024-05-09T05:04:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.045+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f36500bc020 con 0x7f36480e7a50 2024-05-09T05:04:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.048+0000 7f3643e00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3630076300 0x7f36300787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.049+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f36501340d0 con 0x7f36480e7a50 2024-05-09T05:04:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.049+0000 7f364fe00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3630076300 0x7f36300787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.051+0000 7f364fe00640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3630076300 0x7f36300787c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f363c007fd0 tx=0x7f363c007220 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.056+0000 7fa290a00640 1 Processor -- start 2024-05-09T05:04:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.056+0000 7fa290a00640 1 -- start start 2024-05-09T05:04:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.058+0000 7fa290a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa28c15f4b0 0x7fa28c0d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.058+0000 7fa290a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa28c15f890 con 0x7fa28c0b6750 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.058+0000 7fa290a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa28c0d1130 con 0x7fa28c0d5130 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.058+0000 7fa290a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fa28c0d40e0 con 0x7fa28c15f4b0 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.059+0000 7fa28a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa28c0b6750 0x7fa28c0d33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56846/0 (socket says 172.21.15.100:56846) 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.059+0000 7fa28a800640 1 -- 172.21.15.100:0/3582858870 learned_addr learned my addr 172.21.15.100:0/3582858870 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.059+0000 7fa289e00640 1 --2- 172.21.15.100:0/3582858870 >> v2:172.21.15.133:3300/0 conn(0x7fa28c15f4b0 0x7fa28c0d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.060+0000 7fa288a00640 1 -- 172.21.15.100:0/3582858870 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557906434 0 0) 0x7fa28c15f890 con 0x7fa28c0b6750 2024-05-09T05:04:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.060+0000 7fa288a00640 1 -- 172.21.15.100:0/3582858870 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa270003520 con 0x7fa28c0b6750 2024-05-09T05:04:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.060+0000 7fa289e00640 1 -- 172.21.15.100:0/3582858870 >> v1:172.21.15.133:6789/0 conn(0x7fa28c0d5130 legacy=0x7fa28c0b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.060+0000 7fa288a00640 1 -- 172.21.15.100:0/3582858870 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 253231714 0 0) 0x7fa270003520 con 0x7fa28c0b6750 2024-05-09T05:04:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.060+0000 7fa289e00640 1 -- 172.21.15.100:0/3582858870 >> v1:172.21.15.100:6789/0 conn(0x7fa28c0b6750 legacy=0x7fa28c0d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.060+0000 7fa289e00640 1 -- 172.21.15.100:0/3582858870 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c0d0110 con 0x7fa28c15f4b0 2024-05-09T05:04:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.062+0000 7fa289e00640 1 --2- 172.21.15.100:0/3582858870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0d0bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0097a0 tx=0x7fa27c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97c34824cc912bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.063+0000 7fa288a00640 1 -- 172.21.15.100:0/3582858870 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c037070 con 0x7fa28c15f4b0 2024-05-09T05:04:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.063+0000 7fa288a00640 1 -- 172.21.15.100:0/3582858870 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c02ac50 con 0x7fa28c15f4b0 2024-05-09T05:04:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.063+0000 7fa288a00640 1 -- 172.21.15.100:0/3582858870 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284001aa0 con 0x7fa28c15f4b0 2024-05-09T05:04:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 -- 172.21.15.100:0/3582858870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 msgr2=0x7fa28c0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 --2- 172.21.15.100:0/3582858870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0d0bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0097a0 tx=0x7fa27c02a1c0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 -- 172.21.15.100:0/3582858870 shutdown_connections 2024-05-09T05:04:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 --2- 172.21.15.100:0/3582858870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0d0bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 -- 172.21.15.100:0/3582858870 >> 172.21.15.100:0/3582858870 conn(0x7fa28c08ebb0 msgr2=0x7fa28c09e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 -- 172.21.15.100:0/3582858870 shutdown_connections 2024-05-09T05:04:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.064+0000 7fa290a00640 1 -- 172.21.15.100:0/3582858870 wait complete. 2024-05-09T05:04:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.065+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36500fd470 con 0x7f36480e7a50 2024-05-09T05:04:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.066+0000 7fae2d600640 1 Processor -- start 2024-05-09T05:04:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.067+0000 7fa290a00640 1 Processor -- start 2024-05-09T05:04:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.067+0000 7fa290a00640 1 -- start start 2024-05-09T05:04:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa290a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 0x7fa28c15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa290a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa28c0d5130 0x7fa28c160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa290a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa290a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c0cfd90 con 0x7fa28c0b6750 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa290a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c0d06d0 con 0x7fa28c15f4b0 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa290a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa28c0d3ac0 con 0x7fa28c0d5130 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.066+0000 7fae2d600640 1 -- start start 2024-05-09T05:04:33.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fae2d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae20005e90 0x7fae200062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fa289e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 0x7fa28c15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 0x7fa28c15b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35752/0 (socket says 172.21.15.100:35752) 2024-05-09T05:04:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 -- 172.21.15.100:0/3455912429 learned_addr learned my addr 172.21.15.100:0/3455912429 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fae2d600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fae20006810 0x7fae20006c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289400640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa28c0d5130 0x7fa28c160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa28a800640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fae2d600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae20053720 con 0x7fae200ead00 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 -- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa28c0d5130 msgr2=0x7fa28c160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa28c0d5130 0x7fa28c160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 -- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 msgr2=0x7fa28c0ba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0ba3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fa289e00640 1 -- 172.21.15.100:0/3455912429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c15ba20 con 0x7fa28c0b6750 2024-05-09T05:04:33.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7f063ce00640 1 Processor -- start 2024-05-09T05:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fae2d600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fae20054330 con 0x7fae20006810 2024-05-09T05:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.069+0000 7fae2d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fae20053a00 con 0x7fae20005e90 2024-05-09T05:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fae27e00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae200ead00 0x7fae2004fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:34742/0 (socket says 172.21.15.100:34742) 2024-05-09T05:04:33.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fa289400640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa28c0d5130 0x7fa28c160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.070+0000 7fae27e00640 1 -- 172.21.15.100:0/3769173547 learned_addr learned my addr 172.21.15.100:0/3769173547 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:33.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7f063ce00640 1 -- start start 2024-05-09T05:04:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae2cc00640 1 --2- 172.21.15.100:0/3769173547 >> v2:172.21.15.100:3300/0 conn(0x7fae20006810 0x7fae20006c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338261173 0 0) 0x7fae20053720 con 0x7fae200ead00 2024-05-09T05:04:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae10003520 con 0x7fae200ead00 2024-05-09T05:04:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae27400640 1 --2- 172.21.15.100:0/3769173547 >> v2:172.21.15.133:3300/0 conn(0x7fae20005e90 0x7fae200062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fa289e00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 0x7fa28c15b4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa27c035040 tx=0x7fa27c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 475259826 0 0) 0x7fae10003520 con 0x7fae200ead00 2024-05-09T05:04:33.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 >> v2:172.21.15.133:3300/0 conn(0x7fae20005e90 msgr2=0x7fae200062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae26a00640 1 --2- 172.21.15.100:0/3769173547 >> v2:172.21.15.133:3300/0 conn(0x7fae20005e90 0x7fae200062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.071+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 >> v2:172.21.15.100:3300/0 conn(0x7fae20006810 msgr2=0x7fae20006c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 --2- 172.21.15.100:0/3769173547 >> v2:172.21.15.100:3300/0 conn(0x7fae20006810 0x7fae20006c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae20053ce0 con 0x7fae200ead00 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fae140016f0 con 0x7fae200ead00 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 >> v1:172.21.15.133:6789/0 conn(0x7fae200ead00 legacy=0x7fae2004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae10003a50 0x7fae10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae10004800 0x7fae10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae100051c0 0x7fae1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae20054330 con 0x7fae10004800 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fae20053a00 con 0x7fae100051c0 2024-05-09T05:04:33.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.072+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fae1000c140 con 0x7fae10003a50 2024-05-09T05:04:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c041020 con 0x7fa28c0b6750 2024-05-09T05:04:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c03d420 con 0x7fa28c0b6750 2024-05-09T05:04:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c037040 con 0x7fa28c0b6750 2024-05-09T05:04:33.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c15fbb0 con 0x7fa28c0b6750 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7f063ce00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06380d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7f063ce00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f063815fdc0 con 0x7f06380d5c40 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7f063ce00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06381600a0 con 0x7f063815f860 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7f063ce00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f0638160380 con 0x7f06380d3700 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.074+0000 7f0637400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06380d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.074+0000 7f0637e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f06380d5c40 0x7f06380cfda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56860/0 (socket says 172.21.15.100:56860) 2024-05-09T05:04:33.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.074+0000 7f0637e00640 1 -- 172.21.15.100:0/4109339355 learned_addr learned my addr 172.21.15.100:0/4109339355 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.074+0000 7fae27e00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae10003a50 0x7fae10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.075+0000 7f0637400640 1 -- 172.21.15.100:0/4109339355 >> v1:172.21.15.133:6789/0 conn(0x7f063815f860 legacy=0x7f06380d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.075+0000 7f0637400640 1 -- 172.21.15.100:0/4109339355 >> v1:172.21.15.100:6789/0 conn(0x7f06380d5c40 legacy=0x7f06380cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.075+0000 7fae2cc00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae100051c0 0x7fae1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.075+0000 7fae27400640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae10004800 0x7fae10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.073+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c160170 con 0x7fa28c0b6750 2024-05-09T05:04:33.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.076+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28c06a550 con 0x7fa28c0b6750 2024-05-09T05:04:33.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.075+0000 7f0637400640 1 -- 172.21.15.100:0/4109339355 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0638160660 con 0x7f06380d3700 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.076+0000 7fae2cc00640 1 -- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae10003a50 msgr2=0x7fae10003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.076+0000 7fae2cc00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae10003a50 0x7fae10003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.076+0000 7fae2cc00640 1 -- 172.21.15.100:0/3769173547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae10004800 msgr2=0x7fae10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.076+0000 7fae2cc00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae10004800 0x7fae10004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.076+0000 7fae2cc00640 1 -- 172.21.15.100:0/3769173547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae20053ce0 con 0x7fae100051c0 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.077+0000 7fae2cc00640 1 -- 172.21.15.100:0/3769173547 reap_dead start 2024-05-09T05:04:33.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.077+0000 7f0637400640 1 --2- 172.21.15.100:0/4109339355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06380d2f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f06280097d0 tx=0x7f062802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f871298e38fdbfab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.077+0000 7fae2cc00640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae100051c0 0x7fae1000b9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae2806baf0 tx=0x7fae10005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b921770ca39adbd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.078+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280516e0 con 0x7fae100051c0 2024-05-09T05:04:33.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.078+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae280a8720 con 0x7fae100051c0 2024-05-09T05:04:33.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.078+0000 7f0636000640 1 -- 172.21.15.100:0/4109339355 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628037070 con 0x7f06380d3700 2024-05-09T05:04:33.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.078+0000 7f0636000640 1 -- 172.21.15.100:0/4109339355 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0628032440 con 0x7f06380d3700 2024-05-09T05:04:33.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.078+0000 7f0636000640 1 -- 172.21.15.100:0/4109339355 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06280327f0 con 0x7f06380d3700 2024-05-09T05:04:33.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.079+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa27c044020 con 0x7fa28c0b6750 2024-05-09T05:04:33.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.079+0000 7f063ce00640 1 -- 172.21.15.100:0/4109339355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 msgr2=0x7f06380d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.079+0000 7f063ce00640 1 --2- 172.21.15.100:0/4109339355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06380d2f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f06280097d0 tx=0x7f062802a290 comp rx=0 tx=0).stop 2024-05-09T05:04:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.081+0000 7fa282000640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa26c0763d0 0x7fa26c078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.081+0000 7fa289400640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa26c0763d0 0x7fa26c078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.081+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa27c0b7e60 con 0x7fa28c0b6750 2024-05-09T05:04:33.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7f063ce00640 1 -- 172.21.15.100:0/4109339355 shutdown_connections 2024-05-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7f063ce00640 1 --2- 172.21.15.100:0/4109339355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06380d2f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.079+0000 7fae2d600640 1 -- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae100051c0 msgr2=0x7fae1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7fae26a00640 1 -- 172.21.15.100:0/3769173547 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280516e0 con 0x7fae100051c0 2024-05-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7fae2d600640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae100051c0 0x7fae1000b9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae2806baf0 tx=0x7fae10005830 comp rx=0 tx=0).stop 2024-05-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7f063ce00640 1 -- 172.21.15.100:0/4109339355 >> 172.21.15.100:0/4109339355 conn(0x7f06380d5120 msgr2=0x7f06380d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7fae2d600640 1 -- 172.21.15.100:0/3769173547 shutdown_connections 2024-05-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7f063ce00640 1 -- 172.21.15.100:0/4109339355 shutdown_connections 2024-05-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7fae2d600640 1 --2- 172.21.15.100:0/3769173547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae100051c0 0x7fae1000b9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7fae2d600640 1 -- 172.21.15.100:0/3769173547 >> 172.21.15.100:0/3769173547 conn(0x7fae20009fb0 msgr2=0x7fae2000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.083+0000 7fae2d600640 1 -- 172.21.15.100:0/3769173547 shutdown_connections 2024-05-09T05:04:33.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.083+0000 7fae2d600640 1 -- 172.21.15.100:0/3769173547 wait complete. 2024-05-09T05:04:33.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.082+0000 7f063ce00640 1 -- 172.21.15.100:0/4109339355 wait complete. 2024-05-09T05:04:33.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.085+0000 7f063ce00640 1 Processor -- start 2024-05-09T05:04:33.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.085+0000 7f063ce00640 1 -- start start 2024-05-09T05:04:33.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.086+0000 7fae2d600640 1 Processor -- start 2024-05-09T05:04:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.087+0000 7fae2d600640 1 -- start start 2024-05-09T05:04:33.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.087+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa27c04b030 con 0x7fa28c0b6750 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.088+0000 7f063ce00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06382039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.088+0000 7f063ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06380d5c40 0x7f063815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.088+0000 7f063ce00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 0x7f06380a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f063ce00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06380d0630 con 0x7f06380d5c40 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f0637400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06382039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f0637e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 0x7f06380a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f0637e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 0x7f06380a27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:52192/0 (socket says 172.21.15.100:52192) 2024-05-09T05:04:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f0637e00640 1 -- 172.21.15.100:0/2264022808 learned_addr learned my addr 172.21.15.100:0/2264022808 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f063ce00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f06380d04b0 con 0x7f063815f860 2024-05-09T05:04:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f063ce00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f06380d07b0 con 0x7f06380d3700 2024-05-09T05:04:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.089+0000 7f0636a00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06380d5c40 0x7f063815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.090+0000 7fae2d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae100051c0 0x7fae200dd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fa289400640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa26c0763d0 0x7fa26c078890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa278007fd0 tx=0x7fa278009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7f0636a00640 1 -- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 msgr2=0x7f06382039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7f0636a00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06382039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7f0636a00640 1 -- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 msgr2=0x7f06380a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7f0636a00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 0x7f06380a27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7f0636a00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06380cc290 con 0x7f06380d5c40 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.090+0000 7fae2d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae200dabe0 0x7fae200dbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.090+0000 7fae2d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae200db060 0x7fae200dbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae2d600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae20054940 con 0x7fae100051c0 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae2d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fae200547c0 con 0x7fae200dabe0 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae2d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fae2004f550 con 0x7fae200db060 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae100051c0 0x7fae200dd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae100051c0 0x7fae200dd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35784/0 (socket says 172.21.15.100:35784) 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae2cc00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae200db060 0x7fae200dbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae27400640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae200dabe0 0x7fae200dbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.091+0000 7fae27e00640 1 -- 172.21.15.100:0/216238636 learned_addr learned my addr 172.21.15.100:0/216238636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7fae2cc00640 1 -- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae200dabe0 msgr2=0x7fae200dbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7f0637e00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 0x7f06380a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:04:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7fae2cc00640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae200dabe0 0x7fae200dbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7fae2cc00640 1 -- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae100051c0 msgr2=0x7fae200dd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7fae2cc00640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae100051c0 0x7fae200dd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.092+0000 7fae2cc00640 1 -- 172.21.15.100:0/216238636 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae200dc520 con 0x7fae200db060 2024-05-09T05:04:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.093+0000 7f0636a00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06380d5c40 0x7f063815e4e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f062400c340 tx=0x7f062400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.093+0000 7fae2cc00640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae200db060 0x7fae200dbfe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae280750a0 tx=0x7fae2806ae30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.093+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624017070 con 0x7f06380d5c40 2024-05-09T05:04:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.093+0000 7f063ce00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06380cc500 con 0x7f06380d5c40 2024-05-09T05:04:33.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.094+0000 7f063ce00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0638203f20 con 0x7f06380d5c40 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.093+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280ba070 con 0x7fae200db060 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.094+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae200dc790 con 0x7fae200db060 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.094+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae200dcd50 con 0x7fae200db060 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.094+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae280516e0 con 0x7fae200db060 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.094+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae280ba070 con 0x7fae200db060 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.096+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06240052d0 con 0x7f06380d5c40 2024-05-09T05:04:33.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.096+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0610005290 con 0x7f06380d5c40 2024-05-09T05:04:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.096+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624021060 con 0x7f06380d5c40 2024-05-09T05:04:33.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.097+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae04005290 con 0x7fae200db060 2024-05-09T05:04:33.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.101+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f062401a070 con 0x7f06380d5c40 2024-05-09T05:04:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.102+0000 7f062f400640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06180762d0 0x7f0618078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.103+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0624097370 con 0x7f06380d5c40 2024-05-09T05:04:33.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.104+0000 7f0637400640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06180762d0 0x7f0618078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.106+0000 7f0637400640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06180762d0 0x7f0618078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0628034000 tx=0x7f062802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.106+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0624060660 con 0x7f06380d5c40 2024-05-09T05:04:33.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.106+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae280a9a00 con 0x7fae200db060 2024-05-09T05:04:33.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.108+0000 7fae1be00640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fae080764d0 0x7fae08078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.108+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fae281336a0 con 0x7fae200db060 2024-05-09T05:04:33.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.109+0000 7fae27e00640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fae080764d0 0x7fae08078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.110+0000 7fae27e00640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fae080764d0 0x7fae08078990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae14005bb0 tx=0x7fae14007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.114+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fae280b0030 con 0x7fae200db060 2024-05-09T05:04:33.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.140+0000 7f1e84e00640 1 Processor -- start 2024-05-09T05:04:33.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.141+0000 7f45bb200640 1 Processor -- start 2024-05-09T05:04:33.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.140+0000 7f1e84e00640 1 -- start start 2024-05-09T05:04:33.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.142+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 0x7f1e800d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.142+0000 7f1e84e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e800d5c40 0x7f1e800cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.142+0000 7f1e84e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8015fdc0 con 0x7f1e8015f860 2024-05-09T05:04:33.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.142+0000 7f1e84e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f1e801600a0 con 0x7f1e800d5c40 2024-05-09T05:04:33.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.142+0000 7f1e84e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1e80160380 con 0x7f1e800d3700 2024-05-09T05:04:33.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 0x7f1e800d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 0x7f1e800d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52278/0 (socket says 172.21.15.100:52278) 2024-05-09T05:04:33.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f1e7ea00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1e8015f860 0x7f1e800d3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:34768/0 (socket says 172.21.15.100:34768) 2024-05-09T05:04:33.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f1e7f400640 1 -- 172.21.15.100:0/2518333630 learned_addr learned my addr 172.21.15.100:0/2518333630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.141+0000 7f45bb200640 1 -- start start 2024-05-09T05:04:33.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f45bb200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 0x7f45b40d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f45bb200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b40d1240 con 0x7f45b40d1c10 2024-05-09T05:04:33.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f45bb200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45b40d2e90 con 0x7f45b415f6f0 2024-05-09T05:04:33.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f45bb200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f45b40d3170 con 0x7f45b40d5e00 2024-05-09T05:04:33.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.143+0000 7f1e7fe00640 1 --2- 172.21.15.100:0/2518333630 >> v2:172.21.15.133:3300/0 conn(0x7f1e800d5c40 0x7f1e800cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f1e7e000640 1 -- 172.21.15.100:0/2518333630 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4265709031 0 0) 0x7f1e8015fdc0 con 0x7f1e8015f860 2024-05-09T05:04:33.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f1e7e000640 1 -- 172.21.15.100:0/2518333630 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e64003520 con 0x7f1e8015f860 2024-05-09T05:04:33.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f1e7f400640 1 -- 172.21.15.100:0/2518333630 >> v2:172.21.15.133:3300/0 conn(0x7f1e800d5c40 msgr2=0x7f1e800cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f1e7f400640 1 --2- 172.21.15.100:0/2518333630 >> v2:172.21.15.133:3300/0 conn(0x7f1e800d5c40 0x7f1e800cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f45b9200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f45b40d1c10 0x7f45b40b4ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56874/0 (socket says 172.21.15.100:56874) 2024-05-09T05:04:33.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f1e7f400640 1 -- 172.21.15.100:0/2518333630 >> v1:172.21.15.133:6789/0 conn(0x7f1e8015f860 legacy=0x7f1e800d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f45b9200640 1 -- 172.21.15.100:0/2580933581 learned_addr learned my addr 172.21.15.100:0/2580933581 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:33.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f1e7f400640 1 -- 172.21.15.100:0/2518333630 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e80160660 con 0x7f1e800d3700 2024-05-09T05:04:33.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f9257400640 1 Processor -- start 2024-05-09T05:04:33.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.144+0000 7f45b3400640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 0x7f45b40d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.145+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404734980 0 0) 0x7f45b40d1240 con 0x7f45b40d1c10 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.145+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4598003520 con 0x7f45b40d1c10 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.145+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470332878 0 0) 0x7f45b40d2e90 con 0x7f45b415f6f0 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.145+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45980048e0 con 0x7f45b415f6f0 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3352986401 0 0) 0x7f4598003520 con 0x7f45b40d1c10 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 msgr2=0x7f45b40d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 0x7f45b40d3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 >> v1:172.21.15.133:6789/0 conn(0x7f45b415f6f0 legacy=0x7f45b40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b40d3450 con 0x7f45b40d1c10 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f45a40016d0 con 0x7f45b40d1c10 2024-05-09T05:04:33.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 >> v1:172.21.15.100:6789/0 conn(0x7f45b40d1c10 legacy=0x7f45b40b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4598004df0 0x7f45980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 0x7f45980037e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4598003db0 0x7f4598004230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40d3170 con 0x7f4598003db0 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f459800bc20 con 0x7f4598004df0 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f459800be20 con 0x7f45b40d5e00 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.145+0000 7f1e7f400640 1 --2- 172.21.15.100:0/2518333630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 0x7f1e800d2f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009870 tx=0x7f1e7002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35dea1e27f66ff8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f1e7e000640 1 -- 172.21.15.100:0/2518333630 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70037070 con 0x7f1e800d3700 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f1e7e000640 1 -- 172.21.15.100:0/2518333630 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e70032440 con 0x7f1e800d3700 2024-05-09T05:04:33.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f1e7e000640 1 -- 172.21.15.100:0/2518333630 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70032810 con 0x7f1e800d3700 2024-05-09T05:04:33.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.146+0000 7f9257400640 1 -- start start 2024-05-09T05:04:33.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f1e84e00640 1 -- 172.21.15.100:0/2518333630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 msgr2=0x7f1e800d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b9200640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4598003db0 0x7f4598004230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f1e84e00640 1 --2- 172.21.15.100:0/2518333630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 0x7f1e800d2f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009870 tx=0x7f1e7002a250 comp rx=0 tx=0).stop 2024-05-09T05:04:33.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f1e84e00640 1 -- 172.21.15.100:0/2518333630 shutdown_connections 2024-05-09T05:04:33.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7fb0aaa00640 1 Processor -- start 2024-05-09T05:04:33.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.148+0000 7f1e84e00640 1 --2- 172.21.15.100:0/2518333630 >> v2:172.21.15.133:3300/0 conn(0x7f1e800d5c40 0x7f1e800cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.148+0000 7f1e84e00640 1 --2- 172.21.15.100:0/2518333630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e800d3700 0x7f1e800d2f00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.148+0000 7f1e84e00640 1 -- 172.21.15.100:0/2518333630 >> 172.21.15.100:0/2518333630 conn(0x7f1e800d5120 msgr2=0x7f1e800d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.148+0000 7fb0aaa00640 1 -- start start 2024-05-09T05:04:33.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.148+0000 7f1e84e00640 1 -- 172.21.15.100:0/2518333630 shutdown_connections 2024-05-09T05:04:33.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.149+0000 7f1e84e00640 1 -- 172.21.15.100:0/2518333630 wait complete. 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b3400640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 0x7f45980037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b9200640 1 -- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 msgr2=0x7f45980037e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b9200640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f45b40d5e00 0x7f45980037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b9200640 1 -- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4598004df0 msgr2=0x7f45980051d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b9200640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4598004df0 0x7f45980051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.147+0000 7f45b9200640 1 -- 172.21.15.100:0/2580933581 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b40d3450 con 0x7f4598003db0 2024-05-09T05:04:33.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.149+0000 7f45b9200640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4598003db0 0x7f4598004230 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45a400c0e0 tx=0x7f4598005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1dfbe982961d2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.149+0000 7f9257400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f925015f6f0 0x7f92500d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.149+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4007c20 con 0x7f4598003db0 2024-05-09T05:04:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.149+0000 7f924fe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92500d5e00 0x7f92500d3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:34790/0 (socket says 172.21.15.100:34790) 2024-05-09T05:04:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.149+0000 7f924fe00640 1 -- 172.21.15.100:0/2217273484 learned_addr learned my addr 172.21.15.100:0/2217273484 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.150+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92500d1240 con 0x7f92500d1c10 2024-05-09T05:04:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.150+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92500d2e90 con 0x7f92500d5e00 2024-05-09T05:04:33.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.150+0000 7f9254a00640 1 --2- 172.21.15.100:0/2217273484 >> v2:172.21.15.100:3300/0 conn(0x7f925015f6f0 0x7f92500d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.150+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45a4004aa0 con 0x7f4598003db0 2024-05-09T05:04:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.150+0000 7f45bb200640 1 -- 172.21.15.100:0/2580933581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4598003db0 msgr2=0x7f4598004230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.151+0000 7f45b2a00640 1 -- 172.21.15.100:0/2580933581 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4007c20 con 0x7f4598003db0 2024-05-09T05:04:33.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.151+0000 7f45bb200640 1 --2- 172.21.15.100:0/2580933581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4598003db0 0x7f4598004230 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45a400c0e0 tx=0x7f4598005830 comp rx=0 tx=0).stop 2024-05-09T05:04:33.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.151+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f92500d3170 con 0x7f925015f6f0 2024-05-09T05:04:33.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.151+0000 7f45b9200640 1 -- 172.21.15.100:0/2580933581 reap_dead start 2024-05-09T05:04:33.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.151+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131652533 0 0) 0x7f92500d2e90 con 0x7f92500d5e00 2024-05-09T05:04:33.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.151+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9238003520 con 0x7f92500d5e00 2024-05-09T05:04:33.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f45bb200640 1 -- 172.21.15.100:0/2580933581 shutdown_connections 2024-05-09T05:04:33.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f45bb200640 1 -- 172.21.15.100:0/2580933581 >> 172.21.15.100:0/2580933581 conn(0x7f45b409e600 msgr2=0x7f45b40d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 71483686 0 0) 0x7f9238003520 con 0x7f92500d5e00 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 >> v2:172.21.15.100:3300/0 conn(0x7f925015f6f0 msgr2=0x7f92500d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 --2- 172.21.15.100:0/2217273484 >> v2:172.21.15.100:3300/0 conn(0x7f925015f6f0 0x7f92500d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 >> v1:172.21.15.100:6789/0 conn(0x7f92500d1c10 legacy=0x7f92500b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92500d3450 con 0x7f92500d5e00 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f92440016f0 con 0x7f92500d5e00 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 >> v1:172.21.15.133:6789/0 conn(0x7f92500d5e00 legacy=0x7f92500d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238003a50 0x7f9238003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9238004800 0x7f9238004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92380051c0 0x7f923800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92500d3170 con 0x7f9238004800 2024-05-09T05:04:33.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f45bb200640 1 -- 172.21.15.100:0/2580933581 shutdown_connections 2024-05-09T05:04:33.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f45bb200640 1 -- 172.21.15.100:0/2580933581 wait complete. 2024-05-09T05:04:33.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f92380148d0 con 0x7f9238003a50 2024-05-09T05:04:33.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.152+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9238014ad0 con 0x7f92380051c0 2024-05-09T05:04:33.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f9254a00640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238003a50 0x7f9238003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f924fe00640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9238004800 0x7f9238004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f1e84e00640 1 Processor -- start 2024-05-09T05:04:33.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f9255400640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92380051c0 0x7f923800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.154+0000 7f1e84e00640 1 -- start start 2024-05-09T05:04:33.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f9254a00640 1 -- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92380051c0 msgr2=0x7f923800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.153+0000 7f9254a00640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92380051c0 0x7f923800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.154+0000 7f9254a00640 1 -- 172.21.15.100:0/2217273484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9238004800 msgr2=0x7f9238004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.154+0000 7f9254a00640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9238004800 0x7f9238004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.154+0000 7f9254a00640 1 -- 172.21.15.100:0/2217273484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92500d3450 con 0x7f9238003a50 2024-05-09T05:04:33.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.154+0000 7f9255400640 1 -- 172.21.15.100:0/2217273484 reap_dead start 2024-05-09T05:04:33.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7fb0aaa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a4162cf0 0x7fb0a40d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7f9254a00640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238003a50 0x7f9238003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f923c009ac0 tx=0x7f9238005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be5acdc17db38b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7fb0aaa00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0a40d5cc0 0x7fb0a40d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7fb0aaa00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a41630d0 con 0x7fb0a40b5d30 2024-05-09T05:04:33.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7fb0aaa00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a40d0fb0 con 0x7fb0a40d5cc0 2024-05-09T05:04:33.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7fb0aaa00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a40d44c0 con 0x7fb0a4162cf0 2024-05-09T05:04:33.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.155+0000 7f45bb200640 1 Processor -- start 2024-05-09T05:04:33.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7fb0a9600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a4162cf0 0x7fb0a40d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7fb0a9600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a4162cf0 0x7fb0a40d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52304/0 (socket says 172.21.15.100:52304) 2024-05-09T05:04:33.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7fb0a9600640 1 -- 172.21.15.100:0/4042317986 learned_addr learned my addr 172.21.15.100:0/4042317986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c036070 con 0x7f9238003a50 2024-05-09T05:04:33.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7f924f400640 1 -- 172.21.15.100:0/2217273484 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c031400 con 0x7f9238003a50 2024-05-09T05:04:33.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7f45bb200640 1 -- start start 2024-05-09T05:04:33.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.156+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 0x7f1e800b9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7fb0a8c00640 1 --2- 172.21.15.100:0/4042317986 >> v2:172.21.15.133:3300/0 conn(0x7fb0a40d5cc0 0x7fb0a40d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e800d5c40 0x7f1e801edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7f1e84e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e8015f860 0x7f1e801ee220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238003a50 msgr2=0x7f9238003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7f9257400640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238003a50 0x7f9238003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f923c009ac0 tx=0x7f9238005830 comp rx=0 tx=0).stop 2024-05-09T05:04:33.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 0x7f1e800b9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7fb0a8c00640 1 -- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a4162cf0 msgr2=0x7fb0a40d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7fb0a8c00640 1 --2- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a4162cf0 0x7fb0a40d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7fb0a8c00640 1 -- 172.21.15.100:0/4042317986 >> v1:172.21.15.133:6789/0 conn(0x7fb0a40b5d30 legacy=0x7fb0a40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.157+0000 7fb0a8c00640 1 -- 172.21.15.100:0/4042317986 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a40d41e0 con 0x7fb0a40d5cc0 2024-05-09T05:04:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45bb200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4598003db0 0x7f45b4160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45bb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 0x7f45b4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45bb200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b40cd340 0x7f45b4161f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45bb200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40b5340 con 0x7f45b41614b0 2024-05-09T05:04:33.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45bb200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f45b40b51c0 con 0x7f45b40cd340 2024-05-09T05:04:33.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45bb200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f45b40b54c0 con 0x7f4598003db0 2024-05-09T05:04:33.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f1e7f400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 0x7f1e800b9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:52234/0 (socket says 172.21.15.100:52234) 2024-05-09T05:04:33.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 shutdown_connections 2024-05-09T05:04:33.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f9257400640 1 --2- 172.21.15.100:0/2217273484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9238003a50 0x7f9238003e70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 >> 172.21.15.100:0/2217273484 conn(0x7f925009e600 msgr2=0x7f92500d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f1e7f400640 1 -- 172.21.15.100:0/1291712156 learned_addr learned my addr 172.21.15.100:0/1291712156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f1e7fe00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e8015f860 0x7f1e801ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45b3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 0x7f45b4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45b3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 0x7f45b4158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35836/0 (socket says 172.21.15.100:35836) 2024-05-09T05:04:33.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.158+0000 7f45b3400640 1 -- 172.21.15.100:0/3653741683 learned_addr learned my addr 172.21.15.100:0/3653741683 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e800d0460 con 0x7f1e800d5c40 2024-05-09T05:04:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1e800d02e0 con 0x7f1e800d3700 2024-05-09T05:04:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1e800d05e0 con 0x7f1e8015f860 2024-05-09T05:04:33.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f45b9200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b40cd340 0x7f45b4161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 shutdown_connections 2024-05-09T05:04:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f9257400640 1 -- 172.21.15.100:0/2217273484 wait complete. 2024-05-09T05:04:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7f45b3400640 1 -- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4598003db0 msgr2=0x7f45b4160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.159+0000 7fb0a8c00640 1 --2- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 0x7fb0a40d1bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0900097a0 tx=0x7fb09002a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea93bf3b69afab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b3e00640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4598003db0 0x7f45b4160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b3400640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4598003db0 0x7f45b4160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b3400640 1 -- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b40cd340 msgr2=0x7f45b4161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b3400640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b40cd340 0x7f45b4161f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b3400640 1 -- 172.21.15.100:0/3653741683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b4160f50 con 0x7f45b41614b0 2024-05-09T05:04:33.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f1e7ea00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e800d5c40 0x7f1e801edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b3e00640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4598003db0 0x7f45b4160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:33.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7f45b9200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b40cd340 0x7f45b4161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:33.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7fb0a3e00640 1 -- 172.21.15.100:0/4042317986 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090037070 con 0x7fb0a40d5cc0 2024-05-09T05:04:33.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7fb0a3e00640 1 -- 172.21.15.100:0/4042317986 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09002ae30 con 0x7fb0a40d5cc0 2024-05-09T05:04:33.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.160+0000 7fb0a3e00640 1 -- 172.21.15.100:0/4042317986 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090032640 con 0x7fb0a40d5cc0 2024-05-09T05:04:33.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f1e7fe00640 1 -- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 msgr2=0x7f1e800b9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f45b3400640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 0x7f45b4158880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f459c010c00 tx=0x7f459c00e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f1e7fe00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 0x7f1e800b9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f1e7fe00640 1 -- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e800d5c40 msgr2=0x7f1e801edce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c00f040 con 0x7f45b41614b0 2024-05-09T05:04:33.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c00ebf0 con 0x7f45b41614b0 2024-05-09T05:04:33.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b4160c70 con 0x7f45b41614b0 2024-05-09T05:04:33.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f1e7fe00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e800d5c40 0x7f1e801edce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c01c400 con 0x7f45b41614b0 2024-05-09T05:04:33.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7fb0aaa00640 1 -- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 msgr2=0x7fb0a40d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 0x7fb0a40d1bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0900097a0 tx=0x7fb09002a0e0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7fb0aaa00640 1 -- 172.21.15.100:0/4042317986 shutdown_connections 2024-05-09T05:04:33.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 0x7fb0a40d1bb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/4042317986 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a4162cf0 0x7fb0a40d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b40b9770 con 0x7f45b41614b0 2024-05-09T05:04:33.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7fb0aaa00640 1 -- 172.21.15.100:0/4042317986 >> 172.21.15.100:0/4042317986 conn(0x7fb0a40d51a0 msgr2=0x7fb0a40d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7fb0aaa00640 1 -- 172.21.15.100:0/4042317986 shutdown_connections 2024-05-09T05:04:33.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f1e7fe00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8009f970 con 0x7f1e8015f860 2024-05-09T05:04:33.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7f9257400640 1 Processor -- start 2024-05-09T05:04:33.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.161+0000 7f1e7f400640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 0x7f1e800b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:04:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7f1e7ea00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e800d5c40 0x7f1e801edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:33.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.163+0000 7f9257400640 1 -- start start 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.164+0000 7f1e7fe00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e8015f860 0x7f1e801ee220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800efc0 tx=0x7f1e7800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.164+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78018020 con 0x7f1e8015f860 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.164+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e78014480 con 0x7f1e8015f860 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.164+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e78014870 con 0x7f1e8015f860 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8015cbc0 con 0x7f1e8015f860 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e8015d180 con 0x7f1e8015f860 2024-05-09T05:04:33.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f9257400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 0x7f925015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f9257400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500b87b0 0x7f9250154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f9257400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92500b9560 0x7f92500b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f9257400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92500d2220 con 0x7f92500b9560 2024-05-09T05:04:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f9257400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f92500d20a0 con 0x7f92500b87b0 2024-05-09T05:04:33.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b406a630 con 0x7f45b41614b0 2024-05-09T05:04:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.166+0000 7f9254a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 0x7f925015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.166+0000 7f9254a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 0x7f925015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52332/0 (socket says 172.21.15.100:52332) 2024-05-09T05:04:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.166+0000 7f9254a00640 1 -- 172.21.15.100:0/1490030115 learned_addr learned my addr 172.21.15.100:0/1490030115 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.166+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f92500d23a0 con 0x7f9238003a50 2024-05-09T05:04:33.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.162+0000 7fb0aaa00640 1 -- 172.21.15.100:0/4042317986 wait complete. 2024-05-09T05:04:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.166+0000 7f924fe00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500b87b0 0x7f9250154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7fb0aaa00640 1 Processor -- start 2024-05-09T05:04:33.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.166+0000 7fb0aaa00640 1 -- start start 2024-05-09T05:04:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f9254a00640 1 -- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500b87b0 msgr2=0x7f9250154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.165+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f459c01c5a0 con 0x7f45b41614b0 2024-05-09T05:04:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f45abe00640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f45900763d0 0x7f4590078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f459c097ba0 con 0x7f45b41614b0 2024-05-09T05:04:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f9254a00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500b87b0 0x7f9250154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f9254a00640 1 -- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92500b9560 msgr2=0x7f92500b99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f9254a00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92500b9560 0x7f92500b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.167+0000 7f9254a00640 1 -- 172.21.15.100:0/1490030115 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9250154570 con 0x7f9238003a50 2024-05-09T05:04:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.168+0000 7f45b3e00640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f45900763d0 0x7f4590078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.168+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e58005290 con 0x7f1e8015f860 2024-05-09T05:04:33.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.168+0000 7f924fe00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500b87b0 0x7f9250154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:04:33.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.169+0000 7f9254a00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 0x7f925015a6e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f923c02abb0 tx=0x7f923c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.169+0000 7f45b3e00640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f45900763d0 0x7f4590078890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45ac002230 tx=0x7f45ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.169+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c040020 con 0x7f9238003a50 2024-05-09T05:04:33.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.169+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c00f090 con 0x7f9238003a50 2024-05-09T05:04:33.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.169+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c036040 con 0x7f9238003a50 2024-05-09T05:04:33.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.169+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92500ca190 con 0x7f9238003a50 2024-05-09T05:04:33.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.170+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92500b8f00 con 0x7f9238003a50 2024-05-09T05:04:33.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925006a630 con 0x7f9238003a50 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.171+0000 7fb0aaa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a40b5d30 0x7fb0a42018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.171+0000 7fb0aaa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 0x7fb0a40b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.171+0000 7fb0aaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 0x7fb0a406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7fb0aa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 0x7fb0a406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7fb0aa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 0x7fb0a406e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35852/0 (socket says 172.21.15.100:35852) 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7fb0aa000640 1 -- 172.21.15.100:0/1916045005 learned_addr learned my addr 172.21.15.100:0/1916045005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a40b6440 con 0x7fb0a4162cf0 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a40d3f90 con 0x7fb0a40d5cc0 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a40b65c0 con 0x7fb0a40b5d30 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.173+0000 7fb0a9600640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a40b5d30 0x7fb0a42018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.173+0000 7fb0aa000640 1 -- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a40b5d30 msgr2=0x7fb0a42018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.173+0000 7fb0aa000640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a40b5d30 0x7fb0a42018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.174+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f459c018030 con 0x7f45b41614b0 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.172+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e78005d10 con 0x7f1e8015f860 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.174+0000 7f1e77400640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e600762d0 0x7f1e60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.174+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1e780982b0 con 0x7f1e8015f860 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.173+0000 7fb0aa000640 1 -- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 msgr2=0x7fb0a40b4270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.173+0000 7fb0aa000640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 0x7fb0a40b4270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.173+0000 7fb0aa000640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a4201df0 con 0x7fb0a4162cf0 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.174+0000 7fb0aa000640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 0x7fb0a406e0b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00caf0 tx=0x7fb09c004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.174+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c016070 con 0x7fb0a4162cf0 2024-05-09T05:04:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.175+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a4205730 con 0x7fb0a4162cf0 2024-05-09T05:04:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.175+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09c006d50 con 0x7fb0a4162cf0 2024-05-09T05:04:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.175+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c016070 con 0x7fb0a4162cf0 2024-05-09T05:04:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.175+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a4205cf0 con 0x7fb0a4162cf0 2024-05-09T05:04:33.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.176+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f923c043020 con 0x7f9238003a50 2024-05-09T05:04:33.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.176+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a40699e0 con 0x7fb0a4162cf0 2024-05-09T05:04:33.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.178+0000 7f1e7f400640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e600762d0 0x7f1e60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.179+0000 7f1e7f400640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e600762d0 0x7f1e60078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e7002a290 tx=0x7f1e7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.177+0000 7f924cc00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f92300763d0 0x7f9230078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.177+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f923c0b8270 con 0x7f9238003a50 2024-05-09T05:04:33.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.178+0000 7f924fe00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f92300763d0 0x7f9230078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.179+0000 7f924fe00640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f92300763d0 0x7f9230078890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9244000c00 tx=0x7f9244000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.181+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb09c004980 con 0x7fb0a4162cf0 2024-05-09T05:04:33.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.182+0000 7fb0a1600640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb0840764d0 0x7fb084078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.182+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb09c097cd0 con 0x7fb0a4162cf0 2024-05-09T05:04:33.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.183+0000 7fb0a9600640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb0840764d0 0x7fb084078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.184+0000 7fb0a9600640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb0840764d0 0x7fb084078990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb098009b80 tx=0x7fb098009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.185+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1e78022030 con 0x7f1e8015f860 2024-05-09T05:04:33.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.187+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb09c004c70 con 0x7fb0a4162cf0 2024-05-09T05:04:33.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.199+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f923c04a020 con 0x7f9238003a50 2024-05-09T05:04:33.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.518+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f364804d9a0 con 0x7f36480e7a50 2024-05-09T05:04:33.522 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:33.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.519+0000 7f3643e00640 1 -- 172.21.15.100:0/2075790187 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3650101770 con 0x7f36480e7a50 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.522+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3630076300 msgr2=0x7f36300787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.522+0000 7f3655800640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3630076300 0x7f36300787c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f363c007fd0 tx=0x7f363c007220 comp rx=0 tx=0).stop 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.522+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36480e7a50 msgr2=0x7f3648007f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.522+0000 7f3655800640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36480e7a50 0x7f3648007f80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3650051a60 tx=0x7f365006b7c0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.523+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 shutdown_connections 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.523+0000 7f3655800640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3630076300 0x7f36300787c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.523+0000 7f3655800640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36480e7a50 0x7f3648007f80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.523+0000 7f3655800640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36480548a0 0x7f364804a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.523+0000 7f3655800640 1 --2- 172.21.15.100:0/2075790187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364803ca70 0x7f36480ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.524+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 >> 172.21.15.100:0/2075790187 conn(0x7f3648056cd0 msgr2=0x7f36480e5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.524+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 shutdown_connections 2024-05-09T05:04:33.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.524+0000 7f3655800640 1 -- 172.21.15.100:0/2075790187 wait complete. 2024-05-09T05:04:33.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.544+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0610005850 con 0x7f06380d5c40 2024-05-09T05:04:33.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.545+0000 7f062f400640 1 -- 172.21.15.100:0/2264022808 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0624064960 con 0x7f06380d5c40 2024-05-09T05:04:33.547 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:33.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.548+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa28c076150 con 0x7fa28c0b6750 2024-05-09T05:04:33.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.549+0000 7fa282000640 1 -- 172.21.15.100:0/3455912429 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa27c081830 con 0x7fa28c0b6750 2024-05-09T05:04:33.549 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:33.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06180762d0 msgr2=0x7f0618078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06180762d0 0x7f0618078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0628034000 tx=0x7f062802e000 comp rx=0 tx=0).stop 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06380d5c40 msgr2=0x7f063815e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06380d5c40 0x7f063815e4e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f062400c340 tx=0x7f062400c800 comp rx=0 tx=0).stop 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 shutdown_connections 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06180762d0 0x7f0618078790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f063815f860 0x7f06380a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06380d5c40 0x7f063815e4e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 --2- 172.21.15.100:0/2264022808 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06380d3700 0x7f06382039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.550+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 >> 172.21.15.100:0/2264022808 conn(0x7f06380d5120 msgr2=0x7f063806dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-05-09T05:04:33.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.551+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 shutdown_connections 2024-05-09T05:04:33.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.551+0000 7f062cc00640 1 -- 172.21.15.100:0/2264022808 wait complete. 2024-05-09T05:04:33.553 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa26c0763d0 msgr2=0x7fa26c078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa26c0763d0 0x7fa26c078890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa278007fd0 tx=0x7fa278009040 comp rx=0 tx=0).stop 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 msgr2=0x7fa28c15b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 0x7fa28c15b4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa27c035040 tx=0x7fa27c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 shutdown_connections 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa26c0763d0 0x7fa26c078890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa28c15f4b0 0x7fa28c0ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa28c0d5130 0x7fa28c160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 --2- 172.21.15.100:0/3455912429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa28c0b6750 0x7fa28c15b4e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.552+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 >> 172.21.15.100:0/3455912429 conn(0x7fa28c08ebb0 msgr2=0x7fa28c0d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.553+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 shutdown_connections 2024-05-09T05:04:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.553+0000 7fa290a00640 1 -- 172.21.15.100:0/3455912429 wait complete. 2024-05-09T05:04:33.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.559+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fae04005850 con 0x7fae200db060 2024-05-09T05:04:33.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.561+0000 7fae1be00640 1 -- 172.21.15.100:0/216238636 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae281050d0 con 0x7fae200db060 2024-05-09T05:04:33.561 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:33.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.564+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fae080764d0 msgr2=0x7fae08078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.564+0000 7fae2d600640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fae080764d0 0x7fae08078990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae14005bb0 tx=0x7fae14007040 comp rx=0 tx=0).stop 2024-05-09T05:04:33.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.565+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae200db060 msgr2=0x7fae200dbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.565+0000 7fae2d600640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae200db060 0x7fae200dbfe0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae280750a0 tx=0x7fae2806ae30 comp rx=0 tx=0).stop 2024-05-09T05:04:33.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 shutdown_connections 2024-05-09T05:04:33.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fae080764d0 0x7fae08078990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae200db060 0x7fae200dbfe0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae200dabe0 0x7fae200dbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 --2- 172.21.15.100:0/216238636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae100051c0 0x7fae200dd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 >> 172.21.15.100:0/216238636 conn(0x7fae20009fb0 msgr2=0x7fae200494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.566+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 shutdown_connections 2024-05-09T05:04:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.567+0000 7fae2d600640 1 -- 172.21.15.100:0/216238636 wait complete. 2024-05-09T05:04:33.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-09T05:04:33.579 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-05-09T05:04:33.579 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-05-09T05:04:33.593 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.600+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1e58005580 con 0x7f1e8015f860 2024-05-09T05:04:33.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.601+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb0a40d1440 con 0x7fb0a4162cf0 2024-05-09T05:04:33.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.601+0000 7f1e77400640 1 -- 172.21.15.100:0/1291712156 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e8009f970 con 0x7f1e8015f860 2024-05-09T05:04:33.602 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:33.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.601+0000 7fb0a1600640 1 -- 172.21.15.100:0/1916045005 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0a40d1440 con 0x7fb0a4162cf0 2024-05-09T05:04:33.602 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:33.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb0840764d0 msgr2=0x7fb084078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb0840764d0 0x7fb084078990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb098009b80 tx=0x7fb098009240 comp rx=0 tx=0).stop 2024-05-09T05:04:33.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 msgr2=0x7fb0a406e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 0x7fb0a406e0b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00caf0 tx=0x7fb09c004850 comp rx=0 tx=0).stop 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e600762d0 msgr2=0x7f1e60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e600762d0 0x7f1e60078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e7002a290 tx=0x7f1e7002e000 comp rx=0 tx=0).stop 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e8015f860 msgr2=0x7f1e801ee220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e8015f860 0x7f1e801ee220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800efc0 tx=0x7f1e7800c490 comp rx=0 tx=0).stop 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 shutdown_connections 2024-05-09T05:04:33.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e600762d0 0x7f1e60078790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e8015f860 0x7f1e801ee220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e800d5c40 0x7f1e801edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 --2- 172.21.15.100:0/1291712156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e800d3700 0x7f1e800b9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 >> 172.21.15.100:0/1291712156 conn(0x7f1e800d5120 msgr2=0x7f1e8006dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 shutdown_connections 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb0840764d0 0x7fb084078990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0a4162cf0 0x7fb0a406e0b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0a40d5cc0 0x7fb0a40b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 --2- 172.21.15.100:0/1916045005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0a40b5d30 0x7fb0a42018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 >> 172.21.15.100:0/1916045005 conn(0x7fb0a40d51a0 msgr2=0x7fb0a4161b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 shutdown_connections 2024-05-09T05:04:33.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7f1e84e00640 1 -- 172.21.15.100:0/1291712156 wait complete. 2024-05-09T05:04:33.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 shutdown_connections 2024-05-09T05:04:33.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.604+0000 7fb0aaa00640 1 -- 172.21.15.100:0/1916045005 wait complete. 2024-05-09T05:04:33.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.612+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f45b406d580 con 0x7f45b41614b0 2024-05-09T05:04:33.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.613+0000 7f45abe00640 1 -- 172.21.15.100:0/3653741683 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f459c061570 con 0x7f45b41614b0 2024-05-09T05:04:33.614 INFO:teuthology.orchestra.run.smithi100.stdout:55834574854 2024-05-09T05:04:33.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f45900763d0 msgr2=0x7f4590078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f45900763d0 0x7f4590078890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45ac002230 tx=0x7f45ac009040 comp rx=0 tx=0).stop 2024-05-09T05:04:33.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 msgr2=0x7f45b4158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 0x7f45b4158880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f459c010c00 tx=0x7f459c00e540 comp rx=0 tx=0).stop 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 shutdown_connections 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f45900763d0 0x7f4590078890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45b40cd340 0x7f45b4161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45b41614b0 0x7f45b4158880 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 --2- 172.21.15.100:0/3653741683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4598003db0 0x7f45b4160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.616+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 >> 172.21.15.100:0/3653741683 conn(0x7f45b409e600 msgr2=0x7f45b40c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.617+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 shutdown_connections 2024-05-09T05:04:33.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.617+0000 7f45bb200640 1 -- 172.21.15.100:0/3653741683 wait complete. 2024-05-09T05:04:33.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-05-09T05:04:33.623 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-09T05:04:33.625 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.631+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f92500d3cf0 con 0x7f9238003a50 2024-05-09T05:04:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.632+0000 7f924cc00640 1 -- 172.21.15.100:0/1490030115 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f923c081c40 con 0x7f9238003a50 2024-05-09T05:04:33.633 INFO:teuthology.orchestra.run.smithi100.stdout:55834574855 2024-05-09T05:04:33.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f92300763d0 msgr2=0x7f9230078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f92300763d0 0x7f9230078890 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9244000c00 tx=0x7f9244000ed0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 msgr2=0x7f925015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 0x7f925015a6e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f923c02abb0 tx=0x7f923c004730 comp rx=0 tx=0).stop 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 shutdown_connections 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f92300763d0 0x7f9230078890 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9244000c00 tx=0x7f9244000ed0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92500b9560 0x7f92500b99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92500b87b0 0x7f9250154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 --2- 172.21.15.100:0/1490030115 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9238003a50 0x7f925015a6e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 >> 172.21.15.100:0/1490030115 conn(0x7f925009e600 msgr2=0x7f925006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 shutdown_connections 2024-05-09T05:04:33.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.635+0000 7f9257400640 1 -- 172.21.15.100:0/1490030115 wait complete. 2024-05-09T05:04:33.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-05-09T05:04:33.637 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-09T05:04:33.653 DEBUG:teuthology.parallel:result is None 2024-05-09T05:04:33.653 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:04:33.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:04:33.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.882+0000 7f31c0c00640 1 Processor -- start 2024-05-09T05:04:33.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.882+0000 7f31c0c00640 1 -- start start 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31c0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31bc0d0a70 0x7f31bc15e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31c0c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc15e780 con 0x7f31bc0afb70 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31c0c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc0ae3a0 con 0x7f31bc0ade90 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31c0c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f31bc0b4590 con 0x7f31bc0d0a70 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31b9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31bc0d0a70 0x7f31bc15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31b9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31bc0d0a70 0x7f31bc15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35862/0 (socket says 172.21.15.100:35862) 2024-05-09T05:04:33.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.884+0000 7f31b9e00640 1 -- 172.21.15.100:0/2885876640 learned_addr learned my addr 172.21.15.100:0/2885876640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.885+0000 7f31b9e00640 1 -- 172.21.15.100:0/2885876640 >> v1:172.21.15.133:6789/0 conn(0x7f31bc0ade90 legacy=0x7f31bc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:33.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.885+0000 7f31b9e00640 1 -- 172.21.15.100:0/2885876640 >> v1:172.21.15.100:6789/0 conn(0x7f31bc0afb70 legacy=0x7f31bc0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.885+0000 7f31b9e00640 1 -- 172.21.15.100:0/2885876640 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc0b4870 con 0x7f31bc0d0a70 2024-05-09T05:04:33.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.885+0000 7f31b8a00640 1 -- 172.21.15.100:0/2885876640 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739601347 0 0) 0x7f31b4001490 con 0x7f31bc0afb70 2024-05-09T05:04:33.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.886+0000 7f31b9e00640 1 --2- 172.21.15.100:0/2885876640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc15e240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009870 tx=0x7f31ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9a9e3a79ac0727 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.886+0000 7f31b8a00640 1 -- 172.21.15.100:0/2885876640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac037070 con 0x7f31bc0d0a70 2024-05-09T05:04:33.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.886+0000 7f31b8a00640 1 -- 172.21.15.100:0/2885876640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ac032440 con 0x7f31bc0d0a70 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.886+0000 7f31b8a00640 1 -- 172.21.15.100:0/2885876640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ac032810 con 0x7f31bc0d0a70 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 -- 172.21.15.100:0/2885876640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 msgr2=0x7f31bc15e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 --2- 172.21.15.100:0/2885876640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc15e240 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009870 tx=0x7f31ac02a270 comp rx=0 tx=0).stop 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 -- 172.21.15.100:0/2885876640 shutdown_connections 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 --2- 172.21.15.100:0/2885876640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc15e240 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 -- 172.21.15.100:0/2885876640 >> 172.21.15.100:0/2885876640 conn(0x7f31bc0b31e0 msgr2=0x7f31bc0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 -- 172.21.15.100:0/2885876640 shutdown_connections 2024-05-09T05:04:33.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.887+0000 7f31c0c00640 1 -- 172.21.15.100:0/2885876640 wait complete. 2024-05-09T05:04:33.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.888+0000 7f31c0c00640 1 Processor -- start 2024-05-09T05:04:33.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.889+0000 7f31c0c00640 1 -- start start 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.889+0000 7f31c0c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31bc0ade90 0x7f31bc1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.889+0000 7f31c0c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31bc0afb70 0x7f31bc143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.889+0000 7f31c0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31c0c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc072570 con 0x7f31bc0d0a70 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31c0c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc0ae680 con 0x7f31bc0afb70 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31c0c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f31bc0726f0 con 0x7f31bc0ade90 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc1581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35876/0 (socket says 172.21.15.100:35876) 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 -- 172.21.15.100:0/1726244864 learned_addr learned my addr 172.21.15.100:0/1726244864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31b9e00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31bc0ade90 0x7f31bc1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 -- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31bc0ade90 msgr2=0x7f31bc1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31bc0ade90 0x7f31bc1561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 -- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31bc0afb70 msgr2=0x7f31bc143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31bc0afb70 0x7f31bc143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 -- 172.21.15.100:0/1726244864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc158710 con 0x7f31bc0d0a70 2024-05-09T05:04:33.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.890+0000 7f31ba800640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc1581d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31b400c7a0 tx=0x7f31b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.891+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4003da0 con 0x7f31bc0d0a70 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.891+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b4005070 con 0x7f31bc0d0a70 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.891+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31bc1589b0 con 0x7f31bc0d0a70 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.891+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4005440 con 0x7f31bc0d0a70 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.891+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31bc158f70 con 0x7f31bc0d0a70 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.892+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31bc06a5c0 con 0x7f31bc0d0a70 2024-05-09T05:04:33.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.893+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f31b40055e0 con 0x7f31bc0d0a70 2024-05-09T05:04:33.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.894+0000 7f31b2000640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f319c0762d0 0x7f319c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.894+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31b40975c0 con 0x7f31bc0d0a70 2024-05-09T05:04:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.894+0000 7f31b9e00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f319c0762d0 0x7f319c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:33.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.895+0000 7f31b9e00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f319c0762d0 0x7f319c078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31ac034000 tx=0x7f31ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:33.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:33.899+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f31bc15e780 con 0x7f31bc0d0a70 2024-05-09T05:04:34.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.087+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31bc15b760 con 0x7f319c0762d0 2024-05-09T05:04:34.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.095+0000 7f31b2000640 1 -- 172.21.15.100:0/1726244864 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f31bc15b760 con 0x7f319c0762d0 2024-05-09T05:04:34.098 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:34.101 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:04:34.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f319c0762d0 msgr2=0x7f319c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f319c0762d0 0x7f319c078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f31ac034000 tx=0x7f31ac02e000 comp rx=0 tx=0).stop 2024-05-09T05:04:34.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 msgr2=0x7f31bc1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc1581d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31b400c7a0 tx=0x7f31b400cc60 comp rx=0 tx=0).stop 2024-05-09T05:04:34.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 shutdown_connections 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f319c0762d0 0x7f319c078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31bc0d0a70 0x7f31bc1581d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31bc0afb70 0x7f31bc143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 --2- 172.21.15.100:0/1726244864 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f31bc0ade90 0x7f31bc1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 >> 172.21.15.100:0/1726244864 conn(0x7f31bc0b31e0 msgr2=0x7f31bc0aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 shutdown_connections 2024-05-09T05:04:34.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.101+0000 7f31c0c00640 1 -- 172.21.15.100:0/1726244864 wait complete. 2024-05-09T05:04:34.121 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-09T05:04:33.884386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.736984"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591489+0000","last_change":"2024-05-09T05:04:24.203836+0000","last_active":"2024-05-09T05:04:25.591489+0000","last_peered":"2024-05-09T05:04:25.591489+0000","last_clean":"2024-05-09T05:04:25.591489+0000","last_became_active":"2024-05-09T05:04:24.203523+0000","last_became_peered":"2024-05-09T05:04:24.203523+0000","last_unstale":"2024-05-09T05:04:25.591489+0000","last_undegraded":"2024-05-09T05:04:25.591489+0000","last_fullsized":"2024-05-09T05:04:25.591489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:05.764536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589895+0000","last_change":"2024-05-09T05:04:24.173706+0000","last_active":"2024-05-09T05:04:25.589895+0000","last_peered":"2024-05-09T05:04:25.589895+0000","last_clean":"2024-05-09T05:04:25.589895+0000","last_became_active":"2024-05-09T05:04:24.173342+0000","last_became_peered":"2024-05-09T05:04:24.173342+0000","last_unstale":"2024-05-09T05:04:25.589895+0000","last_undegraded":"2024-05-09T05:04:25.589895+0000","last_fullsized":"2024-05-09T05:04:25.589895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181465+0000","last_change":"2024-05-09T05:04:24.189455+0000","last_active":"2024-05-09T05:04:25.181465+0000","last_peered":"2024-05-09T05:04:25.181465+0000","last_clean":"2024-05-09T05:04:25.181465+0000","last_became_active":"2024-05-09T05:04:24.189189+0000","last_became_peered":"2024-05-09T05:04:24.189189+0000","last_unstale":"2024-05-09T05:04:25.181465+0000","last_undegraded":"2024-05-09T05:04:25.181465+0000","last_fullsized":"2024-05-09T05:04:25.181465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187272+0000","last_change":"2024-05-09T05:04:24.178690+0000","last_active":"2024-05-09T05:04:25.187272+0000","last_peered":"2024-05-09T05:04:25.187272+0000","last_clean":"2024-05-09T05:04:25.187272+0000","last_became_active":"2024-05-09T05:04:24.178347+0000","last_became_peered":"2024-05-09T05:04:24.178347+0000","last_unstale":"2024-05-09T05:04:25.187272+0000","last_undegraded":"2024-05-09T05:04:25.187272+0000","last_fullsized":"2024-05-09T05:04:25.187272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590089+0000","last_change":"2024-05-09T05:04:24.191405+0000","last_active":"2024-05-09T05:04:25.590089+0000","last_peered":"2024-05-09T05:04:25.590089+0000","last_clean":"2024-05-09T05:04:25.590089+0000","last_became_active":"2024-05-09T05:04:24.191098+0000","last_became_peered":"2024-05-09T05:04:24.191098+0000","last_unstale":"2024-05-09T05:04:25.590089+0000","last_undegraded":"2024-05-09T05:04:25.590089+0000","last_fullsized":"2024-05-09T05:04:25.590089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186587+0000","last_change":"2024-05-09T05:04:24.179975+0000","last_active":"2024-05-09T05:04:25.186587+0000","last_peered":"2024-05-09T05:04:25.186587+0000","last_clean":"2024-05-09T05:04:25.186587+0000","last_became_active":"2024-05-09T05:04:24.179691+0000","last_became_peered":"2024-05-09T05:04:24.179691+0000","last_unstale":"2024-05-09T05:04:25.186587+0000","last_undegraded":"2024-05-09T05:04:25.186587+0000","last_fullsized":"2024-05-09T05:04:25.186587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589332+0000","last_change":"2024-05-09T05:04:24.203414+0000","last_active":"2024-05-09T05:04:25.589332+0000","last_peered":"2024-05-09T05:04:25.589332+0000","last_clean":"2024-05-09T05:04:25.589332+0000","last_became_active":"2024-05-09T05:04:24.201938+0000","last_became_peered":"2024-05-09T05:04:24.201938+0000","last_unstale":"2024-05-09T05:04:25.589332+0000","last_undegraded":"2024-05-09T05:04:25.589332+0000","last_fullsized":"2024-05-09T05:04:25.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591210+0000","last_change":"2024-05-09T05:04:24.184991+0000","last_active":"2024-05-09T05:04:25.591210+0000","last_peered":"2024-05-09T05:04:25.591210+0000","last_clean":"2024-05-09T05:04:25.591210+0000","last_became_active":"2024-05-09T05:04:24.184661+0000","last_became_peered":"2024-05-09T05:04:24.184661+0000","last_unstale":"2024-05-09T05:04:25.591210+0000","last_undegraded":"2024-05-09T05:04:25.591210+0000","last_fullsized":"2024-05-09T05:04:25.591210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591708+0000","last_change":"2024-05-09T05:04:24.205483+0000","last_active":"2024-05-09T05:04:25.591708+0000","last_peered":"2024-05-09T05:04:25.591708+0000","last_clean":"2024-05-09T05:04:25.591708+0000","last_became_active":"2024-05-09T05:04:24.205172+0000","last_became_peered":"2024-05-09T05:04:24.205172+0000","last_unstale":"2024-05-09T05:04:25.591708+0000","last_undegraded":"2024-05-09T05:04:25.591708+0000","last_fullsized":"2024-05-09T05:04:25.591708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:42.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590912+0000","last_change":"2024-05-09T05:04:24.189101+0000","last_active":"2024-05-09T05:04:25.590912+0000","last_peered":"2024-05-09T05:04:25.590912+0000","last_clean":"2024-05-09T05:04:25.590912+0000","last_became_active":"2024-05-09T05:04:24.188782+0000","last_became_peered":"2024-05-09T05:04:24.188782+0000","last_unstale":"2024-05-09T05:04:25.590912+0000","last_undegraded":"2024-05-09T05:04:25.590912+0000","last_fullsized":"2024-05-09T05:04:25.590912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590328+0000","last_change":"2024-05-09T05:04:24.194232+0000","last_active":"2024-05-09T05:04:25.590328+0000","last_peered":"2024-05-09T05:04:25.590328+0000","last_clean":"2024-05-09T05:04:25.590328+0000","last_became_active":"2024-05-09T05:04:24.193406+0000","last_became_peered":"2024-05-09T05:04:24.193406+0000","last_unstale":"2024-05-09T05:04:25.590328+0000","last_undegraded":"2024-05-09T05:04:25.590328+0000","last_fullsized":"2024-05-09T05:04:25.590328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185677+0000","last_change":"2024-05-09T05:04:24.191071+0000","last_active":"2024-05-09T05:04:25.185677+0000","last_peered":"2024-05-09T05:04:25.185677+0000","last_clean":"2024-05-09T05:04:25.185677+0000","last_became_active":"2024-05-09T05:04:24.190796+0000","last_became_peered":"2024-05-09T05:04:24.190796+0000","last_unstale":"2024-05-09T05:04:25.185677+0000","last_undegraded":"2024-05-09T05:04:25.185677+0000","last_fullsized":"2024-05-09T05:04:25.185677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:51.000950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591619+0000","last_change":"2024-05-09T05:04:24.181185+0000","last_active":"2024-05-09T05:04:25.591619+0000","last_peered":"2024-05-09T05:04:25.591619+0000","last_clean":"2024-05-09T05:04:25.591619+0000","last_became_active":"2024-05-09T05:04:24.180913+0000","last_became_peered":"2024-05-09T05:04:24.180913+0000","last_unstale":"2024-05-09T05:04:25.591619+0000","last_undegraded":"2024-05-09T05:04:25.591619+0000","last_fullsized":"2024-05-09T05:04:25.591619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181113+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.181113+0000","last_peered":"2024-05-09T05:04:25.181113+0000","last_clean":"2024-05-09T05:04:25.181113+0000","last_became_active":"2024-05-09T05:04:24.167267+0000","last_became_peered":"2024-05-09T05:04:24.167267+0000","last_unstale":"2024-05-09T05:04:25.181113+0000","last_undegraded":"2024-05-09T05:04:25.181113+0000","last_fullsized":"2024-05-09T05:04:25.181113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588520+0000","last_change":"2024-05-09T05:04:24.198074+0000","last_active":"2024-05-09T05:04:25.588520+0000","last_peered":"2024-05-09T05:04:25.588520+0000","last_clean":"2024-05-09T05:04:25.588520+0000","last_became_active":"2024-05-09T05:04:24.197831+0000","last_became_peered":"2024-05-09T05:04:24.197831+0000","last_unstale":"2024-05-09T05:04:25.588520+0000","last_undegraded":"2024-05-09T05:04:25.588520+0000","last_fullsized":"2024-05-09T05:04:25.588520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184408+0000","last_change":"2024-05-09T05:04:24.173451+0000","last_active":"2024-05-09T05:04:25.184408+0000","last_peered":"2024-05-09T05:04:25.184408+0000","last_clean":"2024-05-09T05:04:25.184408+0000","last_became_active":"2024-05-09T05:04:24.172936+0000","last_became_peered":"2024-05-09T05:04:24.172936+0000","last_unstale":"2024-05-09T05:04:25.184408+0000","last_undegraded":"2024-05-09T05:04:25.184408+0000","last_fullsized":"2024-05-09T05:04:25.184408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188372+0000","last_change":"2024-05-09T05:04:24.202382+0000","last_active":"2024-05-09T05:04:25.188372+0000","last_peered":"2024-05-09T05:04:25.188372+0000","last_clean":"2024-05-09T05:04:25.188372+0000","last_became_active":"2024-05-09T05:04:24.201887+0000","last_became_peered":"2024-05-09T05:04:24.201887+0000","last_unstale":"2024-05-09T05:04:25.188372+0000","last_undegraded":"2024-05-09T05:04:25.188372+0000","last_fullsized":"2024-05-09T05:04:25.188372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589079+0000","last_change":"2024-05-09T05:04:24.194414+0000","last_active":"2024-05-09T05:04:25.589079+0000","last_peered":"2024-05-09T05:04:25.589079+0000","last_clean":"2024-05-09T05:04:25.589079+0000","last_became_active":"2024-05-09T05:04:24.194106+0000","last_became_peered":"2024-05-09T05:04:24.194106+0000","last_unstale":"2024-05-09T05:04:25.589079+0000","last_undegraded":"2024-05-09T05:04:25.589079+0000","last_fullsized":"2024-05-09T05:04:25.589079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591114+0000","last_change":"2024-05-09T05:04:24.197967+0000","last_active":"2024-05-09T05:04:25.591114+0000","last_peered":"2024-05-09T05:04:25.591114+0000","last_clean":"2024-05-09T05:04:25.591114+0000","last_became_active":"2024-05-09T05:04:24.197672+0000","last_became_peered":"2024-05-09T05:04:24.197672+0000","last_unstale":"2024-05-09T05:04:25.591114+0000","last_undegraded":"2024-05-09T05:04:25.591114+0000","last_fullsized":"2024-05-09T05:04:25.591114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:16.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589820+0000","last_change":"2024-05-09T05:04:24.203278+0000","last_active":"2024-05-09T05:04:25.589820+0000","last_peered":"2024-05-09T05:04:25.589820+0000","last_clean":"2024-05-09T05:04:25.589820+0000","last_became_active":"2024-05-09T05:04:24.202994+0000","last_became_peered":"2024-05-09T05:04:24.202994+0000","last_unstale":"2024-05-09T05:04:25.589820+0000","last_undegraded":"2024-05-09T05:04:25.589820+0000","last_fullsized":"2024-05-09T05:04:25.589820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180771+0000","last_change":"2024-05-09T05:04:24.199162+0000","last_active":"2024-05-09T05:04:25.180771+0000","last_peered":"2024-05-09T05:04:25.180771+0000","last_clean":"2024-05-09T05:04:25.180771+0000","last_became_active":"2024-05-09T05:04:24.198809+0000","last_became_peered":"2024-05-09T05:04:24.198809+0000","last_unstale":"2024-05-09T05:04:25.180771+0000","last_undegraded":"2024-05-09T05:04:25.180771+0000","last_fullsized":"2024-05-09T05:04:25.180771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:06.638505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187003+0000","last_change":"2024-05-09T05:04:24.193592+0000","last_active":"2024-05-09T05:04:25.187003+0000","last_peered":"2024-05-09T05:04:25.187003+0000","last_clean":"2024-05-09T05:04:25.187003+0000","last_became_active":"2024-05-09T05:04:24.190111+0000","last_became_peered":"2024-05-09T05:04:24.190111+0000","last_unstale":"2024-05-09T05:04:25.187003+0000","last_undegraded":"2024-05-09T05:04:25.187003+0000","last_fullsized":"2024-05-09T05:04:25.187003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591263+0000","last_change":"2024-05-09T05:04:24.195840+0000","last_active":"2024-05-09T05:04:25.591263+0000","last_peered":"2024-05-09T05:04:25.591263+0000","last_clean":"2024-05-09T05:04:25.591263+0000","last_became_active":"2024-05-09T05:04:24.195548+0000","last_became_peered":"2024-05-09T05:04:24.195548+0000","last_unstale":"2024-05-09T05:04:25.591263+0000","last_undegraded":"2024-05-09T05:04:25.591263+0000","last_fullsized":"2024-05-09T05:04:25.591263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184835+0000","last_change":"2024-05-09T05:04:24.177654+0000","last_active":"2024-05-09T05:04:25.184835+0000","last_peered":"2024-05-09T05:04:25.184835+0000","last_clean":"2024-05-09T05:04:25.184835+0000","last_became_active":"2024-05-09T05:04:24.177281+0000","last_became_peered":"2024-05-09T05:04:24.177281+0000","last_unstale":"2024-05-09T05:04:25.184835+0000","last_undegraded":"2024-05-09T05:04:25.184835+0000","last_fullsized":"2024-05-09T05:04:25.184835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592160+0000","last_change":"2024-05-09T05:04:24.194016+0000","last_active":"2024-05-09T05:04:25.592160+0000","last_peered":"2024-05-09T05:04:25.592160+0000","last_clean":"2024-05-09T05:04:25.592160+0000","last_became_active":"2024-05-09T05:04:24.193720+0000","last_became_peered":"2024-05-09T05:04:24.193720+0000","last_unstale":"2024-05-09T05:04:25.592160+0000","last_undegraded":"2024-05-09T05:04:25.592160+0000","last_fullsized":"2024-05-09T05:04:25.592160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591104+0000","last_change":"2024-05-09T05:04:24.189812+0000","last_active":"2024-05-09T05:04:25.591104+0000","last_peered":"2024-05-09T05:04:25.591104+0000","last_clean":"2024-05-09T05:04:25.591104+0000","last_became_active":"2024-05-09T05:04:24.189449+0000","last_became_peered":"2024-05-09T05:04:24.189449+0000","last_unstale":"2024-05-09T05:04:25.591104+0000","last_undegraded":"2024-05-09T05:04:25.591104+0000","last_fullsized":"2024-05-09T05:04:25.591104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590046+0000","last_change":"2024-05-09T05:04:24.176362+0000","last_active":"2024-05-09T05:04:25.590046+0000","last_peered":"2024-05-09T05:04:25.590046+0000","last_clean":"2024-05-09T05:04:25.590046+0000","last_became_active":"2024-05-09T05:04:24.176105+0000","last_became_peered":"2024-05-09T05:04:24.176105+0000","last_unstale":"2024-05-09T05:04:25.590046+0000","last_undegraded":"2024-05-09T05:04:25.590046+0000","last_fullsized":"2024-05-09T05:04:25.590046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592264+0000","last_change":"2024-05-09T05:04:24.202970+0000","last_active":"2024-05-09T05:04:25.592264+0000","last_peered":"2024-05-09T05:04:25.592264+0000","last_clean":"2024-05-09T05:04:25.592264+0000","last_became_active":"2024-05-09T05:04:24.202686+0000","last_became_peered":"2024-05-09T05:04:24.202686+0000","last_unstale":"2024-05-09T05:04:25.592264+0000","last_undegraded":"2024-05-09T05:04:25.592264+0000","last_fullsized":"2024-05-09T05:04:25.592264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180896+0000","last_change":"2024-05-09T05:04:24.174802+0000","last_active":"2024-05-09T05:04:25.180896+0000","last_peered":"2024-05-09T05:04:25.180896+0000","last_clean":"2024-05-09T05:04:25.180896+0000","last_became_active":"2024-05-09T05:04:24.174563+0000","last_became_peered":"2024-05-09T05:04:24.174563+0000","last_unstale":"2024-05-09T05:04:25.180896+0000","last_undegraded":"2024-05-09T05:04:25.180896+0000","last_fullsized":"2024-05-09T05:04:25.180896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.877889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187440+0000","last_change":"2024-05-09T05:04:24.177693+0000","last_active":"2024-05-09T05:04:25.187440+0000","last_peered":"2024-05-09T05:04:25.187440+0000","last_clean":"2024-05-09T05:04:25.187440+0000","last_became_active":"2024-05-09T05:04:24.177378+0000","last_became_peered":"2024-05-09T05:04:24.177378+0000","last_unstale":"2024-05-09T05:04:25.187440+0000","last_undegraded":"2024-05-09T05:04:25.187440+0000","last_fullsized":"2024-05-09T05:04:25.187440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588726+0000","last_change":"2024-05-09T05:04:24.187125+0000","last_active":"2024-05-09T05:04:25.588726+0000","last_peered":"2024-05-09T05:04:25.588726+0000","last_clean":"2024-05-09T05:04:25.588726+0000","last_became_active":"2024-05-09T05:04:24.186891+0000","last_became_peered":"2024-05-09T05:04:24.186891+0000","last_unstale":"2024-05-09T05:04:25.588726+0000","last_undegraded":"2024-05-09T05:04:25.588726+0000","last_fullsized":"2024-05-09T05:04:25.588726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588587+0000","last_change":"2024-05-09T05:04:24.181177+0000","last_active":"2024-05-09T05:04:25.588587+0000","last_peered":"2024-05-09T05:04:25.588587+0000","last_clean":"2024-05-09T05:04:25.588587+0000","last_became_active":"2024-05-09T05:04:24.180833+0000","last_became_peered":"2024-05-09T05:04:24.180833+0000","last_unstale":"2024-05-09T05:04:25.588587+0000","last_undegraded":"2024-05-09T05:04:25.588587+0000","last_fullsized":"2024-05-09T05:04:25.588587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185228+0000","last_change":"2024-05-09T05:04:24.193208+0000","last_active":"2024-05-09T05:04:25.185228+0000","last_peered":"2024-05-09T05:04:25.185228+0000","last_clean":"2024-05-09T05:04:25.185228+0000","last_became_active":"2024-05-09T05:04:24.192925+0000","last_became_peered":"2024-05-09T05:04:24.192925+0000","last_unstale":"2024-05-09T05:04:25.185228+0000","last_undegraded":"2024-05-09T05:04:25.185228+0000","last_fullsized":"2024-05-09T05:04:25.185228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:34.632849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592174+0000","last_change":"2024-05-09T05:04:23.180425+0000","last_active":"2024-05-09T05:04:25.592174+0000","last_peered":"2024-05-09T05:04:25.592174+0000","last_clean":"2024-05-09T05:04:25.592174+0000","last_became_active":"2024-05-09T05:04:23.180148+0000","last_became_peered":"2024-05-09T05:04:23.180148+0000","last_unstale":"2024-05-09T05:04:25.592174+0000","last_undegraded":"2024-05-09T05:04:25.592174+0000","last_fullsized":"2024-05-09T05:04:25.592174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180999+0000","last_change":"2024-05-09T05:04:24.195547+0000","last_active":"2024-05-09T05:04:25.180999+0000","last_peered":"2024-05-09T05:04:25.180999+0000","last_clean":"2024-05-09T05:04:25.180999+0000","last_became_active":"2024-05-09T05:04:24.195230+0000","last_became_peered":"2024-05-09T05:04:24.195230+0000","last_unstale":"2024-05-09T05:04:25.180999+0000","last_undegraded":"2024-05-09T05:04:25.180999+0000","last_fullsized":"2024-05-09T05:04:25.180999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588849+0000","last_change":"2024-05-09T05:04:23.181255+0000","last_active":"2024-05-09T05:04:25.588849+0000","last_peered":"2024-05-09T05:04:25.588849+0000","last_clean":"2024-05-09T05:04:25.588849+0000","last_became_active":"2024-05-09T05:04:23.180998+0000","last_became_peered":"2024-05-09T05:04:23.180998+0000","last_unstale":"2024-05-09T05:04:25.588849+0000","last_undegraded":"2024-05-09T05:04:25.588849+0000","last_fullsized":"2024-05-09T05:04:25.588849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591449+0000","last_change":"2024-05-09T05:04:23.180456+0000","last_active":"2024-05-09T05:04:25.591449+0000","last_peered":"2024-05-09T05:04:25.591449+0000","last_clean":"2024-05-09T05:04:25.591449+0000","last_became_active":"2024-05-09T05:04:23.179393+0000","last_became_peered":"2024-05-09T05:04:23.179393+0000","last_unstale":"2024-05-09T05:04:25.591449+0000","last_undegraded":"2024-05-09T05:04:25.591449+0000","last_fullsized":"2024-05-09T05:04:25.591449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591092+0000","last_change":"2024-05-09T05:04:24.168133+0000","last_active":"2024-05-09T05:04:25.591092+0000","last_peered":"2024-05-09T05:04:25.591092+0000","last_clean":"2024-05-09T05:04:25.591092+0000","last_became_active":"2024-05-09T05:04:24.167871+0000","last_became_peered":"2024-05-09T05:04:24.167871+0000","last_unstale":"2024-05-09T05:04:25.591092+0000","last_undegraded":"2024-05-09T05:04:25.591092+0000","last_fullsized":"2024-05-09T05:04:25.591092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185098+0000","last_change":"2024-05-09T05:04:23.185286+0000","last_active":"2024-05-09T05:04:25.185098+0000","last_peered":"2024-05-09T05:04:25.185098+0000","last_clean":"2024-05-09T05:04:25.185098+0000","last_became_active":"2024-05-09T05:04:23.184998+0000","last_became_peered":"2024-05-09T05:04:23.184998+0000","last_unstale":"2024-05-09T05:04:25.185098+0000","last_undegraded":"2024-05-09T05:04:25.185098+0000","last_fullsized":"2024-05-09T05:04:25.185098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588614+0000","last_change":"2024-05-09T05:04:24.175033+0000","last_active":"2024-05-09T05:04:25.588614+0000","last_peered":"2024-05-09T05:04:25.588614+0000","last_clean":"2024-05-09T05:04:25.588614+0000","last_became_active":"2024-05-09T05:04:24.174753+0000","last_became_peered":"2024-05-09T05:04:24.174753+0000","last_unstale":"2024-05-09T05:04:25.588614+0000","last_undegraded":"2024-05-09T05:04:25.588614+0000","last_fullsized":"2024-05-09T05:04:25.588614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591751+0000","last_change":"2024-05-09T05:04:23.182654+0000","last_active":"2024-05-09T05:04:25.591751+0000","last_peered":"2024-05-09T05:04:25.591751+0000","last_clean":"2024-05-09T05:04:25.591751+0000","last_became_active":"2024-05-09T05:04:23.182087+0000","last_became_peered":"2024-05-09T05:04:23.182087+0000","last_unstale":"2024-05-09T05:04:25.591751+0000","last_undegraded":"2024-05-09T05:04:25.591751+0000","last_fullsized":"2024-05-09T05:04:25.591751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187491+0000","last_change":"2024-05-09T05:04:24.194301+0000","last_active":"2024-05-09T05:04:25.187491+0000","last_peered":"2024-05-09T05:04:25.187491+0000","last_clean":"2024-05-09T05:04:25.187491+0000","last_became_active":"2024-05-09T05:04:24.190096+0000","last_became_peered":"2024-05-09T05:04:24.190096+0000","last_unstale":"2024-05-09T05:04:25.187491+0000","last_undegraded":"2024-05-09T05:04:25.187491+0000","last_fullsized":"2024-05-09T05:04:25.187491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187700+0000","last_change":"2024-05-09T05:04:23.186630+0000","last_active":"2024-05-09T05:04:25.187700+0000","last_peered":"2024-05-09T05:04:25.187700+0000","last_clean":"2024-05-09T05:04:25.187700+0000","last_became_active":"2024-05-09T05:04:23.186214+0000","last_became_peered":"2024-05-09T05:04:23.186214+0000","last_unstale":"2024-05-09T05:04:25.187700+0000","last_undegraded":"2024-05-09T05:04:25.187700+0000","last_fullsized":"2024-05-09T05:04:25.187700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181800+0000","last_change":"2024-05-09T05:04:24.184201+0000","last_active":"2024-05-09T05:04:25.181800+0000","last_peered":"2024-05-09T05:04:25.181800+0000","last_clean":"2024-05-09T05:04:25.181800+0000","last_became_active":"2024-05-09T05:04:24.183907+0000","last_became_peered":"2024-05-09T05:04:24.183907+0000","last_unstale":"2024-05-09T05:04:25.181800+0000","last_undegraded":"2024-05-09T05:04:25.181800+0000","last_fullsized":"2024-05-09T05:04:25.181800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590227+0000","last_change":"2024-05-09T05:04:23.174192+0000","last_active":"2024-05-09T05:04:25.590227+0000","last_peered":"2024-05-09T05:04:25.590227+0000","last_clean":"2024-05-09T05:04:25.590227+0000","last_became_active":"2024-05-09T05:04:23.173954+0000","last_became_peered":"2024-05-09T05:04:23.173954+0000","last_unstale":"2024-05-09T05:04:25.590227+0000","last_undegraded":"2024-05-09T05:04:25.590227+0000","last_fullsized":"2024-05-09T05:04:25.590227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187980+0000","last_change":"2024-05-09T05:04:24.199870+0000","last_active":"2024-05-09T05:04:25.187980+0000","last_peered":"2024-05-09T05:04:25.187980+0000","last_clean":"2024-05-09T05:04:25.187980+0000","last_became_active":"2024-05-09T05:04:24.194765+0000","last_became_peered":"2024-05-09T05:04:24.194765+0000","last_unstale":"2024-05-09T05:04:25.187980+0000","last_undegraded":"2024-05-09T05:04:25.187980+0000","last_fullsized":"2024-05-09T05:04:25.187980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:00.442516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589940+0000","last_change":"2024-05-09T05:04:23.178383+0000","last_active":"2024-05-09T05:04:25.589940+0000","last_peered":"2024-05-09T05:04:25.589940+0000","last_clean":"2024-05-09T05:04:25.589940+0000","last_became_active":"2024-05-09T05:04:23.177752+0000","last_became_peered":"2024-05-09T05:04:23.177752+0000","last_unstale":"2024-05-09T05:04:25.589940+0000","last_undegraded":"2024-05-09T05:04:25.589940+0000","last_fullsized":"2024-05-09T05:04:25.589940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590379+0000","last_change":"2024-05-09T05:04:24.198031+0000","last_active":"2024-05-09T05:04:25.590379+0000","last_peered":"2024-05-09T05:04:25.590379+0000","last_clean":"2024-05-09T05:04:25.590379+0000","last_became_active":"2024-05-09T05:04:24.197675+0000","last_became_peered":"2024-05-09T05:04:24.197675+0000","last_unstale":"2024-05-09T05:04:25.590379+0000","last_undegraded":"2024-05-09T05:04:25.590379+0000","last_fullsized":"2024-05-09T05:04:25.590379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181054+0000","last_change":"2024-05-09T05:04:23.172214+0000","last_active":"2024-05-09T05:04:25.181054+0000","last_peered":"2024-05-09T05:04:25.181054+0000","last_clean":"2024-05-09T05:04:25.181054+0000","last_became_active":"2024-05-09T05:04:23.171697+0000","last_became_peered":"2024-05-09T05:04:23.171697+0000","last_unstale":"2024-05-09T05:04:25.181054+0000","last_undegraded":"2024-05-09T05:04:25.181054+0000","last_fullsized":"2024-05-09T05:04:25.181054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181247+0000","last_change":"2024-05-09T05:04:24.200063+0000","last_active":"2024-05-09T05:04:25.181247+0000","last_peered":"2024-05-09T05:04:25.181247+0000","last_clean":"2024-05-09T05:04:25.181247+0000","last_became_active":"2024-05-09T05:04:24.198772+0000","last_became_peered":"2024-05-09T05:04:24.198772+0000","last_unstale":"2024-05-09T05:04:25.181247+0000","last_undegraded":"2024-05-09T05:04:25.181247+0000","last_fullsized":"2024-05-09T05:04:25.181247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187721+0000","last_change":"2024-05-09T05:04:23.175634+0000","last_active":"2024-05-09T05:04:25.187721+0000","last_peered":"2024-05-09T05:04:25.187721+0000","last_clean":"2024-05-09T05:04:25.187721+0000","last_became_active":"2024-05-09T05:04:23.173526+0000","last_became_peered":"2024-05-09T05:04:23.173526+0000","last_unstale":"2024-05-09T05:04:25.187721+0000","last_undegraded":"2024-05-09T05:04:25.187721+0000","last_fullsized":"2024-05-09T05:04:25.187721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590502+0000","last_change":"2024-05-09T05:04:24.205506+0000","last_active":"2024-05-09T05:04:25.590502+0000","last_peered":"2024-05-09T05:04:25.590502+0000","last_clean":"2024-05-09T05:04:25.590502+0000","last_became_active":"2024-05-09T05:04:24.205221+0000","last_became_peered":"2024-05-09T05:04:24.205221+0000","last_unstale":"2024-05-09T05:04:25.590502+0000","last_undegraded":"2024-05-09T05:04:25.590502+0000","last_fullsized":"2024-05-09T05:04:25.590502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588601+0000","last_change":"2024-05-09T05:04:23.183566+0000","last_active":"2024-05-09T05:04:25.588601+0000","last_peered":"2024-05-09T05:04:25.588601+0000","last_clean":"2024-05-09T05:04:25.588601+0000","last_became_active":"2024-05-09T05:04:23.182348+0000","last_became_peered":"2024-05-09T05:04:23.182348+0000","last_unstale":"2024-05-09T05:04:25.588601+0000","last_undegraded":"2024-05-09T05:04:25.588601+0000","last_fullsized":"2024-05-09T05:04:25.588601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588690+0000","last_change":"2024-05-09T05:04:24.185048+0000","last_active":"2024-05-09T05:04:25.588690+0000","last_peered":"2024-05-09T05:04:25.588690+0000","last_clean":"2024-05-09T05:04:25.588690+0000","last_became_active":"2024-05-09T05:04:24.184774+0000","last_became_peered":"2024-05-09T05:04:24.184774+0000","last_unstale":"2024-05-09T05:04:25.588690+0000","last_undegraded":"2024-05-09T05:04:25.588690+0000","last_fullsized":"2024-05-09T05:04:25.588690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588925+0000","last_change":"2024-05-09T05:04:23.166873+0000","last_active":"2024-05-09T05:04:25.588925+0000","last_peered":"2024-05-09T05:04:25.588925+0000","last_clean":"2024-05-09T05:04:25.588925+0000","last_became_active":"2024-05-09T05:04:23.166497+0000","last_became_peered":"2024-05-09T05:04:23.166497+0000","last_unstale":"2024-05-09T05:04:25.588925+0000","last_undegraded":"2024-05-09T05:04:25.588925+0000","last_fullsized":"2024-05-09T05:04:25.588925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589440+0000","last_change":"2024-05-09T05:04:24.206139+0000","last_active":"2024-05-09T05:04:25.589440+0000","last_peered":"2024-05-09T05:04:25.589440+0000","last_clean":"2024-05-09T05:04:25.589440+0000","last_became_active":"2024-05-09T05:04:24.205511+0000","last_became_peered":"2024-05-09T05:04:24.205511+0000","last_unstale":"2024-05-09T05:04:25.589440+0000","last_undegraded":"2024-05-09T05:04:25.589440+0000","last_fullsized":"2024-05-09T05:04:25.589440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186530+0000","last_change":"2024-05-09T05:04:23.171534+0000","last_active":"2024-05-09T05:04:25.186530+0000","last_peered":"2024-05-09T05:04:25.186530+0000","last_clean":"2024-05-09T05:04:25.186530+0000","last_became_active":"2024-05-09T05:04:23.170897+0000","last_became_peered":"2024-05-09T05:04:23.170897+0000","last_unstale":"2024-05-09T05:04:25.186530+0000","last_undegraded":"2024-05-09T05:04:25.186530+0000","last_fullsized":"2024-05-09T05:04:25.186530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591239+0000","last_change":"2024-05-09T05:04:24.205782+0000","last_active":"2024-05-09T05:04:25.591239+0000","last_peered":"2024-05-09T05:04:25.591239+0000","last_clean":"2024-05-09T05:04:25.591239+0000","last_became_active":"2024-05-09T05:04:24.205206+0000","last_became_peered":"2024-05-09T05:04:24.205206+0000","last_unstale":"2024-05-09T05:04:25.591239+0000","last_undegraded":"2024-05-09T05:04:25.591239+0000","last_fullsized":"2024-05-09T05:04:25.591239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:04.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589468+0000","last_change":"2024-05-09T05:04:23.165788+0000","last_active":"2024-05-09T05:04:25.589468+0000","last_peered":"2024-05-09T05:04:25.589468+0000","last_clean":"2024-05-09T05:04:25.589468+0000","last_became_active":"2024-05-09T05:04:23.165479+0000","last_became_peered":"2024-05-09T05:04:23.165479+0000","last_unstale":"2024-05-09T05:04:25.589468+0000","last_undegraded":"2024-05-09T05:04:25.589468+0000","last_fullsized":"2024-05-09T05:04:25.589468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591882+0000","last_change":"2024-05-09T05:04:24.209039+0000","last_active":"2024-05-09T05:04:25.591882+0000","last_peered":"2024-05-09T05:04:25.591882+0000","last_clean":"2024-05-09T05:04:25.591882+0000","last_became_active":"2024-05-09T05:04:24.208701+0000","last_became_peered":"2024-05-09T05:04:24.208701+0000","last_unstale":"2024-05-09T05:04:25.591882+0000","last_undegraded":"2024-05-09T05:04:25.591882+0000","last_fullsized":"2024-05-09T05:04:25.591882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:08.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590358+0000","last_change":"2024-05-09T05:04:23.180485+0000","last_active":"2024-05-09T05:04:25.590358+0000","last_peered":"2024-05-09T05:04:25.590358+0000","last_clean":"2024-05-09T05:04:25.590358+0000","last_became_active":"2024-05-09T05:04:23.179867+0000","last_became_peered":"2024-05-09T05:04:23.179867+0000","last_unstale":"2024-05-09T05:04:25.590358+0000","last_undegraded":"2024-05-09T05:04:25.590358+0000","last_fullsized":"2024-05-09T05:04:25.590358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188120+0000","last_change":"2024-05-09T05:04:24.178327+0000","last_active":"2024-05-09T05:04:25.188120+0000","last_peered":"2024-05-09T05:04:25.188120+0000","last_clean":"2024-05-09T05:04:25.188120+0000","last_became_active":"2024-05-09T05:04:24.178031+0000","last_became_peered":"2024-05-09T05:04:24.178031+0000","last_unstale":"2024-05-09T05:04:25.188120+0000","last_undegraded":"2024-05-09T05:04:25.188120+0000","last_fullsized":"2024-05-09T05:04:25.188120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589001+0000","last_change":"2024-05-09T05:04:23.178749+0000","last_active":"2024-05-09T05:04:25.589001+0000","last_peered":"2024-05-09T05:04:25.589001+0000","last_clean":"2024-05-09T05:04:25.589001+0000","last_became_active":"2024-05-09T05:04:23.178241+0000","last_became_peered":"2024-05-09T05:04:23.178241+0000","last_unstale":"2024-05-09T05:04:25.589001+0000","last_undegraded":"2024-05-09T05:04:25.589001+0000","last_fullsized":"2024-05-09T05:04:25.589001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590329+0000","last_change":"2024-05-09T05:04:24.201431+0000","last_active":"2024-05-09T05:04:25.590329+0000","last_peered":"2024-05-09T05:04:25.590329+0000","last_clean":"2024-05-09T05:04:25.590329+0000","last_became_active":"2024-05-09T05:04:24.201222+0000","last_became_peered":"2024-05-09T05:04:24.201222+0000","last_unstale":"2024-05-09T05:04:25.590329+0000","last_undegraded":"2024-05-09T05:04:25.590329+0000","last_fullsized":"2024-05-09T05:04:25.590329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589083+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:04:25.589083+0000","last_peered":"2024-05-09T05:04:25.589083+0000","last_clean":"2024-05-09T05:04:25.589083+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:04:25.589083+0000","last_undegraded":"2024-05-09T05:04:25.589083+0000","last_fullsized":"2024-05-09T05:04:25.589083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187511+0000","last_change":"2024-05-09T05:04:23.172824+0000","last_active":"2024-05-09T05:04:25.187511+0000","last_peered":"2024-05-09T05:04:25.187511+0000","last_clean":"2024-05-09T05:04:25.187511+0000","last_became_active":"2024-05-09T05:04:23.170516+0000","last_became_peered":"2024-05-09T05:04:23.170516+0000","last_unstale":"2024-05-09T05:04:25.187511+0000","last_undegraded":"2024-05-09T05:04:25.187511+0000","last_fullsized":"2024-05-09T05:04:25.187511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591314+0000","last_change":"2024-05-09T05:04:24.190284+0000","last_active":"2024-05-09T05:04:25.591314+0000","last_peered":"2024-05-09T05:04:25.591314+0000","last_clean":"2024-05-09T05:04:25.591314+0000","last_became_active":"2024-05-09T05:04:24.189965+0000","last_became_peered":"2024-05-09T05:04:24.189965+0000","last_unstale":"2024-05-09T05:04:25.591314+0000","last_undegraded":"2024-05-09T05:04:25.591314+0000","last_fullsized":"2024-05-09T05:04:25.591314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589150+0000","last_change":"2024-05-09T05:04:23.190598+0000","last_active":"2024-05-09T05:04:25.589150+0000","last_peered":"2024-05-09T05:04:25.589150+0000","last_clean":"2024-05-09T05:04:25.589150+0000","last_became_active":"2024-05-09T05:04:23.190004+0000","last_became_peered":"2024-05-09T05:04:23.190004+0000","last_unstale":"2024-05-09T05:04:25.589150+0000","last_undegraded":"2024-05-09T05:04:25.589150+0000","last_fullsized":"2024-05-09T05:04:25.589150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180906+0000","last_change":"2024-05-09T05:04:24.188115+0000","last_active":"2024-05-09T05:04:25.180906+0000","last_peered":"2024-05-09T05:04:25.180906+0000","last_clean":"2024-05-09T05:04:25.180906+0000","last_became_active":"2024-05-09T05:04:24.187747+0000","last_became_peered":"2024-05-09T05:04:24.187747+0000","last_unstale":"2024-05-09T05:04:25.180906+0000","last_undegraded":"2024-05-09T05:04:25.180906+0000","last_fullsized":"2024-05-09T05:04:25.180906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:16.303467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589266+0000","last_change":"2024-05-09T05:04:23.167656+0000","last_active":"2024-05-09T05:04:25.589266+0000","last_peered":"2024-05-09T05:04:25.589266+0000","last_clean":"2024-05-09T05:04:25.589266+0000","last_became_active":"2024-05-09T05:04:23.167341+0000","last_became_peered":"2024-05-09T05:04:23.167341+0000","last_unstale":"2024-05-09T05:04:25.589266+0000","last_undegraded":"2024-05-09T05:04:25.589266+0000","last_fullsized":"2024-05-09T05:04:25.589266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588789+0000","last_change":"2024-05-09T05:04:24.193106+0000","last_active":"2024-05-09T05:04:25.588789+0000","last_peered":"2024-05-09T05:04:25.588789+0000","last_clean":"2024-05-09T05:04:25.588789+0000","last_became_active":"2024-05-09T05:04:24.191023+0000","last_became_peered":"2024-05-09T05:04:24.191023+0000","last_unstale":"2024-05-09T05:04:25.588789+0000","last_undegraded":"2024-05-09T05:04:25.588789+0000","last_fullsized":"2024-05-09T05:04:25.588789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187924+0000","last_change":"2024-05-09T05:04:23.166039+0000","last_active":"2024-05-09T05:04:25.187924+0000","last_peered":"2024-05-09T05:04:25.187924+0000","last_clean":"2024-05-09T05:04:25.187924+0000","last_became_active":"2024-05-09T05:04:23.165410+0000","last_became_peered":"2024-05-09T05:04:23.165410+0000","last_unstale":"2024-05-09T05:04:25.187924+0000","last_undegraded":"2024-05-09T05:04:25.187924+0000","last_fullsized":"2024-05-09T05:04:25.187924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185765+0000","last_change":"2024-05-09T05:04:24.201881+0000","last_active":"2024-05-09T05:04:25.185765+0000","last_peered":"2024-05-09T05:04:25.185765+0000","last_clean":"2024-05-09T05:04:25.185765+0000","last_became_active":"2024-05-09T05:04:24.197108+0000","last_became_peered":"2024-05-09T05:04:24.197108+0000","last_unstale":"2024-05-09T05:04:25.185765+0000","last_undegraded":"2024-05-09T05:04:25.185765+0000","last_fullsized":"2024-05-09T05:04:25.185765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589619+0000","last_change":"2024-05-09T05:04:23.167664+0000","last_active":"2024-05-09T05:04:25.589619+0000","last_peered":"2024-05-09T05:04:25.589619+0000","last_clean":"2024-05-09T05:04:25.589619+0000","last_became_active":"2024-05-09T05:04:23.167332+0000","last_became_peered":"2024-05-09T05:04:23.167332+0000","last_unstale":"2024-05-09T05:04:25.589619+0000","last_undegraded":"2024-05-09T05:04:25.589619+0000","last_fullsized":"2024-05-09T05:04:25.589619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188219+0000","last_change":"2024-05-09T05:04:24.176401+0000","last_active":"2024-05-09T05:04:25.188219+0000","last_peered":"2024-05-09T05:04:25.188219+0000","last_clean":"2024-05-09T05:04:25.188219+0000","last_became_active":"2024-05-09T05:04:24.176054+0000","last_became_peered":"2024-05-09T05:04:24.176054+0000","last_unstale":"2024-05-09T05:04:25.188219+0000","last_undegraded":"2024-05-09T05:04:25.188219+0000","last_fullsized":"2024-05-09T05:04:25.188219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591454+0000","last_change":"2024-05-09T05:04:23.190670+0000","last_active":"2024-05-09T05:04:25.591454+0000","last_peered":"2024-05-09T05:04:25.591454+0000","last_clean":"2024-05-09T05:04:25.591454+0000","last_became_active":"2024-05-09T05:04:23.190356+0000","last_became_peered":"2024-05-09T05:04:23.190356+0000","last_unstale":"2024-05-09T05:04:25.591454+0000","last_undegraded":"2024-05-09T05:04:25.591454+0000","last_fullsized":"2024-05-09T05:04:25.591454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:15.288068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589390+0000","last_change":"2024-05-09T05:04:24.190440+0000","last_active":"2024-05-09T05:04:25.589390+0000","last_peered":"2024-05-09T05:04:25.589390+0000","last_clean":"2024-05-09T05:04:25.589390+0000","last_became_active":"2024-05-09T05:04:24.190123+0000","last_became_peered":"2024-05-09T05:04:24.190123+0000","last_unstale":"2024-05-09T05:04:25.589390+0000","last_undegraded":"2024-05-09T05:04:25.589390+0000","last_fullsized":"2024-05-09T05:04:25.589390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:26.165909+0000","last_change":"2024-05-09T05:04:23.180222+0000","last_active":"2024-05-09T05:04:26.165909+0000","last_peered":"2024-05-09T05:04:26.165909+0000","last_clean":"2024-05-09T05:04:26.165909+0000","last_became_active":"2024-05-09T05:04:23.179880+0000","last_became_peered":"2024-05-09T05:04:23.179880+0000","last_unstale":"2024-05-09T05:04:26.165909+0000","last_undegraded":"2024-05-09T05:04:26.165909+0000","last_fullsized":"2024-05-09T05:04:26.165909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592374+0000","last_change":"2024-05-09T05:04:24.200883+0000","last_active":"2024-05-09T05:04:25.592374+0000","last_peered":"2024-05-09T05:04:25.592374+0000","last_clean":"2024-05-09T05:04:25.592374+0000","last_became_active":"2024-05-09T05:04:24.200559+0000","last_became_peered":"2024-05-09T05:04:24.200559+0000","last_unstale":"2024-05-09T05:04:25.592374+0000","last_undegraded":"2024-05-09T05:04:25.592374+0000","last_fullsized":"2024-05-09T05:04:25.592374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591990+0000","last_change":"2024-05-09T05:04:23.187164+0000","last_active":"2024-05-09T05:04:25.591990+0000","last_peered":"2024-05-09T05:04:25.591990+0000","last_clean":"2024-05-09T05:04:25.591990+0000","last_became_active":"2024-05-09T05:04:23.186835+0000","last_became_peered":"2024-05-09T05:04:23.186835+0000","last_unstale":"2024-05-09T05:04:25.591990+0000","last_undegraded":"2024-05-09T05:04:25.591990+0000","last_fullsized":"2024-05-09T05:04:25.591990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181677+0000","last_change":"2024-05-09T05:04:24.169643+0000","last_active":"2024-05-09T05:04:25.181677+0000","last_peered":"2024-05-09T05:04:25.181677+0000","last_clean":"2024-05-09T05:04:25.181677+0000","last_became_active":"2024-05-09T05:04:24.169348+0000","last_became_peered":"2024-05-09T05:04:24.169348+0000","last_unstale":"2024-05-09T05:04:25.181677+0000","last_undegraded":"2024-05-09T05:04:25.181677+0000","last_fullsized":"2024-05-09T05:04:25.181677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588730+0000","last_change":"2024-05-09T05:04:23.190850+0000","last_active":"2024-05-09T05:04:25.588730+0000","last_peered":"2024-05-09T05:04:25.588730+0000","last_clean":"2024-05-09T05:04:25.588730+0000","last_became_active":"2024-05-09T05:04:23.190358+0000","last_became_peered":"2024-05-09T05:04:23.190358+0000","last_unstale":"2024-05-09T05:04:25.588730+0000","last_undegraded":"2024-05-09T05:04:25.588730+0000","last_fullsized":"2024-05-09T05:04:25.588730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186764+0000","last_change":"2024-05-09T05:04:24.186871+0000","last_active":"2024-05-09T05:04:25.186764+0000","last_peered":"2024-05-09T05:04:25.186764+0000","last_clean":"2024-05-09T05:04:25.186764+0000","last_became_active":"2024-05-09T05:04:24.186416+0000","last_became_peered":"2024-05-09T05:04:24.186416+0000","last_unstale":"2024-05-09T05:04:25.186764+0000","last_undegraded":"2024-05-09T05:04:25.186764+0000","last_fullsized":"2024-05-09T05:04:25.186764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589253+0000","last_change":"2024-05-09T05:04:23.187287+0000","last_active":"2024-05-09T05:04:25.589253+0000","last_peered":"2024-05-09T05:04:25.589253+0000","last_clean":"2024-05-09T05:04:25.589253+0000","last_became_active":"2024-05-09T05:04:23.187041+0000","last_became_peered":"2024-05-09T05:04:23.187041+0000","last_unstale":"2024-05-09T05:04:25.589253+0000","last_undegraded":"2024-05-09T05:04:25.589253+0000","last_fullsized":"2024-05-09T05:04:25.589253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591503+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.591503+0000","last_peered":"2024-05-09T05:04:25.591503+0000","last_clean":"2024-05-09T05:04:25.591503+0000","last_became_active":"2024-05-09T05:04:24.167271+0000","last_became_peered":"2024-05-09T05:04:24.167271+0000","last_unstale":"2024-05-09T05:04:25.591503+0000","last_undegraded":"2024-05-09T05:04:25.591503+0000","last_fullsized":"2024-05-09T05:04:25.591503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590044+0000","last_change":"2024-05-09T05:04:23.161771+0000","last_active":"2024-05-09T05:04:25.590044+0000","last_peered":"2024-05-09T05:04:25.590044+0000","last_clean":"2024-05-09T05:04:25.590044+0000","last_became_active":"2024-05-09T05:04:23.160931+0000","last_became_peered":"2024-05-09T05:04:23.160931+0000","last_unstale":"2024-05-09T05:04:25.590044+0000","last_undegraded":"2024-05-09T05:04:25.590044+0000","last_fullsized":"2024-05-09T05:04:25.590044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592043+0000","last_change":"2024-05-09T05:04:24.167833+0000","last_active":"2024-05-09T05:04:25.592043+0000","last_peered":"2024-05-09T05:04:25.592043+0000","last_clean":"2024-05-09T05:04:25.592043+0000","last_became_active":"2024-05-09T05:04:24.166426+0000","last_became_peered":"2024-05-09T05:04:24.166426+0000","last_unstale":"2024-05-09T05:04:25.592043+0000","last_undegraded":"2024-05-09T05:04:25.592043+0000","last_fullsized":"2024-05-09T05:04:25.592043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591026+0000","last_change":"2024-05-09T05:04:23.188260+0000","last_active":"2024-05-09T05:04:25.591026+0000","last_peered":"2024-05-09T05:04:25.591026+0000","last_clean":"2024-05-09T05:04:25.591026+0000","last_became_active":"2024-05-09T05:04:23.187636+0000","last_became_peered":"2024-05-09T05:04:23.187636+0000","last_unstale":"2024-05-09T05:04:25.591026+0000","last_undegraded":"2024-05-09T05:04:25.591026+0000","last_fullsized":"2024-05-09T05:04:25.591026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:48.016720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588905+0000","last_change":"2024-05-09T05:04:24.198809+0000","last_active":"2024-05-09T05:04:25.588905+0000","last_peered":"2024-05-09T05:04:25.588905+0000","last_clean":"2024-05-09T05:04:25.588905+0000","last_became_active":"2024-05-09T05:04:24.198483+0000","last_became_peered":"2024-05-09T05:04:24.198483+0000","last_unstale":"2024-05-09T05:04:25.588905+0000","last_undegraded":"2024-05-09T05:04:25.588905+0000","last_fullsized":"2024-05-09T05:04:25.588905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187176+0000","last_change":"2024-05-09T05:04:24.191311+0000","last_active":"2024-05-09T05:04:25.187176+0000","last_peered":"2024-05-09T05:04:25.187176+0000","last_clean":"2024-05-09T05:04:25.187176+0000","last_became_active":"2024-05-09T05:04:24.190802+0000","last_became_peered":"2024-05-09T05:04:24.190802+0000","last_unstale":"2024-05-09T05:04:25.187176+0000","last_undegraded":"2024-05-09T05:04:25.187176+0000","last_fullsized":"2024-05-09T05:04:25.187176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590353+0000","last_change":"2024-05-09T05:04:23.190173+0000","last_active":"2024-05-09T05:04:25.590353+0000","last_peered":"2024-05-09T05:04:25.590353+0000","last_clean":"2024-05-09T05:04:25.590353+0000","last_became_active":"2024-05-09T05:04:23.188510+0000","last_became_peered":"2024-05-09T05:04:23.188510+0000","last_unstale":"2024-05-09T05:04:25.590353+0000","last_undegraded":"2024-05-09T05:04:25.590353+0000","last_fullsized":"2024-05-09T05:04:25.590353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:59.427116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187677+0000","last_change":"2024-05-09T05:04:24.203886+0000","last_active":"2024-05-09T05:04:25.187677+0000","last_peered":"2024-05-09T05:04:25.187677+0000","last_clean":"2024-05-09T05:04:25.187677+0000","last_became_active":"2024-05-09T05:04:24.203038+0000","last_became_peered":"2024-05-09T05:04:24.203038+0000","last_unstale":"2024-05-09T05:04:25.187677+0000","last_undegraded":"2024-05-09T05:04:25.187677+0000","last_fullsized":"2024-05-09T05:04:25.187677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590697+0000","last_change":"2024-05-09T05:04:23.190286+0000","last_active":"2024-05-09T05:04:25.590697+0000","last_peered":"2024-05-09T05:04:25.590697+0000","last_clean":"2024-05-09T05:04:25.590697+0000","last_became_active":"2024-05-09T05:04:23.189891+0000","last_became_peered":"2024-05-09T05:04:23.189891+0000","last_unstale":"2024-05-09T05:04:25.590697+0000","last_undegraded":"2024-05-09T05:04:25.590697+0000","last_fullsized":"2024-05-09T05:04:25.590697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:05.623105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181794+0000","last_change":"2024-05-09T05:04:24.184658+0000","last_active":"2024-05-09T05:04:25.181794+0000","last_peered":"2024-05-09T05:04:25.181794+0000","last_clean":"2024-05-09T05:04:25.181794+0000","last_became_active":"2024-05-09T05:04:24.184274+0000","last_became_peered":"2024-05-09T05:04:24.184274+0000","last_unstale":"2024-05-09T05:04:25.181794+0000","last_undegraded":"2024-05-09T05:04:25.181794+0000","last_fullsized":"2024-05-09T05:04:25.181794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592066+0000","last_change":"2024-05-09T05:04:23.163738+0000","last_active":"2024-05-09T05:04:25.592066+0000","last_peered":"2024-05-09T05:04:25.592066+0000","last_clean":"2024-05-09T05:04:25.592066+0000","last_became_active":"2024-05-09T05:04:23.163417+0000","last_became_peered":"2024-05-09T05:04:23.163417+0000","last_unstale":"2024-05-09T05:04:25.592066+0000","last_undegraded":"2024-05-09T05:04:25.592066+0000","last_fullsized":"2024-05-09T05:04:25.592066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592380+0000","last_change":"2024-05-09T05:04:24.188177+0000","last_active":"2024-05-09T05:04:25.592380+0000","last_peered":"2024-05-09T05:04:25.592380+0000","last_clean":"2024-05-09T05:04:25.592380+0000","last_became_active":"2024-05-09T05:04:24.187292+0000","last_became_peered":"2024-05-09T05:04:24.187292+0000","last_unstale":"2024-05-09T05:04:25.592380+0000","last_undegraded":"2024-05-09T05:04:25.592380+0000","last_fullsized":"2024-05-09T05:04:25.592380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181957+0000","last_change":"2024-05-09T05:04:23.181472+0000","last_active":"2024-05-09T05:04:25.181957+0000","last_peered":"2024-05-09T05:04:25.181957+0000","last_clean":"2024-05-09T05:04:25.181957+0000","last_became_active":"2024-05-09T05:04:23.181154+0000","last_became_peered":"2024-05-09T05:04:23.181154+0000","last_unstale":"2024-05-09T05:04:25.181957+0000","last_undegraded":"2024-05-09T05:04:25.181957+0000","last_fullsized":"2024-05-09T05:04:25.181957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:04:34.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:04:34.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.360+0000 7f995e000640 1 Processor -- start 2024-05-09T05:04:34.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.360+0000 7f995e000640 1 -- start start 2024-05-09T05:04:34.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995e000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f99580b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995e000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99580d3660 0x7f99580d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995e000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99580d2f80 con 0x7f99580d1a10 2024-05-09T05:04:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995e000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f99580d4000 con 0x7f99580d3660 2024-05-09T05:04:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995e000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f99580b6190 con 0x7f99580b4530 2024-05-09T05:04:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995d600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f99580d1a10 0x7f99580cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56904/0 (socket says 172.21.15.100:56904) 2024-05-09T05:04:34.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.362+0000 7f995d600640 1 -- 172.21.15.100:0/2853085219 learned_addr learned my addr 172.21.15.100:0/2853085219 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:34.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f995cc00640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f99580b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957e00640 1 --2- 172.21.15.100:0/2853085219 >> v2:172.21.15.133:3300/0 conn(0x7f99580d3660 0x7f99580d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232146551 0 0) 0x7f99580d2f80 con 0x7f99580d1a10 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f993c003520 con 0x7f99580d1a10 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087960082 0 0) 0x7f993c003520 con 0x7f99580d1a10 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 msgr2=0x7f99580b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f99580b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 >> v2:172.21.15.133:3300/0 conn(0x7f99580d3660 msgr2=0x7f99580d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 --2- 172.21.15.100:0/2853085219 >> v2:172.21.15.133:3300/0 conn(0x7f99580d3660 0x7f99580d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99580b51e0 con 0x7f99580d1a10 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f99500016f0 con 0x7f99580d1a10 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 >> v1:172.21.15.100:6789/0 conn(0x7f99580d1a10 legacy=0x7f99580cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f993c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c003fd0 0x7f993c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f993c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99580b6190 con 0x7f993c004d40 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f993c00b9c0 con 0x7f993c003fd0 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f993c00bb90 con 0x7f99580b4530 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.363+0000 7f995d600640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f993c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995cc00640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f993c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f9957e00640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c003fd0 0x7f993c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995d600640 1 -- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 msgr2=0x7f993c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995d600640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f993c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995d600640 1 -- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c003fd0 msgr2=0x7f993c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995d600640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f993c003fd0 0x7f993c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995d600640 1 -- 172.21.15.100:0/2853085219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c003520 con 0x7f993c004d40 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.364+0000 7f995cc00640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99580b4530 0x7f993c003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f995d600640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f993c0051c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f995000c2c0 tx=0x7f993c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9793d85478722cf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950007d50 con 0x7f993c004d40 2024-05-09T05:04:34.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9950005af0 con 0x7f993c004d40 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f9957400640 1 -- 172.21.15.100:0/2853085219 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950007070 con 0x7f993c004d40 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f995e000640 1 -- 172.21.15.100:0/2853085219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 msgr2=0x7f993c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f995e000640 1 --2- 172.21.15.100:0/2853085219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f993c0051c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f995000c2c0 tx=0x7f993c005830 comp rx=0 tx=0).stop 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.365+0000 7f995d600640 1 -- 172.21.15.100:0/2853085219 reap_dead start 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.366+0000 7f995e000640 1 -- 172.21.15.100:0/2853085219 shutdown_connections 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.366+0000 7f995e000640 1 -- 172.21.15.100:0/2853085219 >> 172.21.15.100:0/2853085219 conn(0x7f995808eb30 msgr2=0x7f995809e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.366+0000 7f995e000640 1 -- 172.21.15.100:0/2853085219 shutdown_connections 2024-05-09T05:04:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.366+0000 7f995e000640 1 -- 172.21.15.100:0/2853085219 wait complete. 2024-05-09T05:04:34.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.367+0000 7f995e000640 1 Processor -- start 2024-05-09T05:04:34.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.367+0000 7f995e000640 1 -- start start 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.368+0000 7f995e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f99581574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.368+0000 7f995e000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995815a520 0x7f99580cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.368+0000 7f995e000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99581f5cb0 0x7f9958161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.368+0000 7f995e000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f99580b5730 con 0x7f993c004d40 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.368+0000 7f995e000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f99580b5450 con 0x7f995815a520 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.368+0000 7f995e000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f99580d28d0 con 0x7f99581f5cb0 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f99581574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f99581574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35888/0 (socket says 172.21.15.100:35888) 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 -- 172.21.15.100:0/1376904866 learned_addr learned my addr 172.21.15.100:0/1376904866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f9957e00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995815a520 0x7f99580cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 -- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99581f5cb0 msgr2=0x7f9958161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99581f5cb0 0x7f9958161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 -- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995815a520 msgr2=0x7f99580cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995815a520 0x7f99580cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 -- 172.21.15.100:0/1376904866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99581f5520 con 0x7f993c004d40 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f9957e00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995815a520 0x7f99580cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995cc00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f99581574f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f994800f380 tx=0x7f994800f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948003b90 con 0x7f993c004d40 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948003d30 con 0x7f993c004d40 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948004220 con 0x7f993c004d40 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.369+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995815aa90 con 0x7f993c004d40 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.370+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995815b050 con 0x7f993c004d40 2024-05-09T05:04:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.371+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995806a550 con 0x7f993c004d40 2024-05-09T05:04:34.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.372+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f994801e020 con 0x7f993c004d40 2024-05-09T05:04:34.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.372+0000 7f9954c00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9934076300 0x7f99340787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.373+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9948097d10 con 0x7f993c004d40 2024-05-09T05:04:34.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.373+0000 7f9957e00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9934076300 0x7f99340787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.373+0000 7f9957e00640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9934076300 0x7f99340787c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9958163360 tx=0x7f9940008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:34.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.377+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f994809d020 con 0x7f993c004d40 2024-05-09T05:04:34.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.575+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99580d2d40 con 0x7f9934076300 2024-05-09T05:04:34.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.592+0000 7f9954c00640 1 -- 172.21.15.100:0/1376904866 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f99580d2d40 con 0x7f9934076300 2024-05-09T05:04:34.596 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:34.597 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:04:34.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9934076300 msgr2=0x7f99340787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9934076300 0x7f99340787c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9958163360 tx=0x7f9940008040 comp rx=0 tx=0).stop 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 msgr2=0x7f99581574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f99581574f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f994800f380 tx=0x7f994800f840 comp rx=0 tx=0).stop 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 shutdown_connections 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9934076300 0x7f99340787c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99581f5cb0 0x7f9958161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995815a520 0x7f99580cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 --2- 172.21.15.100:0/1376904866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c004d40 0x7f99581574f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 >> 172.21.15.100:0/1376904866 conn(0x7f995808eb30 msgr2=0x7f99580d4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 shutdown_connections 2024-05-09T05:04:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.597+0000 7f995e000640 1 -- 172.21.15.100:0/1376904866 wait complete. 2024-05-09T05:04:34.616 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-09T05:04:33.884386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219004,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.736984"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591489+0000","last_change":"2024-05-09T05:04:24.203836+0000","last_active":"2024-05-09T05:04:25.591489+0000","last_peered":"2024-05-09T05:04:25.591489+0000","last_clean":"2024-05-09T05:04:25.591489+0000","last_became_active":"2024-05-09T05:04:24.203523+0000","last_became_peered":"2024-05-09T05:04:24.203523+0000","last_unstale":"2024-05-09T05:04:25.591489+0000","last_undegraded":"2024-05-09T05:04:25.591489+0000","last_fullsized":"2024-05-09T05:04:25.591489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:05.764536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589895+0000","last_change":"2024-05-09T05:04:24.173706+0000","last_active":"2024-05-09T05:04:25.589895+0000","last_peered":"2024-05-09T05:04:25.589895+0000","last_clean":"2024-05-09T05:04:25.589895+0000","last_became_active":"2024-05-09T05:04:24.173342+0000","last_became_peered":"2024-05-09T05:04:24.173342+0000","last_unstale":"2024-05-09T05:04:25.589895+0000","last_undegraded":"2024-05-09T05:04:25.589895+0000","last_fullsized":"2024-05-09T05:04:25.589895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181465+0000","last_change":"2024-05-09T05:04:24.189455+0000","last_active":"2024-05-09T05:04:25.181465+0000","last_peered":"2024-05-09T05:04:25.181465+0000","last_clean":"2024-05-09T05:04:25.181465+0000","last_became_active":"2024-05-09T05:04:24.189189+0000","last_became_peered":"2024-05-09T05:04:24.189189+0000","last_unstale":"2024-05-09T05:04:25.181465+0000","last_undegraded":"2024-05-09T05:04:25.181465+0000","last_fullsized":"2024-05-09T05:04:25.181465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187272+0000","last_change":"2024-05-09T05:04:24.178690+0000","last_active":"2024-05-09T05:04:25.187272+0000","last_peered":"2024-05-09T05:04:25.187272+0000","last_clean":"2024-05-09T05:04:25.187272+0000","last_became_active":"2024-05-09T05:04:24.178347+0000","last_became_peered":"2024-05-09T05:04:24.178347+0000","last_unstale":"2024-05-09T05:04:25.187272+0000","last_undegraded":"2024-05-09T05:04:25.187272+0000","last_fullsized":"2024-05-09T05:04:25.187272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590089+0000","last_change":"2024-05-09T05:04:24.191405+0000","last_active":"2024-05-09T05:04:25.590089+0000","last_peered":"2024-05-09T05:04:25.590089+0000","last_clean":"2024-05-09T05:04:25.590089+0000","last_became_active":"2024-05-09T05:04:24.191098+0000","last_became_peered":"2024-05-09T05:04:24.191098+0000","last_unstale":"2024-05-09T05:04:25.590089+0000","last_undegraded":"2024-05-09T05:04:25.590089+0000","last_fullsized":"2024-05-09T05:04:25.590089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186587+0000","last_change":"2024-05-09T05:04:24.179975+0000","last_active":"2024-05-09T05:04:25.186587+0000","last_peered":"2024-05-09T05:04:25.186587+0000","last_clean":"2024-05-09T05:04:25.186587+0000","last_became_active":"2024-05-09T05:04:24.179691+0000","last_became_peered":"2024-05-09T05:04:24.179691+0000","last_unstale":"2024-05-09T05:04:25.186587+0000","last_undegraded":"2024-05-09T05:04:25.186587+0000","last_fullsized":"2024-05-09T05:04:25.186587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589332+0000","last_change":"2024-05-09T05:04:24.203414+0000","last_active":"2024-05-09T05:04:25.589332+0000","last_peered":"2024-05-09T05:04:25.589332+0000","last_clean":"2024-05-09T05:04:25.589332+0000","last_became_active":"2024-05-09T05:04:24.201938+0000","last_became_peered":"2024-05-09T05:04:24.201938+0000","last_unstale":"2024-05-09T05:04:25.589332+0000","last_undegraded":"2024-05-09T05:04:25.589332+0000","last_fullsized":"2024-05-09T05:04:25.589332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591210+0000","last_change":"2024-05-09T05:04:24.184991+0000","last_active":"2024-05-09T05:04:25.591210+0000","last_peered":"2024-05-09T05:04:25.591210+0000","last_clean":"2024-05-09T05:04:25.591210+0000","last_became_active":"2024-05-09T05:04:24.184661+0000","last_became_peered":"2024-05-09T05:04:24.184661+0000","last_unstale":"2024-05-09T05:04:25.591210+0000","last_undegraded":"2024-05-09T05:04:25.591210+0000","last_fullsized":"2024-05-09T05:04:25.591210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591708+0000","last_change":"2024-05-09T05:04:24.205483+0000","last_active":"2024-05-09T05:04:25.591708+0000","last_peered":"2024-05-09T05:04:25.591708+0000","last_clean":"2024-05-09T05:04:25.591708+0000","last_became_active":"2024-05-09T05:04:24.205172+0000","last_became_peered":"2024-05-09T05:04:24.205172+0000","last_unstale":"2024-05-09T05:04:25.591708+0000","last_undegraded":"2024-05-09T05:04:25.591708+0000","last_fullsized":"2024-05-09T05:04:25.591708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:42.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590912+0000","last_change":"2024-05-09T05:04:24.189101+0000","last_active":"2024-05-09T05:04:25.590912+0000","last_peered":"2024-05-09T05:04:25.590912+0000","last_clean":"2024-05-09T05:04:25.590912+0000","last_became_active":"2024-05-09T05:04:24.188782+0000","last_became_peered":"2024-05-09T05:04:24.188782+0000","last_unstale":"2024-05-09T05:04:25.590912+0000","last_undegraded":"2024-05-09T05:04:25.590912+0000","last_fullsized":"2024-05-09T05:04:25.590912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590328+0000","last_change":"2024-05-09T05:04:24.194232+0000","last_active":"2024-05-09T05:04:25.590328+0000","last_peered":"2024-05-09T05:04:25.590328+0000","last_clean":"2024-05-09T05:04:25.590328+0000","last_became_active":"2024-05-09T05:04:24.193406+0000","last_became_peered":"2024-05-09T05:04:24.193406+0000","last_unstale":"2024-05-09T05:04:25.590328+0000","last_undegraded":"2024-05-09T05:04:25.590328+0000","last_fullsized":"2024-05-09T05:04:25.590328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185677+0000","last_change":"2024-05-09T05:04:24.191071+0000","last_active":"2024-05-09T05:04:25.185677+0000","last_peered":"2024-05-09T05:04:25.185677+0000","last_clean":"2024-05-09T05:04:25.185677+0000","last_became_active":"2024-05-09T05:04:24.190796+0000","last_became_peered":"2024-05-09T05:04:24.190796+0000","last_unstale":"2024-05-09T05:04:25.185677+0000","last_undegraded":"2024-05-09T05:04:25.185677+0000","last_fullsized":"2024-05-09T05:04:25.185677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:51.000950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591619+0000","last_change":"2024-05-09T05:04:24.181185+0000","last_active":"2024-05-09T05:04:25.591619+0000","last_peered":"2024-05-09T05:04:25.591619+0000","last_clean":"2024-05-09T05:04:25.591619+0000","last_became_active":"2024-05-09T05:04:24.180913+0000","last_became_peered":"2024-05-09T05:04:24.180913+0000","last_unstale":"2024-05-09T05:04:25.591619+0000","last_undegraded":"2024-05-09T05:04:25.591619+0000","last_fullsized":"2024-05-09T05:04:25.591619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181113+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.181113+0000","last_peered":"2024-05-09T05:04:25.181113+0000","last_clean":"2024-05-09T05:04:25.181113+0000","last_became_active":"2024-05-09T05:04:24.167267+0000","last_became_peered":"2024-05-09T05:04:24.167267+0000","last_unstale":"2024-05-09T05:04:25.181113+0000","last_undegraded":"2024-05-09T05:04:25.181113+0000","last_fullsized":"2024-05-09T05:04:25.181113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588520+0000","last_change":"2024-05-09T05:04:24.198074+0000","last_active":"2024-05-09T05:04:25.588520+0000","last_peered":"2024-05-09T05:04:25.588520+0000","last_clean":"2024-05-09T05:04:25.588520+0000","last_became_active":"2024-05-09T05:04:24.197831+0000","last_became_peered":"2024-05-09T05:04:24.197831+0000","last_unstale":"2024-05-09T05:04:25.588520+0000","last_undegraded":"2024-05-09T05:04:25.588520+0000","last_fullsized":"2024-05-09T05:04:25.588520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184408+0000","last_change":"2024-05-09T05:04:24.173451+0000","last_active":"2024-05-09T05:04:25.184408+0000","last_peered":"2024-05-09T05:04:25.184408+0000","last_clean":"2024-05-09T05:04:25.184408+0000","last_became_active":"2024-05-09T05:04:24.172936+0000","last_became_peered":"2024-05-09T05:04:24.172936+0000","last_unstale":"2024-05-09T05:04:25.184408+0000","last_undegraded":"2024-05-09T05:04:25.184408+0000","last_fullsized":"2024-05-09T05:04:25.184408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188372+0000","last_change":"2024-05-09T05:04:24.202382+0000","last_active":"2024-05-09T05:04:25.188372+0000","last_peered":"2024-05-09T05:04:25.188372+0000","last_clean":"2024-05-09T05:04:25.188372+0000","last_became_active":"2024-05-09T05:04:24.201887+0000","last_became_peered":"2024-05-09T05:04:24.201887+0000","last_unstale":"2024-05-09T05:04:25.188372+0000","last_undegraded":"2024-05-09T05:04:25.188372+0000","last_fullsized":"2024-05-09T05:04:25.188372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589079+0000","last_change":"2024-05-09T05:04:24.194414+0000","last_active":"2024-05-09T05:04:25.589079+0000","last_peered":"2024-05-09T05:04:25.589079+0000","last_clean":"2024-05-09T05:04:25.589079+0000","last_became_active":"2024-05-09T05:04:24.194106+0000","last_became_peered":"2024-05-09T05:04:24.194106+0000","last_unstale":"2024-05-09T05:04:25.589079+0000","last_undegraded":"2024-05-09T05:04:25.589079+0000","last_fullsized":"2024-05-09T05:04:25.589079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591114+0000","last_change":"2024-05-09T05:04:24.197967+0000","last_active":"2024-05-09T05:04:25.591114+0000","last_peered":"2024-05-09T05:04:25.591114+0000","last_clean":"2024-05-09T05:04:25.591114+0000","last_became_active":"2024-05-09T05:04:24.197672+0000","last_became_peered":"2024-05-09T05:04:24.197672+0000","last_unstale":"2024-05-09T05:04:25.591114+0000","last_undegraded":"2024-05-09T05:04:25.591114+0000","last_fullsized":"2024-05-09T05:04:25.591114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:00:16.600001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589820+0000","last_change":"2024-05-09T05:04:24.203278+0000","last_active":"2024-05-09T05:04:25.589820+0000","last_peered":"2024-05-09T05:04:25.589820+0000","last_clean":"2024-05-09T05:04:25.589820+0000","last_became_active":"2024-05-09T05:04:24.202994+0000","last_became_peered":"2024-05-09T05:04:24.202994+0000","last_unstale":"2024-05-09T05:04:25.589820+0000","last_undegraded":"2024-05-09T05:04:25.589820+0000","last_fullsized":"2024-05-09T05:04:25.589820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180771+0000","last_change":"2024-05-09T05:04:24.199162+0000","last_active":"2024-05-09T05:04:25.180771+0000","last_peered":"2024-05-09T05:04:25.180771+0000","last_clean":"2024-05-09T05:04:25.180771+0000","last_became_active":"2024-05-09T05:04:24.198809+0000","last_became_peered":"2024-05-09T05:04:24.198809+0000","last_unstale":"2024-05-09T05:04:25.180771+0000","last_undegraded":"2024-05-09T05:04:25.180771+0000","last_fullsized":"2024-05-09T05:04:25.180771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:06.638505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187003+0000","last_change":"2024-05-09T05:04:24.193592+0000","last_active":"2024-05-09T05:04:25.187003+0000","last_peered":"2024-05-09T05:04:25.187003+0000","last_clean":"2024-05-09T05:04:25.187003+0000","last_became_active":"2024-05-09T05:04:24.190111+0000","last_became_peered":"2024-05-09T05:04:24.190111+0000","last_unstale":"2024-05-09T05:04:25.187003+0000","last_undegraded":"2024-05-09T05:04:25.187003+0000","last_fullsized":"2024-05-09T05:04:25.187003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591263+0000","last_change":"2024-05-09T05:04:24.195840+0000","last_active":"2024-05-09T05:04:25.591263+0000","last_peered":"2024-05-09T05:04:25.591263+0000","last_clean":"2024-05-09T05:04:25.591263+0000","last_became_active":"2024-05-09T05:04:24.195548+0000","last_became_peered":"2024-05-09T05:04:24.195548+0000","last_unstale":"2024-05-09T05:04:25.591263+0000","last_undegraded":"2024-05-09T05:04:25.591263+0000","last_fullsized":"2024-05-09T05:04:25.591263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.184835+0000","last_change":"2024-05-09T05:04:24.177654+0000","last_active":"2024-05-09T05:04:25.184835+0000","last_peered":"2024-05-09T05:04:25.184835+0000","last_clean":"2024-05-09T05:04:25.184835+0000","last_became_active":"2024-05-09T05:04:24.177281+0000","last_became_peered":"2024-05-09T05:04:24.177281+0000","last_unstale":"2024-05-09T05:04:25.184835+0000","last_undegraded":"2024-05-09T05:04:25.184835+0000","last_fullsized":"2024-05-09T05:04:25.184835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592160+0000","last_change":"2024-05-09T05:04:24.194016+0000","last_active":"2024-05-09T05:04:25.592160+0000","last_peered":"2024-05-09T05:04:25.592160+0000","last_clean":"2024-05-09T05:04:25.592160+0000","last_became_active":"2024-05-09T05:04:24.193720+0000","last_became_peered":"2024-05-09T05:04:24.193720+0000","last_unstale":"2024-05-09T05:04:25.592160+0000","last_undegraded":"2024-05-09T05:04:25.592160+0000","last_fullsized":"2024-05-09T05:04:25.592160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:06.949181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591104+0000","last_change":"2024-05-09T05:04:24.189812+0000","last_active":"2024-05-09T05:04:25.591104+0000","last_peered":"2024-05-09T05:04:25.591104+0000","last_clean":"2024-05-09T05:04:25.591104+0000","last_became_active":"2024-05-09T05:04:24.189449+0000","last_became_peered":"2024-05-09T05:04:24.189449+0000","last_unstale":"2024-05-09T05:04:25.591104+0000","last_undegraded":"2024-05-09T05:04:25.591104+0000","last_fullsized":"2024-05-09T05:04:25.591104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590046+0000","last_change":"2024-05-09T05:04:24.176362+0000","last_active":"2024-05-09T05:04:25.590046+0000","last_peered":"2024-05-09T05:04:25.590046+0000","last_clean":"2024-05-09T05:04:25.590046+0000","last_became_active":"2024-05-09T05:04:24.176105+0000","last_became_peered":"2024-05-09T05:04:24.176105+0000","last_unstale":"2024-05-09T05:04:25.590046+0000","last_undegraded":"2024-05-09T05:04:25.590046+0000","last_fullsized":"2024-05-09T05:04:25.590046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592264+0000","last_change":"2024-05-09T05:04:24.202970+0000","last_active":"2024-05-09T05:04:25.592264+0000","last_peered":"2024-05-09T05:04:25.592264+0000","last_clean":"2024-05-09T05:04:25.592264+0000","last_became_active":"2024-05-09T05:04:24.202686+0000","last_became_peered":"2024-05-09T05:04:24.202686+0000","last_unstale":"2024-05-09T05:04:25.592264+0000","last_undegraded":"2024-05-09T05:04:25.592264+0000","last_fullsized":"2024-05-09T05:04:25.592264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180896+0000","last_change":"2024-05-09T05:04:24.174802+0000","last_active":"2024-05-09T05:04:25.180896+0000","last_peered":"2024-05-09T05:04:25.180896+0000","last_clean":"2024-05-09T05:04:25.180896+0000","last_became_active":"2024-05-09T05:04:24.174563+0000","last_became_peered":"2024-05-09T05:04:24.174563+0000","last_unstale":"2024-05-09T05:04:25.180896+0000","last_undegraded":"2024-05-09T05:04:25.180896+0000","last_fullsized":"2024-05-09T05:04:25.180896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:05.877889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187440+0000","last_change":"2024-05-09T05:04:24.177693+0000","last_active":"2024-05-09T05:04:25.187440+0000","last_peered":"2024-05-09T05:04:25.187440+0000","last_clean":"2024-05-09T05:04:25.187440+0000","last_became_active":"2024-05-09T05:04:24.177378+0000","last_became_peered":"2024-05-09T05:04:24.177378+0000","last_unstale":"2024-05-09T05:04:25.187440+0000","last_undegraded":"2024-05-09T05:04:25.187440+0000","last_fullsized":"2024-05-09T05:04:25.187440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588726+0000","last_change":"2024-05-09T05:04:24.187125+0000","last_active":"2024-05-09T05:04:25.588726+0000","last_peered":"2024-05-09T05:04:25.588726+0000","last_clean":"2024-05-09T05:04:25.588726+0000","last_became_active":"2024-05-09T05:04:24.186891+0000","last_became_peered":"2024-05-09T05:04:24.186891+0000","last_unstale":"2024-05-09T05:04:25.588726+0000","last_undegraded":"2024-05-09T05:04:25.588726+0000","last_fullsized":"2024-05-09T05:04:25.588726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588587+0000","last_change":"2024-05-09T05:04:24.181177+0000","last_active":"2024-05-09T05:04:25.588587+0000","last_peered":"2024-05-09T05:04:25.588587+0000","last_clean":"2024-05-09T05:04:25.588587+0000","last_became_active":"2024-05-09T05:04:24.180833+0000","last_became_peered":"2024-05-09T05:04:24.180833+0000","last_unstale":"2024-05-09T05:04:25.588587+0000","last_undegraded":"2024-05-09T05:04:25.588587+0000","last_fullsized":"2024-05-09T05:04:25.588587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185228+0000","last_change":"2024-05-09T05:04:24.193208+0000","last_active":"2024-05-09T05:04:25.185228+0000","last_peered":"2024-05-09T05:04:25.185228+0000","last_clean":"2024-05-09T05:04:25.185228+0000","last_became_active":"2024-05-09T05:04:24.192925+0000","last_became_peered":"2024-05-09T05:04:24.192925+0000","last_unstale":"2024-05-09T05:04:25.185228+0000","last_undegraded":"2024-05-09T05:04:25.185228+0000","last_fullsized":"2024-05-09T05:04:25.185228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:34.632849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592174+0000","last_change":"2024-05-09T05:04:23.180425+0000","last_active":"2024-05-09T05:04:25.592174+0000","last_peered":"2024-05-09T05:04:25.592174+0000","last_clean":"2024-05-09T05:04:25.592174+0000","last_became_active":"2024-05-09T05:04:23.180148+0000","last_became_peered":"2024-05-09T05:04:23.180148+0000","last_unstale":"2024-05-09T05:04:25.592174+0000","last_undegraded":"2024-05-09T05:04:25.592174+0000","last_fullsized":"2024-05-09T05:04:25.592174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180999+0000","last_change":"2024-05-09T05:04:24.195547+0000","last_active":"2024-05-09T05:04:25.180999+0000","last_peered":"2024-05-09T05:04:25.180999+0000","last_clean":"2024-05-09T05:04:25.180999+0000","last_became_active":"2024-05-09T05:04:24.195230+0000","last_became_peered":"2024-05-09T05:04:24.195230+0000","last_unstale":"2024-05-09T05:04:25.180999+0000","last_undegraded":"2024-05-09T05:04:25.180999+0000","last_fullsized":"2024-05-09T05:04:25.180999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:10:13.905334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588849+0000","last_change":"2024-05-09T05:04:23.181255+0000","last_active":"2024-05-09T05:04:25.588849+0000","last_peered":"2024-05-09T05:04:25.588849+0000","last_clean":"2024-05-09T05:04:25.588849+0000","last_became_active":"2024-05-09T05:04:23.180998+0000","last_became_peered":"2024-05-09T05:04:23.180998+0000","last_unstale":"2024-05-09T05:04:25.588849+0000","last_undegraded":"2024-05-09T05:04:25.588849+0000","last_fullsized":"2024-05-09T05:04:25.588849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591449+0000","last_change":"2024-05-09T05:04:23.180456+0000","last_active":"2024-05-09T05:04:25.591449+0000","last_peered":"2024-05-09T05:04:25.591449+0000","last_clean":"2024-05-09T05:04:25.591449+0000","last_became_active":"2024-05-09T05:04:23.179393+0000","last_became_peered":"2024-05-09T05:04:23.179393+0000","last_unstale":"2024-05-09T05:04:25.591449+0000","last_undegraded":"2024-05-09T05:04:25.591449+0000","last_fullsized":"2024-05-09T05:04:25.591449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591092+0000","last_change":"2024-05-09T05:04:24.168133+0000","last_active":"2024-05-09T05:04:25.591092+0000","last_peered":"2024-05-09T05:04:25.591092+0000","last_clean":"2024-05-09T05:04:25.591092+0000","last_became_active":"2024-05-09T05:04:24.167871+0000","last_became_peered":"2024-05-09T05:04:24.167871+0000","last_unstale":"2024-05-09T05:04:25.591092+0000","last_undegraded":"2024-05-09T05:04:25.591092+0000","last_fullsized":"2024-05-09T05:04:25.591092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185098+0000","last_change":"2024-05-09T05:04:23.185286+0000","last_active":"2024-05-09T05:04:25.185098+0000","last_peered":"2024-05-09T05:04:25.185098+0000","last_clean":"2024-05-09T05:04:25.185098+0000","last_became_active":"2024-05-09T05:04:23.184998+0000","last_became_peered":"2024-05-09T05:04:23.184998+0000","last_unstale":"2024-05-09T05:04:25.185098+0000","last_undegraded":"2024-05-09T05:04:25.185098+0000","last_fullsized":"2024-05-09T05:04:25.185098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588614+0000","last_change":"2024-05-09T05:04:24.175033+0000","last_active":"2024-05-09T05:04:25.588614+0000","last_peered":"2024-05-09T05:04:25.588614+0000","last_clean":"2024-05-09T05:04:25.588614+0000","last_became_active":"2024-05-09T05:04:24.174753+0000","last_became_peered":"2024-05-09T05:04:24.174753+0000","last_unstale":"2024-05-09T05:04:25.588614+0000","last_undegraded":"2024-05-09T05:04:25.588614+0000","last_fullsized":"2024-05-09T05:04:25.588614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591751+0000","last_change":"2024-05-09T05:04:23.182654+0000","last_active":"2024-05-09T05:04:25.591751+0000","last_peered":"2024-05-09T05:04:25.591751+0000","last_clean":"2024-05-09T05:04:25.591751+0000","last_became_active":"2024-05-09T05:04:23.182087+0000","last_became_peered":"2024-05-09T05:04:23.182087+0000","last_unstale":"2024-05-09T05:04:25.591751+0000","last_undegraded":"2024-05-09T05:04:25.591751+0000","last_fullsized":"2024-05-09T05:04:25.591751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187491+0000","last_change":"2024-05-09T05:04:24.194301+0000","last_active":"2024-05-09T05:04:25.187491+0000","last_peered":"2024-05-09T05:04:25.187491+0000","last_clean":"2024-05-09T05:04:25.187491+0000","last_became_active":"2024-05-09T05:04:24.190096+0000","last_became_peered":"2024-05-09T05:04:24.190096+0000","last_unstale":"2024-05-09T05:04:25.187491+0000","last_undegraded":"2024-05-09T05:04:25.187491+0000","last_fullsized":"2024-05-09T05:04:25.187491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187700+0000","last_change":"2024-05-09T05:04:23.186630+0000","last_active":"2024-05-09T05:04:25.187700+0000","last_peered":"2024-05-09T05:04:25.187700+0000","last_clean":"2024-05-09T05:04:25.187700+0000","last_became_active":"2024-05-09T05:04:23.186214+0000","last_became_peered":"2024-05-09T05:04:23.186214+0000","last_unstale":"2024-05-09T05:04:25.187700+0000","last_undegraded":"2024-05-09T05:04:25.187700+0000","last_fullsized":"2024-05-09T05:04:25.187700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181800+0000","last_change":"2024-05-09T05:04:24.184201+0000","last_active":"2024-05-09T05:04:25.181800+0000","last_peered":"2024-05-09T05:04:25.181800+0000","last_clean":"2024-05-09T05:04:25.181800+0000","last_became_active":"2024-05-09T05:04:24.183907+0000","last_became_peered":"2024-05-09T05:04:24.183907+0000","last_unstale":"2024-05-09T05:04:25.181800+0000","last_undegraded":"2024-05-09T05:04:25.181800+0000","last_fullsized":"2024-05-09T05:04:25.181800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:53:12.658799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590227+0000","last_change":"2024-05-09T05:04:23.174192+0000","last_active":"2024-05-09T05:04:25.590227+0000","last_peered":"2024-05-09T05:04:25.590227+0000","last_clean":"2024-05-09T05:04:25.590227+0000","last_became_active":"2024-05-09T05:04:23.173954+0000","last_became_peered":"2024-05-09T05:04:23.173954+0000","last_unstale":"2024-05-09T05:04:25.590227+0000","last_undegraded":"2024-05-09T05:04:25.590227+0000","last_fullsized":"2024-05-09T05:04:25.590227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187980+0000","last_change":"2024-05-09T05:04:24.199870+0000","last_active":"2024-05-09T05:04:25.187980+0000","last_peered":"2024-05-09T05:04:25.187980+0000","last_clean":"2024-05-09T05:04:25.187980+0000","last_became_active":"2024-05-09T05:04:24.194765+0000","last_became_peered":"2024-05-09T05:04:24.194765+0000","last_unstale":"2024-05-09T05:04:25.187980+0000","last_undegraded":"2024-05-09T05:04:25.187980+0000","last_fullsized":"2024-05-09T05:04:25.187980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:00.442516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589940+0000","last_change":"2024-05-09T05:04:23.178383+0000","last_active":"2024-05-09T05:04:25.589940+0000","last_peered":"2024-05-09T05:04:25.589940+0000","last_clean":"2024-05-09T05:04:25.589940+0000","last_became_active":"2024-05-09T05:04:23.177752+0000","last_became_peered":"2024-05-09T05:04:23.177752+0000","last_unstale":"2024-05-09T05:04:25.589940+0000","last_undegraded":"2024-05-09T05:04:25.589940+0000","last_fullsized":"2024-05-09T05:04:25.589940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590379+0000","last_change":"2024-05-09T05:04:24.198031+0000","last_active":"2024-05-09T05:04:25.590379+0000","last_peered":"2024-05-09T05:04:25.590379+0000","last_clean":"2024-05-09T05:04:25.590379+0000","last_became_active":"2024-05-09T05:04:24.197675+0000","last_became_peered":"2024-05-09T05:04:24.197675+0000","last_unstale":"2024-05-09T05:04:25.590379+0000","last_undegraded":"2024-05-09T05:04:25.590379+0000","last_fullsized":"2024-05-09T05:04:25.590379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181054+0000","last_change":"2024-05-09T05:04:23.172214+0000","last_active":"2024-05-09T05:04:25.181054+0000","last_peered":"2024-05-09T05:04:25.181054+0000","last_clean":"2024-05-09T05:04:25.181054+0000","last_became_active":"2024-05-09T05:04:23.171697+0000","last_became_peered":"2024-05-09T05:04:23.171697+0000","last_unstale":"2024-05-09T05:04:25.181054+0000","last_undegraded":"2024-05-09T05:04:25.181054+0000","last_fullsized":"2024-05-09T05:04:25.181054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:14:52.910962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181247+0000","last_change":"2024-05-09T05:04:24.200063+0000","last_active":"2024-05-09T05:04:25.181247+0000","last_peered":"2024-05-09T05:04:25.181247+0000","last_clean":"2024-05-09T05:04:25.181247+0000","last_became_active":"2024-05-09T05:04:24.198772+0000","last_became_peered":"2024-05-09T05:04:24.198772+0000","last_unstale":"2024-05-09T05:04:25.181247+0000","last_undegraded":"2024-05-09T05:04:25.181247+0000","last_fullsized":"2024-05-09T05:04:25.181247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187721+0000","last_change":"2024-05-09T05:04:23.175634+0000","last_active":"2024-05-09T05:04:25.187721+0000","last_peered":"2024-05-09T05:04:25.187721+0000","last_clean":"2024-05-09T05:04:25.187721+0000","last_became_active":"2024-05-09T05:04:23.173526+0000","last_became_peered":"2024-05-09T05:04:23.173526+0000","last_unstale":"2024-05-09T05:04:25.187721+0000","last_undegraded":"2024-05-09T05:04:25.187721+0000","last_fullsized":"2024-05-09T05:04:25.187721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590502+0000","last_change":"2024-05-09T05:04:24.205506+0000","last_active":"2024-05-09T05:04:25.590502+0000","last_peered":"2024-05-09T05:04:25.590502+0000","last_clean":"2024-05-09T05:04:25.590502+0000","last_became_active":"2024-05-09T05:04:24.205221+0000","last_became_peered":"2024-05-09T05:04:24.205221+0000","last_unstale":"2024-05-09T05:04:25.590502+0000","last_undegraded":"2024-05-09T05:04:25.590502+0000","last_fullsized":"2024-05-09T05:04:25.590502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:53.073210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588601+0000","last_change":"2024-05-09T05:04:23.183566+0000","last_active":"2024-05-09T05:04:25.588601+0000","last_peered":"2024-05-09T05:04:25.588601+0000","last_clean":"2024-05-09T05:04:25.588601+0000","last_became_active":"2024-05-09T05:04:23.182348+0000","last_became_peered":"2024-05-09T05:04:23.182348+0000","last_unstale":"2024-05-09T05:04:25.588601+0000","last_undegraded":"2024-05-09T05:04:25.588601+0000","last_fullsized":"2024-05-09T05:04:25.588601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588690+0000","last_change":"2024-05-09T05:04:24.185048+0000","last_active":"2024-05-09T05:04:25.588690+0000","last_peered":"2024-05-09T05:04:25.588690+0000","last_clean":"2024-05-09T05:04:25.588690+0000","last_became_active":"2024-05-09T05:04:24.184774+0000","last_became_peered":"2024-05-09T05:04:24.184774+0000","last_unstale":"2024-05-09T05:04:25.588690+0000","last_undegraded":"2024-05-09T05:04:25.588690+0000","last_fullsized":"2024-05-09T05:04:25.588690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:18.972244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588925+0000","last_change":"2024-05-09T05:04:23.166873+0000","last_active":"2024-05-09T05:04:25.588925+0000","last_peered":"2024-05-09T05:04:25.588925+0000","last_clean":"2024-05-09T05:04:25.588925+0000","last_became_active":"2024-05-09T05:04:23.166497+0000","last_became_peered":"2024-05-09T05:04:23.166497+0000","last_unstale":"2024-05-09T05:04:25.588925+0000","last_undegraded":"2024-05-09T05:04:25.588925+0000","last_fullsized":"2024-05-09T05:04:25.588925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589440+0000","last_change":"2024-05-09T05:04:24.206139+0000","last_active":"2024-05-09T05:04:25.589440+0000","last_peered":"2024-05-09T05:04:25.589440+0000","last_clean":"2024-05-09T05:04:25.589440+0000","last_became_active":"2024-05-09T05:04:24.205511+0000","last_became_peered":"2024-05-09T05:04:24.205511+0000","last_unstale":"2024-05-09T05:04:25.589440+0000","last_undegraded":"2024-05-09T05:04:25.589440+0000","last_fullsized":"2024-05-09T05:04:25.589440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:25:43.737559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186530+0000","last_change":"2024-05-09T05:04:23.171534+0000","last_active":"2024-05-09T05:04:25.186530+0000","last_peered":"2024-05-09T05:04:25.186530+0000","last_clean":"2024-05-09T05:04:25.186530+0000","last_became_active":"2024-05-09T05:04:23.170897+0000","last_became_peered":"2024-05-09T05:04:23.170897+0000","last_unstale":"2024-05-09T05:04:25.186530+0000","last_undegraded":"2024-05-09T05:04:25.186530+0000","last_fullsized":"2024-05-09T05:04:25.186530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591239+0000","last_change":"2024-05-09T05:04:24.205782+0000","last_active":"2024-05-09T05:04:25.591239+0000","last_peered":"2024-05-09T05:04:25.591239+0000","last_clean":"2024-05-09T05:04:25.591239+0000","last_became_active":"2024-05-09T05:04:24.205206+0000","last_became_peered":"2024-05-09T05:04:24.205206+0000","last_unstale":"2024-05-09T05:04:25.591239+0000","last_undegraded":"2024-05-09T05:04:25.591239+0000","last_fullsized":"2024-05-09T05:04:25.591239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:04.426132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589468+0000","last_change":"2024-05-09T05:04:23.165788+0000","last_active":"2024-05-09T05:04:25.589468+0000","last_peered":"2024-05-09T05:04:25.589468+0000","last_clean":"2024-05-09T05:04:25.589468+0000","last_became_active":"2024-05-09T05:04:23.165479+0000","last_became_peered":"2024-05-09T05:04:23.165479+0000","last_unstale":"2024-05-09T05:04:25.589468+0000","last_undegraded":"2024-05-09T05:04:25.589468+0000","last_fullsized":"2024-05-09T05:04:25.589468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591882+0000","last_change":"2024-05-09T05:04:24.209039+0000","last_active":"2024-05-09T05:04:25.591882+0000","last_peered":"2024-05-09T05:04:25.591882+0000","last_clean":"2024-05-09T05:04:25.591882+0000","last_became_active":"2024-05-09T05:04:24.208701+0000","last_became_peered":"2024-05-09T05:04:24.208701+0000","last_unstale":"2024-05-09T05:04:25.591882+0000","last_undegraded":"2024-05-09T05:04:25.591882+0000","last_fullsized":"2024-05-09T05:04:25.591882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:50:08.737793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590358+0000","last_change":"2024-05-09T05:04:23.180485+0000","last_active":"2024-05-09T05:04:25.590358+0000","last_peered":"2024-05-09T05:04:25.590358+0000","last_clean":"2024-05-09T05:04:25.590358+0000","last_became_active":"2024-05-09T05:04:23.179867+0000","last_became_peered":"2024-05-09T05:04:23.179867+0000","last_unstale":"2024-05-09T05:04:25.590358+0000","last_undegraded":"2024-05-09T05:04:25.590358+0000","last_fullsized":"2024-05-09T05:04:25.590358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188120+0000","last_change":"2024-05-09T05:04:24.178327+0000","last_active":"2024-05-09T05:04:25.188120+0000","last_peered":"2024-05-09T05:04:25.188120+0000","last_clean":"2024-05-09T05:04:25.188120+0000","last_became_active":"2024-05-09T05:04:24.178031+0000","last_became_peered":"2024-05-09T05:04:24.178031+0000","last_unstale":"2024-05-09T05:04:25.188120+0000","last_undegraded":"2024-05-09T05:04:25.188120+0000","last_fullsized":"2024-05-09T05:04:25.188120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589001+0000","last_change":"2024-05-09T05:04:23.178749+0000","last_active":"2024-05-09T05:04:25.589001+0000","last_peered":"2024-05-09T05:04:25.589001+0000","last_clean":"2024-05-09T05:04:25.589001+0000","last_became_active":"2024-05-09T05:04:23.178241+0000","last_became_peered":"2024-05-09T05:04:23.178241+0000","last_unstale":"2024-05-09T05:04:25.589001+0000","last_undegraded":"2024-05-09T05:04:25.589001+0000","last_fullsized":"2024-05-09T05:04:25.589001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:48.004855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590329+0000","last_change":"2024-05-09T05:04:24.201431+0000","last_active":"2024-05-09T05:04:25.590329+0000","last_peered":"2024-05-09T05:04:25.590329+0000","last_clean":"2024-05-09T05:04:25.590329+0000","last_became_active":"2024-05-09T05:04:24.201222+0000","last_became_peered":"2024-05-09T05:04:24.201222+0000","last_unstale":"2024-05-09T05:04:25.590329+0000","last_undegraded":"2024-05-09T05:04:25.590329+0000","last_fullsized":"2024-05-09T05:04:25.590329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:49:45.798517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589083+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:04:25.589083+0000","last_peered":"2024-05-09T05:04:25.589083+0000","last_clean":"2024-05-09T05:04:25.589083+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:04:25.589083+0000","last_undegraded":"2024-05-09T05:04:25.589083+0000","last_fullsized":"2024-05-09T05:04:25.589083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187511+0000","last_change":"2024-05-09T05:04:23.172824+0000","last_active":"2024-05-09T05:04:25.187511+0000","last_peered":"2024-05-09T05:04:25.187511+0000","last_clean":"2024-05-09T05:04:25.187511+0000","last_became_active":"2024-05-09T05:04:23.170516+0000","last_became_peered":"2024-05-09T05:04:23.170516+0000","last_unstale":"2024-05-09T05:04:25.187511+0000","last_undegraded":"2024-05-09T05:04:25.187511+0000","last_fullsized":"2024-05-09T05:04:25.187511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:01:34.800845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591314+0000","last_change":"2024-05-09T05:04:24.190284+0000","last_active":"2024-05-09T05:04:25.591314+0000","last_peered":"2024-05-09T05:04:25.591314+0000","last_clean":"2024-05-09T05:04:25.591314+0000","last_became_active":"2024-05-09T05:04:24.189965+0000","last_became_peered":"2024-05-09T05:04:24.189965+0000","last_unstale":"2024-05-09T05:04:25.591314+0000","last_undegraded":"2024-05-09T05:04:25.591314+0000","last_fullsized":"2024-05-09T05:04:25.591314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589150+0000","last_change":"2024-05-09T05:04:23.190598+0000","last_active":"2024-05-09T05:04:25.589150+0000","last_peered":"2024-05-09T05:04:25.589150+0000","last_clean":"2024-05-09T05:04:25.589150+0000","last_became_active":"2024-05-09T05:04:23.190004+0000","last_became_peered":"2024-05-09T05:04:23.190004+0000","last_unstale":"2024-05-09T05:04:25.589150+0000","last_undegraded":"2024-05-09T05:04:25.589150+0000","last_fullsized":"2024-05-09T05:04:25.589150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.180906+0000","last_change":"2024-05-09T05:04:24.188115+0000","last_active":"2024-05-09T05:04:25.180906+0000","last_peered":"2024-05-09T05:04:25.180906+0000","last_clean":"2024-05-09T05:04:25.180906+0000","last_became_active":"2024-05-09T05:04:24.187747+0000","last_became_peered":"2024-05-09T05:04:24.187747+0000","last_unstale":"2024-05-09T05:04:25.180906+0000","last_undegraded":"2024-05-09T05:04:25.180906+0000","last_fullsized":"2024-05-09T05:04:25.180906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:16.303467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589266+0000","last_change":"2024-05-09T05:04:23.167656+0000","last_active":"2024-05-09T05:04:25.589266+0000","last_peered":"2024-05-09T05:04:25.589266+0000","last_clean":"2024-05-09T05:04:25.589266+0000","last_became_active":"2024-05-09T05:04:23.167341+0000","last_became_peered":"2024-05-09T05:04:23.167341+0000","last_unstale":"2024-05-09T05:04:25.589266+0000","last_undegraded":"2024-05-09T05:04:25.589266+0000","last_fullsized":"2024-05-09T05:04:25.589266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588789+0000","last_change":"2024-05-09T05:04:24.193106+0000","last_active":"2024-05-09T05:04:25.588789+0000","last_peered":"2024-05-09T05:04:25.588789+0000","last_clean":"2024-05-09T05:04:25.588789+0000","last_became_active":"2024-05-09T05:04:24.191023+0000","last_became_peered":"2024-05-09T05:04:24.191023+0000","last_unstale":"2024-05-09T05:04:25.588789+0000","last_undegraded":"2024-05-09T05:04:25.588789+0000","last_fullsized":"2024-05-09T05:04:25.588789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:32.327450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187924+0000","last_change":"2024-05-09T05:04:23.166039+0000","last_active":"2024-05-09T05:04:25.187924+0000","last_peered":"2024-05-09T05:04:25.187924+0000","last_clean":"2024-05-09T05:04:25.187924+0000","last_became_active":"2024-05-09T05:04:23.165410+0000","last_became_peered":"2024-05-09T05:04:23.165410+0000","last_unstale":"2024-05-09T05:04:25.187924+0000","last_undegraded":"2024-05-09T05:04:25.187924+0000","last_fullsized":"2024-05-09T05:04:25.187924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:08:26.421178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.185765+0000","last_change":"2024-05-09T05:04:24.201881+0000","last_active":"2024-05-09T05:04:25.185765+0000","last_peered":"2024-05-09T05:04:25.185765+0000","last_clean":"2024-05-09T05:04:25.185765+0000","last_became_active":"2024-05-09T05:04:24.197108+0000","last_became_peered":"2024-05-09T05:04:24.197108+0000","last_unstale":"2024-05-09T05:04:25.185765+0000","last_undegraded":"2024-05-09T05:04:25.185765+0000","last_fullsized":"2024-05-09T05:04:25.185765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:16.607226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589619+0000","last_change":"2024-05-09T05:04:23.167664+0000","last_active":"2024-05-09T05:04:25.589619+0000","last_peered":"2024-05-09T05:04:25.589619+0000","last_clean":"2024-05-09T05:04:25.589619+0000","last_became_active":"2024-05-09T05:04:23.167332+0000","last_became_peered":"2024-05-09T05:04:23.167332+0000","last_unstale":"2024-05-09T05:04:25.589619+0000","last_undegraded":"2024-05-09T05:04:25.589619+0000","last_fullsized":"2024-05-09T05:04:25.589619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.188219+0000","last_change":"2024-05-09T05:04:24.176401+0000","last_active":"2024-05-09T05:04:25.188219+0000","last_peered":"2024-05-09T05:04:25.188219+0000","last_clean":"2024-05-09T05:04:25.188219+0000","last_became_active":"2024-05-09T05:04:24.176054+0000","last_became_peered":"2024-05-09T05:04:24.176054+0000","last_unstale":"2024-05-09T05:04:25.188219+0000","last_undegraded":"2024-05-09T05:04:25.188219+0000","last_fullsized":"2024-05-09T05:04:25.188219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:41.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591454+0000","last_change":"2024-05-09T05:04:23.190670+0000","last_active":"2024-05-09T05:04:25.591454+0000","last_peered":"2024-05-09T05:04:25.591454+0000","last_clean":"2024-05-09T05:04:25.591454+0000","last_became_active":"2024-05-09T05:04:23.190356+0000","last_became_peered":"2024-05-09T05:04:23.190356+0000","last_unstale":"2024-05-09T05:04:25.591454+0000","last_undegraded":"2024-05-09T05:04:25.591454+0000","last_fullsized":"2024-05-09T05:04:25.591454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:52:15.288068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589390+0000","last_change":"2024-05-09T05:04:24.190440+0000","last_active":"2024-05-09T05:04:25.589390+0000","last_peered":"2024-05-09T05:04:25.589390+0000","last_clean":"2024-05-09T05:04:25.589390+0000","last_became_active":"2024-05-09T05:04:24.190123+0000","last_became_peered":"2024-05-09T05:04:24.190123+0000","last_unstale":"2024-05-09T05:04:25.589390+0000","last_undegraded":"2024-05-09T05:04:25.589390+0000","last_fullsized":"2024-05-09T05:04:25.589390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:26.165909+0000","last_change":"2024-05-09T05:04:23.180222+0000","last_active":"2024-05-09T05:04:26.165909+0000","last_peered":"2024-05-09T05:04:26.165909+0000","last_clean":"2024-05-09T05:04:26.165909+0000","last_became_active":"2024-05-09T05:04:23.179880+0000","last_became_peered":"2024-05-09T05:04:23.179880+0000","last_unstale":"2024-05-09T05:04:26.165909+0000","last_undegraded":"2024-05-09T05:04:26.165909+0000","last_fullsized":"2024-05-09T05:04:26.165909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592374+0000","last_change":"2024-05-09T05:04:24.200883+0000","last_active":"2024-05-09T05:04:25.592374+0000","last_peered":"2024-05-09T05:04:25.592374+0000","last_clean":"2024-05-09T05:04:25.592374+0000","last_became_active":"2024-05-09T05:04:24.200559+0000","last_became_peered":"2024-05-09T05:04:24.200559+0000","last_unstale":"2024-05-09T05:04:25.592374+0000","last_undegraded":"2024-05-09T05:04:25.592374+0000","last_fullsized":"2024-05-09T05:04:25.592374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:21.131866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591990+0000","last_change":"2024-05-09T05:04:23.187164+0000","last_active":"2024-05-09T05:04:25.591990+0000","last_peered":"2024-05-09T05:04:25.591990+0000","last_clean":"2024-05-09T05:04:25.591990+0000","last_became_active":"2024-05-09T05:04:23.186835+0000","last_became_peered":"2024-05-09T05:04:23.186835+0000","last_unstale":"2024-05-09T05:04:25.591990+0000","last_undegraded":"2024-05-09T05:04:25.591990+0000","last_fullsized":"2024-05-09T05:04:25.591990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:49.985551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181677+0000","last_change":"2024-05-09T05:04:24.169643+0000","last_active":"2024-05-09T05:04:25.181677+0000","last_peered":"2024-05-09T05:04:25.181677+0000","last_clean":"2024-05-09T05:04:25.181677+0000","last_became_active":"2024-05-09T05:04:24.169348+0000","last_became_peered":"2024-05-09T05:04:24.169348+0000","last_unstale":"2024-05-09T05:04:25.181677+0000","last_undegraded":"2024-05-09T05:04:25.181677+0000","last_fullsized":"2024-05-09T05:04:25.181677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:41:39.509273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588730+0000","last_change":"2024-05-09T05:04:23.190850+0000","last_active":"2024-05-09T05:04:25.588730+0000","last_peered":"2024-05-09T05:04:25.588730+0000","last_clean":"2024-05-09T05:04:25.588730+0000","last_became_active":"2024-05-09T05:04:23.190358+0000","last_became_peered":"2024-05-09T05:04:23.190358+0000","last_unstale":"2024-05-09T05:04:25.588730+0000","last_undegraded":"2024-05-09T05:04:25.588730+0000","last_fullsized":"2024-05-09T05:04:25.588730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:50:15.591827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.186764+0000","last_change":"2024-05-09T05:04:24.186871+0000","last_active":"2024-05-09T05:04:25.186764+0000","last_peered":"2024-05-09T05:04:25.186764+0000","last_clean":"2024-05-09T05:04:25.186764+0000","last_became_active":"2024-05-09T05:04:24.186416+0000","last_became_peered":"2024-05-09T05:04:24.186416+0000","last_unstale":"2024-05-09T05:04:25.186764+0000","last_undegraded":"2024-05-09T05:04:25.186764+0000","last_fullsized":"2024-05-09T05:04:25.186764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:28.783690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.589253+0000","last_change":"2024-05-09T05:04:23.187287+0000","last_active":"2024-05-09T05:04:25.589253+0000","last_peered":"2024-05-09T05:04:25.589253+0000","last_clean":"2024-05-09T05:04:25.589253+0000","last_became_active":"2024-05-09T05:04:23.187041+0000","last_became_peered":"2024-05-09T05:04:23.187041+0000","last_unstale":"2024-05-09T05:04:25.589253+0000","last_undegraded":"2024-05-09T05:04:25.589253+0000","last_fullsized":"2024-05-09T05:04:25.589253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:16:33.617450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591503+0000","last_change":"2024-05-09T05:04:24.167539+0000","last_active":"2024-05-09T05:04:25.591503+0000","last_peered":"2024-05-09T05:04:25.591503+0000","last_clean":"2024-05-09T05:04:25.591503+0000","last_became_active":"2024-05-09T05:04:24.167271+0000","last_became_peered":"2024-05-09T05:04:24.167271+0000","last_unstale":"2024-05-09T05:04:25.591503+0000","last_undegraded":"2024-05-09T05:04:25.591503+0000","last_fullsized":"2024-05-09T05:04:25.591503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590044+0000","last_change":"2024-05-09T05:04:23.161771+0000","last_active":"2024-05-09T05:04:25.590044+0000","last_peered":"2024-05-09T05:04:25.590044+0000","last_clean":"2024-05-09T05:04:25.590044+0000","last_became_active":"2024-05-09T05:04:23.160931+0000","last_became_peered":"2024-05-09T05:04:23.160931+0000","last_unstale":"2024-05-09T05:04:25.590044+0000","last_undegraded":"2024-05-09T05:04:25.590044+0000","last_fullsized":"2024-05-09T05:04:25.590044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:12:27.768290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592043+0000","last_change":"2024-05-09T05:04:24.167833+0000","last_active":"2024-05-09T05:04:25.592043+0000","last_peered":"2024-05-09T05:04:25.592043+0000","last_clean":"2024-05-09T05:04:25.592043+0000","last_became_active":"2024-05-09T05:04:24.166426+0000","last_became_peered":"2024-05-09T05:04:24.166426+0000","last_unstale":"2024-05-09T05:04:25.592043+0000","last_undegraded":"2024-05-09T05:04:25.592043+0000","last_fullsized":"2024-05-09T05:04:25.592043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:05:07.772555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.591026+0000","last_change":"2024-05-09T05:04:23.188260+0000","last_active":"2024-05-09T05:04:25.591026+0000","last_peered":"2024-05-09T05:04:25.591026+0000","last_clean":"2024-05-09T05:04:25.591026+0000","last_became_active":"2024-05-09T05:04:23.187636+0000","last_became_peered":"2024-05-09T05:04:23.187636+0000","last_unstale":"2024-05-09T05:04:25.591026+0000","last_undegraded":"2024-05-09T05:04:25.591026+0000","last_fullsized":"2024-05-09T05:04:25.591026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:48.016720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.588905+0000","last_change":"2024-05-09T05:04:24.198809+0000","last_active":"2024-05-09T05:04:25.588905+0000","last_peered":"2024-05-09T05:04:25.588905+0000","last_clean":"2024-05-09T05:04:25.588905+0000","last_became_active":"2024-05-09T05:04:24.198483+0000","last_became_peered":"2024-05-09T05:04:24.198483+0000","last_unstale":"2024-05-09T05:04:25.588905+0000","last_undegraded":"2024-05-09T05:04:25.588905+0000","last_fullsized":"2024-05-09T05:04:25.588905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:21:20.377082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187176+0000","last_change":"2024-05-09T05:04:24.191311+0000","last_active":"2024-05-09T05:04:25.187176+0000","last_peered":"2024-05-09T05:04:25.187176+0000","last_clean":"2024-05-09T05:04:25.187176+0000","last_became_active":"2024-05-09T05:04:24.190802+0000","last_became_peered":"2024-05-09T05:04:24.190802+0000","last_unstale":"2024-05-09T05:04:25.187176+0000","last_undegraded":"2024-05-09T05:04:25.187176+0000","last_fullsized":"2024-05-09T05:04:25.187176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:36:26.935452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590353+0000","last_change":"2024-05-09T05:04:23.190173+0000","last_active":"2024-05-09T05:04:25.590353+0000","last_peered":"2024-05-09T05:04:25.590353+0000","last_clean":"2024-05-09T05:04:25.590353+0000","last_became_active":"2024-05-09T05:04:23.188510+0000","last_became_peered":"2024-05-09T05:04:23.188510+0000","last_unstale":"2024-05-09T05:04:25.590353+0000","last_undegraded":"2024-05-09T05:04:25.590353+0000","last_fullsized":"2024-05-09T05:04:25.590353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:02:59.427116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.187677+0000","last_change":"2024-05-09T05:04:24.203886+0000","last_active":"2024-05-09T05:04:25.187677+0000","last_peered":"2024-05-09T05:04:25.187677+0000","last_clean":"2024-05-09T05:04:25.187677+0000","last_became_active":"2024-05-09T05:04:24.203038+0000","last_became_peered":"2024-05-09T05:04:24.203038+0000","last_unstale":"2024-05-09T05:04:25.187677+0000","last_undegraded":"2024-05-09T05:04:25.187677+0000","last_fullsized":"2024-05-09T05:04:25.187677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:34:44.453115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.590697+0000","last_change":"2024-05-09T05:04:23.190286+0000","last_active":"2024-05-09T05:04:25.590697+0000","last_peered":"2024-05-09T05:04:25.590697+0000","last_clean":"2024-05-09T05:04:25.590697+0000","last_became_active":"2024-05-09T05:04:23.189891+0000","last_became_peered":"2024-05-09T05:04:23.189891+0000","last_unstale":"2024-05-09T05:04:25.590697+0000","last_undegraded":"2024-05-09T05:04:25.590697+0000","last_fullsized":"2024-05-09T05:04:25.590697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:58:05.623105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181794+0000","last_change":"2024-05-09T05:04:24.184658+0000","last_active":"2024-05-09T05:04:25.181794+0000","last_peered":"2024-05-09T05:04:25.181794+0000","last_clean":"2024-05-09T05:04:25.181794+0000","last_became_active":"2024-05-09T05:04:24.184274+0000","last_became_peered":"2024-05-09T05:04:24.184274+0000","last_unstale":"2024-05-09T05:04:25.181794+0000","last_undegraded":"2024-05-09T05:04:25.181794+0000","last_fullsized":"2024-05-09T05:04:25.181794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:39.399129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592066+0000","last_change":"2024-05-09T05:04:23.163738+0000","last_active":"2024-05-09T05:04:25.592066+0000","last_peered":"2024-05-09T05:04:25.592066+0000","last_clean":"2024-05-09T05:04:25.592066+0000","last_became_active":"2024-05-09T05:04:23.163417+0000","last_became_peered":"2024-05-09T05:04:23.163417+0000","last_unstale":"2024-05-09T05:04:25.592066+0000","last_undegraded":"2024-05-09T05:04:25.592066+0000","last_fullsized":"2024-05-09T05:04:25.592066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:46:44.802539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.592380+0000","last_change":"2024-05-09T05:04:24.188177+0000","last_active":"2024-05-09T05:04:25.592380+0000","last_peered":"2024-05-09T05:04:25.592380+0000","last_clean":"2024-05-09T05:04:25.592380+0000","last_became_active":"2024-05-09T05:04:24.187292+0000","last_became_peered":"2024-05-09T05:04:24.187292+0000","last_unstale":"2024-05-09T05:04:25.592380+0000","last_undegraded":"2024-05-09T05:04:25.592380+0000","last_fullsized":"2024-05-09T05:04:25.592380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:23.124898+0000","last_clean_scrub_stamp":"2024-05-09T05:04:23.124898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-09T05:04:25.181957+0000","last_change":"2024-05-09T05:04:23.181472+0000","last_active":"2024-05-09T05:04:25.181957+0000","last_peered":"2024-05-09T05:04:25.181957+0000","last_clean":"2024-05-09T05:04:25.181957+0000","last_became_active":"2024-05-09T05:04:23.181154+0000","last_became_peered":"2024-05-09T05:04:23.181154+0000","last_unstale":"2024-05-09T05:04:25.181957+0000","last_undegraded":"2024-05-09T05:04:25.181957+0000","last_fullsized":"2024-05-09T05:04:25.181957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:22.109498+0000","last_clean_scrub_stamp":"2024-05-09T05:04:22.109498+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:30.729592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:04:34.619 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:04:34.619 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T05:04:34.620 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-09T05:04:34.620 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-09T05:04:34.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.856+0000 7fe59f200640 1 Processor -- start 2024-05-09T05:04:34.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.857+0000 7fe59f200640 1 -- start start 2024-05-09T05:04:34.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.858+0000 7fe59f200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5980d0a70 0x7fe59815e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.858+0000 7fe59f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe5980ade90 0x7fe5980b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.858+0000 7fe59f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59815e780 con 0x7fe5980afb70 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.858+0000 7fe59f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe5980b55b0 con 0x7fe5980ade90 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.858+0000 7fe59f200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fe5980ae3a0 con 0x7fe5980d0a70 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe58f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe5980ade90 0x7fe5980b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe59d200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe5980afb70 0x7fe5980affa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56908/0 (socket says 172.21.15.100:56908) 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe59d200640 1 -- 172.21.15.100:0/2094521920 learned_addr learned my addr 172.21.15.100:0/2094521920 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe597e00640 1 --2- 172.21.15.100:0/2094521920 >> v2:172.21.15.133:3300/0 conn(0x7fe5980d0a70 0x7fe59815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe58f400640 1 -- 172.21.15.100:0/2094521920 >> v2:172.21.15.133:3300/0 conn(0x7fe5980d0a70 msgr2=0x7fe59815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe58f400640 1 --2- 172.21.15.100:0/2094521920 >> v2:172.21.15.133:3300/0 conn(0x7fe5980d0a70 0x7fe59815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe58f400640 1 -- 172.21.15.100:0/2094521920 >> v1:172.21.15.100:6789/0 conn(0x7fe5980afb70 legacy=0x7fe5980affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe58f400640 1 -- 172.21.15.100:0/2094521920 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980b4590 con 0x7fe5980ade90 2024-05-09T05:04:34.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.859+0000 7fe597400640 1 -- 172.21.15.100:0/2094521920 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426414833 0 0) 0x7fe590001490 con 0x7fe5980afb70 2024-05-09T05:04:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.860+0000 7fe58f400640 1 --2- 172.21.15.100:0/2094521920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe5980b5070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe598070950 tx=0x7fe58802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbfb72394257e4c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.860+0000 7fe597400640 1 -- 172.21.15.100:0/2094521920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588037070 con 0x7fe5980ade90 2024-05-09T05:04:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.860+0000 7fe597400640 1 -- 172.21.15.100:0/2094521920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588032440 con 0x7fe5980ade90 2024-05-09T05:04:34.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.860+0000 7fe597400640 1 -- 172.21.15.100:0/2094521920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588032810 con 0x7fe5980ade90 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 -- 172.21.15.100:0/2094521920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 msgr2=0x7fe5980b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 --2- 172.21.15.100:0/2094521920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe5980b5070 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe598070950 tx=0x7fe58802a1a0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 -- 172.21.15.100:0/2094521920 shutdown_connections 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 --2- 172.21.15.100:0/2094521920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe5980b5070 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 --2- 172.21.15.100:0/2094521920 >> v2:172.21.15.133:3300/0 conn(0x7fe5980d0a70 0x7fe59815e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 -- 172.21.15.100:0/2094521920 >> 172.21.15.100:0/2094521920 conn(0x7fe5980b31e0 msgr2=0x7fe5980d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 -- 172.21.15.100:0/2094521920 shutdown_connections 2024-05-09T05:04:34.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.861+0000 7fe59f200640 1 -- 172.21.15.100:0/2094521920 wait complete. 2024-05-09T05:04:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.863+0000 7fe59f200640 1 Processor -- start 2024-05-09T05:04:34.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.863+0000 7fe59f200640 1 -- start start 2024-05-09T05:04:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe59f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe59814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe59f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5980afb70 0x7fe5981f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe59f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980d0a70 0x7fe5981f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe59f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980ae680 con 0x7fe5980ade90 2024-05-09T05:04:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe59f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980b4b50 con 0x7fe5980d0a70 2024-05-09T05:04:34.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe59f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fe598072570 con 0x7fe5980afb70 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe597e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe59814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe597e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe59814f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35906/0 (socket says 172.21.15.100:35906) 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.864+0000 7fe597e00640 1 -- 172.21.15.100:0/1444242193 learned_addr learned my addr 172.21.15.100:0/1444242193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe597e00640 1 -- 172.21.15.100:0/1444242193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5980afb70 msgr2=0x7fe5981f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe597e00640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5980afb70 0x7fe5981f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe597e00640 1 -- 172.21.15.100:0/1444242193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980d0a70 msgr2=0x7fe5981f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe597e00640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980d0a70 0x7fe5981f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe597e00640 1 -- 172.21.15.100:0/1444242193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe598157d80 con 0x7fe5980ade90 2024-05-09T05:04:34.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe597e00640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe59814f7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d5f0 tx=0x7fe58000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5800125f0 con 0x7fe5980ade90 2024-05-09T05:04:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe580019070 con 0x7fe5980ade90 2024-05-09T05:04:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5800129d0 con 0x7fe5980ade90 2024-05-09T05:04:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe598158060 con 0x7fe5980ade90 2024-05-09T05:04:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.865+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59806e8e0 con 0x7fe5980ade90 2024-05-09T05:04:34.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.866+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe598076070 con 0x7fe5980ade90 2024-05-09T05:04:34.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.867+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe580012b70 con 0x7fe5980ade90 2024-05-09T05:04:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.868+0000 7fe594c00640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe5740762d0 0x7fe574078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.869+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe580097ab0 con 0x7fe5980ade90 2024-05-09T05:04:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.869+0000 7fe58f400640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe5740762d0 0x7fe574078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:34.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.869+0000 7fe58f400640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe5740762d0 0x7fe574078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe588034000 tx=0x7fe58802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:34.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:34.873+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe580061400 con 0x7fe5980ade90 2024-05-09T05:04:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.100+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe59806a5c0 con 0x7fe5980ade90 2024-05-09T05:04:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.101+0000 7fe594c00640 1 -- 172.21.15.100:0/1444242193 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe580060d00 con 0x7fe5980ade90 2024-05-09T05:04:35.102 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:35.102 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T05:04:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.103+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe5740762d0 msgr2=0x7fe574078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.103+0000 7fe59f200640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe5740762d0 0x7fe574078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe588034000 tx=0x7fe58802c000 comp rx=0 tx=0).stop 2024-05-09T05:04:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.103+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 msgr2=0x7fe59814f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.103+0000 7fe59f200640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe59814f7e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe58000d5f0 tx=0x7fe58000dab0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 shutdown_connections 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe5740762d0 0x7fe574078790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980d0a70 0x7fe5981f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5980afb70 0x7fe5981f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 --2- 172.21.15.100:0/1444242193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980ade90 0x7fe59814f7e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 >> 172.21.15.100:0/1444242193 conn(0x7fe5980b31e0 msgr2=0x7fe598072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 shutdown_connections 2024-05-09T05:04:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.104+0000 7fe59f200640 1 -- 172.21.15.100:0/1444242193 wait complete. 2024-05-09T05:04:35.122 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-09T05:04:35.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:35.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.315+0000 7fad24a00640 1 Processor -- start 2024-05-09T05:04:35.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.315+0000 7fad24a00640 1 -- start start 2024-05-09T05:04:35.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad24a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fad20143710 0x7fad20161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad24a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad2015db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad24a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad20143af0 con 0x7fad200cdc20 2024-05-09T05:04:35.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad24a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fad20160ce0 con 0x7fad20143710 2024-05-09T05:04:35.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad24a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fad20161c70 con 0x7fad2015d6c0 2024-05-09T05:04:35.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad1fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fad200cdc20 0x7fad200cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56922/0 (socket says 172.21.15.100:56922) 2024-05-09T05:04:35.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad1fe00640 1 -- 172.21.15.100:0/434389167 learned_addr learned my addr 172.21.15.100:0/434389167 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:35.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.317+0000 7fad1f400640 1 --2- 172.21.15.100:0/434389167 >> v2:172.21.15.100:3300/0 conn(0x7fad20143710 0x7fad20161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad17e00640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad2015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad1ea00640 1 -- 172.21.15.100:0/434389167 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577707615 0 0) 0x7fad20143af0 con 0x7fad200cdc20 2024-05-09T05:04:35.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad1ea00640 1 -- 172.21.15.100:0/434389167 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad04003520 con 0x7fad200cdc20 2024-05-09T05:04:35.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad1f400640 1 -- 172.21.15.100:0/434389167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 msgr2=0x7fad2015db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:35.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad1f400640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad2015db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad1f400640 1 -- 172.21.15.100:0/434389167 >> v1:172.21.15.100:6789/0 conn(0x7fad200cdc20 legacy=0x7fad200cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad1f400640 1 -- 172.21.15.100:0/434389167 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2015e240 con 0x7fad20143710 2024-05-09T05:04:35.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.318+0000 7fad17e00640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad2015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.319+0000 7fad1f400640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20161730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad100097a0 tx=0x7fad1002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9936dd9a5d4486dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.319+0000 7fad1ea00640 1 -- 172.21.15.100:0/434389167 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10037070 con 0x7fad20143710 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.319+0000 7fad1ea00640 1 -- 172.21.15.100:0/434389167 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1002ae50 con 0x7fad20143710 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.319+0000 7fad1ea00640 1 -- 172.21.15.100:0/434389167 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10032640 con 0x7fad20143710 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 -- 172.21.15.100:0/434389167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 msgr2=0x7fad20161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20161730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad100097a0 tx=0x7fad1002a100 comp rx=0 tx=0).stop 2024-05-09T05:04:35.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 -- 172.21.15.100:0/434389167 shutdown_connections 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad2015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 --2- 172.21.15.100:0/434389167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20161730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 -- 172.21.15.100:0/434389167 >> 172.21.15.100:0/434389167 conn(0x7fad2006c7f0 msgr2=0x7fad2006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 -- 172.21.15.100:0/434389167 shutdown_connections 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.320+0000 7fad24a00640 1 -- 172.21.15.100:0/434389167 wait complete. 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.322+0000 7fad24a00640 1 Processor -- start 2024-05-09T05:04:35.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.322+0000 7fad24a00640 1 -- start start 2024-05-09T05:04:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad24a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200cdc20 0x7fad2013db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad24a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad24a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad201506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad24a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad20161210 con 0x7fad20143710 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad24a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fad20160f30 con 0x7fad200cdc20 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad24a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fad20072490 con 0x7fad2015d6c0 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad17e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad17e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35934/0 (socket says 172.21.15.100:35934) 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.323+0000 7fad17e00640 1 -- 172.21.15.100:0/4199265041 learned_addr learned my addr 172.21.15.100:0/4199265041 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad1f400640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200cdc20 0x7fad2013db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad1fe00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad201506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17e00640 1 -- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 msgr2=0x7fad201506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17e00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad201506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17e00640 1 -- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200cdc20 msgr2=0x7fad2013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17e00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200cdc20 0x7fad2013db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17e00640 1 -- 172.21.15.100:0/4199265041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad201511e0 con 0x7fad20143710 2024-05-09T05:04:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17e00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20140150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:35.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08004030 con 0x7fad20143710 2024-05-09T05:04:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad080041d0 con 0x7fad20143710 2024-05-09T05:04:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad201514c0 con 0x7fad20143710 2024-05-09T05:04:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.324+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad080096a0 con 0x7fad20143710 2024-05-09T05:04:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.325+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2013fc30 con 0x7fad20143710 2024-05-09T05:04:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.326+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2006a550 con 0x7fad20143710 2024-05-09T05:04:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.327+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fad08009840 con 0x7fad20143710 2024-05-09T05:04:35.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.328+0000 7fad17400640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7facfc0762d0 0x7facfc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.328+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad080978f0 con 0x7fad20143710 2024-05-09T05:04:35.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.328+0000 7fad1f400640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7facfc0762d0 0x7facfc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.329+0000 7fad1f400640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7facfc0762d0 0x7facfc078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad10034000 tx=0x7fad1002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:35.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.332+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fad08061240 con 0x7fad20143710 2024-05-09T05:04:35.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.581+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad2015dd30 con 0x7fad20143710 2024-05-09T05:04:35.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.582+0000 7fad17400640 1 -- 172.21.15.100:0/4199265041 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fad08060b40 con 0x7fad20143710 2024-05-09T05:04:35.583 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:35.583 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:04:35.583 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7facfc0762d0 msgr2=0x7facfc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7facfc0762d0 0x7facfc078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad10034000 tx=0x7fad1002e000 comp rx=0 tx=0).stop 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 msgr2=0x7fad20140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20140150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 shutdown_connections 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7facfc0762d0 0x7facfc078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad2015d6c0 0x7fad201506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad20143710 0x7fad20140150 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 --2- 172.21.15.100:0/4199265041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200cdc20 0x7fad2013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 >> 172.21.15.100:0/4199265041 conn(0x7fad2006c7f0 msgr2=0x7fad2015ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 shutdown_connections 2024-05-09T05:04:35.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.585+0000 7fad24a00640 1 -- 172.21.15.100:0/4199265041 wait complete. 2024-05-09T05:04:35.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:35.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.804+0000 7f47b7400640 1 Processor -- start 2024-05-09T05:04:35.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.804+0000 7f47b7400640 1 -- start start 2024-05-09T05:04:35.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.805+0000 7f47b7400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006fd60 0x7f47b0070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.805+0000 7f47b7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47b00afe20 0x7f47b0073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.805+0000 7f47b7400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b0070680 con 0x7f47b0073840 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.805+0000 7f47b7400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f47b006f390 con 0x7f47b00afe20 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.805+0000 7f47b7400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f47b006e810 con 0x7f47b006fd60 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47b00afe20 0x7f47b0073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47b00afe20 0x7f47b0073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35942/0 (socket says 172.21.15.100:35942) 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 -- 172.21.15.100:0/952202410 learned_addr learned my addr 172.21.15.100:0/952202410 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b4a00640 1 --2- 172.21.15.100:0/952202410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006fd60 0x7f47b0070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 -- 172.21.15.100:0/952202410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006fd60 msgr2=0x7f47b0070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 --2- 172.21.15.100:0/952202410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006fd60 0x7f47b0070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 -- 172.21.15.100:0/952202410 >> v1:172.21.15.133:6789/0 conn(0x7f47b0073840 legacy=0x7f47b015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:35.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.806+0000 7f47b5400640 1 -- 172.21.15.100:0/952202410 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b006eaf0 con 0x7f47b00afe20 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.807+0000 7f47b5400640 1 --2- 172.21.15.100:0/952202410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b00afe20 0x7f47b0073ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f47a800d150 tx=0x7f47a802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90533acbcf27c28e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.807+0000 7f47af400640 1 -- 172.21.15.100:0/952202410 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8039070 con 0x7f47b00afe20 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.807+0000 7f47af400640 1 -- 172.21.15.100:0/952202410 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8009600 con 0x7f47b00afe20 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.807+0000 7f47af400640 1 -- 172.21.15.100:0/952202410 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80099d0 con 0x7f47b00afe20 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 -- 172.21.15.100:0/952202410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b00afe20 msgr2=0x7f47b0073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 --2- 172.21.15.100:0/952202410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b00afe20 0x7f47b0073ca0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f47a800d150 tx=0x7f47a802c890 comp rx=0 tx=0).stop 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 -- 172.21.15.100:0/952202410 shutdown_connections 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 --2- 172.21.15.100:0/952202410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b00afe20 0x7f47b0073ca0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 --2- 172.21.15.100:0/952202410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b006fd60 0x7f47b0070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 -- 172.21.15.100:0/952202410 >> 172.21.15.100:0/952202410 conn(0x7f47b00b31e0 msgr2=0x7f47b00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 -- 172.21.15.100:0/952202410 shutdown_connections 2024-05-09T05:04:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.808+0000 7f47b7400640 1 -- 172.21.15.100:0/952202410 wait complete. 2024-05-09T05:04:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.810+0000 7f47b7400640 1 Processor -- start 2024-05-09T05:04:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.810+0000 7f47b7400640 1 -- start start 2024-05-09T05:04:35.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 0x7f47b01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b7400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b0073840 0x7f47b00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b7400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b00afe20 0x7f47b00b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b7400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47b006e4a0 con 0x7f47b006fd60 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b7400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f47b006f0b0 con 0x7f47b0073840 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b7400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f47b0159f00 con 0x7f47b00afe20 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 0x7f47b01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 0x7f47b01566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35946/0 (socket says 172.21.15.100:35946) 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.811+0000 7f47b4a00640 1 -- 172.21.15.100:0/2249127934 learned_addr learned my addr 172.21.15.100:0/2249127934 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b4a00640 1 -- 172.21.15.100:0/2249127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b00afe20 msgr2=0x7f47b00b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b4a00640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b00afe20 0x7f47b00b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b4a00640 1 -- 172.21.15.100:0/2249127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b0073840 msgr2=0x7f47b00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b4a00640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b0073840 0x7f47b00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b4a00640 1 -- 172.21.15.100:0/2249127934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b00cd460 con 0x7f47b006fd60 2024-05-09T05:04:35.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b4a00640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 0x7f47b01566c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47a400d800 tx=0x7f47a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:35.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a400b6c0 con 0x7f47b006fd60 2024-05-09T05:04:35.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a4019070 con 0x7f47b006fd60 2024-05-09T05:04:35.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b00cd740 con 0x7f47b006fd60 2024-05-09T05:04:35.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a400ba60 con 0x7f47b006fd60 2024-05-09T05:04:35.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.812+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b00cdd00 con 0x7f47b006fd60 2024-05-09T05:04:35.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.814+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b0076070 con 0x7f47b006fd60 2024-05-09T05:04:35.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.815+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47a400bc00 con 0x7f47b006fd60 2024-05-09T05:04:35.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.816+0000 7f47acc00640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f47900762d0 0x7f4790078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:35.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.816+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47a4097ba0 con 0x7f47b006fd60 2024-05-09T05:04:35.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.816+0000 7f47afe00640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f47900762d0 0x7f4790078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:35.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.817+0000 7f47afe00640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f47900762d0 0x7f4790078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47b009f1c0 tx=0x7f479c0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:35.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:35.820+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47a4061460 con 0x7f47b006fd60 2024-05-09T05:04:36.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.072+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47b006a5c0 con 0x7f47b006fd60 2024-05-09T05:04:36.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.074+0000 7f47acc00640 1 -- 172.21.15.100:0/2249127934 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f47a4060d60 con 0x7f47b006fd60 2024-05-09T05:04:36.075 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:36.075 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:04:36.075 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:04:36.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.076+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f47900762d0 msgr2=0x7f4790078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.076+0000 7f47b7400640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f47900762d0 0x7f4790078790 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47b009f1c0 tx=0x7f479c0079b0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.076+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 msgr2=0x7f47b01566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.076+0000 7f47b7400640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 0x7f47b01566c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f47a400d800 tx=0x7f47a400dcc0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.076+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 shutdown_connections 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f47900762d0 0x7f4790078790 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b00afe20 0x7f47b00b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47b0073840 0x7f47b00b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 --2- 172.21.15.100:0/2249127934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47b006fd60 0x7f47b01566c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 >> 172.21.15.100:0/2249127934 conn(0x7f47b00b31e0 msgr2=0x7f47b00cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 shutdown_connections 2024-05-09T05:04:36.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.077+0000 7f47b7400640 1 -- 172.21.15.100:0/2249127934 wait complete. 2024-05-09T05:04:36.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.296+0000 7fa0d0800640 1 Processor -- start 2024-05-09T05:04:36.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.296+0000 7fa0d0800640 1 -- start start 2024-05-09T05:04:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.298+0000 7fa0d0800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0c80b45c0 0x7fa0c814cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.298+0000 7fa0d0800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.298+0000 7fa0d0800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c814d550 con 0x7fa0c80d04f0 2024-05-09T05:04:36.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.298+0000 7fa0d0800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c8073cc0 con 0x7fa0c80b45c0 2024-05-09T05:04:36.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.298+0000 7fa0d0800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c80730b0 con 0x7fa0c814d110 2024-05-09T05:04:36.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c806eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52448/0 (socket says 172.21.15.100:52448) 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 -- 172.21.15.100:0/2091223181 learned_addr learned my addr 172.21.15.100:0/2091223181 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0cde00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa0c80d04f0 0x7fa0c80b3eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:34826/0 (socket says 172.21.15.100:34826) 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0cd400640 1 --2- 172.21.15.100:0/2091223181 >> v2:172.21.15.133:3300/0 conn(0x7fa0c80b45c0 0x7fa0c814cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 -- 172.21.15.100:0/2091223181 >> v2:172.21.15.133:3300/0 conn(0x7fa0c80b45c0 msgr2=0x7fa0c814cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 --2- 172.21.15.100:0/2091223181 >> v2:172.21.15.133:3300/0 conn(0x7fa0c80b45c0 0x7fa0c814cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 -- 172.21.15.100:0/2091223181 >> v1:172.21.15.133:6789/0 conn(0x7fa0c80d04f0 legacy=0x7fa0c80b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.299+0000 7fa0ce800640 1 -- 172.21.15.100:0/2091223181 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c8073390 con 0x7fa0c814d110 2024-05-09T05:04:36.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.301+0000 7fa0ce800640 1 --2- 172.21.15.100:0/2091223181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c806eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009e50 tx=0x7fa0c402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b1fea284c0cd718 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.301+0000 7fa0cca00640 1 -- 172.21.15.100:0/2091223181 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4036070 con 0x7fa0c814d110 2024-05-09T05:04:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.301+0000 7fa0cca00640 1 -- 172.21.15.100:0/2091223181 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c4031600 con 0x7fa0c814d110 2024-05-09T05:04:36.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.301+0000 7fa0cca00640 1 -- 172.21.15.100:0/2091223181 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40319d0 con 0x7fa0c814d110 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 -- 172.21.15.100:0/2091223181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 msgr2=0x7fa0c806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 --2- 172.21.15.100:0/2091223181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c806eac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009e50 tx=0x7fa0c402a680 comp rx=0 tx=0).stop 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 -- 172.21.15.100:0/2091223181 shutdown_connections 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 --2- 172.21.15.100:0/2091223181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c806eac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 --2- 172.21.15.100:0/2091223181 >> v2:172.21.15.133:3300/0 conn(0x7fa0c80b45c0 0x7fa0c814cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 -- 172.21.15.100:0/2091223181 >> 172.21.15.100:0/2091223181 conn(0x7fa0c80b31e0 msgr2=0x7fa0c80d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:36.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 -- 172.21.15.100:0/2091223181 shutdown_connections 2024-05-09T05:04:36.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.302+0000 7fa0d0800640 1 -- 172.21.15.100:0/2091223181 wait complete. 2024-05-09T05:04:36.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.304+0000 7fa0d0800640 1 Processor -- start 2024-05-09T05:04:36.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.304+0000 7fa0d0800640 1 -- start start 2024-05-09T05:04:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0d0800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 0x7fa0c81634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0d0800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c80d04f0 0x7fa0c8146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0d0800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c8147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0d0800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c80d08d0 con 0x7fa0c80b45c0 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0d0800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c8073950 con 0x7fa0c80d04f0 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0d0800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c80b4bf0 con 0x7fa0c814d110 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0cde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 0x7fa0c81634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0cde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 0x7fa0c81634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35958/0 (socket says 172.21.15.100:35958) 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.305+0000 7fa0cde00640 1 -- 172.21.15.100:0/4043180807 learned_addr learned my addr 172.21.15.100:0/4043180807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0ce800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c8147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cd400640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c80d04f0 0x7fa0c8146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cde00640 1 -- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 msgr2=0x7fa0c8147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cde00640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c8147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cde00640 1 -- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c80d04f0 msgr2=0x7fa0c8146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cde00640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c80d04f0 0x7fa0c8146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cde00640 1 -- 172.21.15.100:0/4043180807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c809c7e0 con 0x7fa0c80b45c0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0cde00640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 0x7fa0c81634a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c4d0 tx=0x7fa0bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc018070 con 0x7fa0c80b45c0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0bc007480 con 0x7fa0c80b45c0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0049e0 con 0x7fa0c80b45c0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c809cac0 con 0x7fa0c80b45c0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.306+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c809d080 con 0x7fa0c80b45c0 2024-05-09T05:04:36.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.307+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c81f9840 con 0x7fa0c80b45c0 2024-05-09T05:04:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.308+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa0bc004b80 con 0x7fa0c80b45c0 2024-05-09T05:04:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.309+0000 7fa0c2000640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa0ac076300 0x7fa0ac0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.310+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa0bc096820 con 0x7fa0c80b45c0 2024-05-09T05:04:36.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.310+0000 7fa0cd400640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa0ac076300 0x7fa0ac0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.310+0000 7fa0cd400640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa0ac076300 0x7fa0ac0787c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0c806e450 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:36.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.314+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa0c81f9840 con 0x7fa0c80b45c0 2024-05-09T05:04:36.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.522+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0c80b63b0 con 0x7fa0c80b45c0 2024-05-09T05:04:36.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.525+0000 7fa0c2000640 1 -- 172.21.15.100:0/4043180807 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fa0bc007670 con 0x7fa0c80b45c0 2024-05-09T05:04:36.526 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:36.526 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:36.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa0ac076300 msgr2=0x7fa0ac0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa0ac076300 0x7fa0ac0787c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa0c806e450 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 msgr2=0x7fa0c81634a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 0x7fa0c81634a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c4d0 tx=0x7fa0bc00c990 comp rx=0 tx=0).stop 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 shutdown_connections 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa0ac076300 0x7fa0ac0787c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0c814d110 0x7fa0c8147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0c80d04f0 0x7fa0c8146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 --2- 172.21.15.100:0/4043180807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0c80b45c0 0x7fa0c81634a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 >> 172.21.15.100:0/4043180807 conn(0x7fa0c80b31e0 msgr2=0x7fa0c80b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 shutdown_connections 2024-05-09T05:04:36.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.529+0000 7fa0d0800640 1 -- 172.21.15.100:0/4043180807 wait complete. 2024-05-09T05:04:36.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:36.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.745+0000 7f13a2e00640 1 Processor -- start 2024-05-09T05:04:36.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.745+0000 7f13a2e00640 1 -- start start 2024-05-09T05:04:36.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a2e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 0x7f139c15e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a2e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f139c0ade90 0x7f139c0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a2e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f139c15e780 con 0x7f139c0afb70 2024-05-09T05:04:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a2e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f139c0b55b0 con 0x7f139c0ade90 2024-05-09T05:04:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a2e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f139c0ae3a0 con 0x7f139c0d0a70 2024-05-09T05:04:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a0e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f139c0afb70 0x7f139c0affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56924/0 (socket says 172.21.15.100:56924) 2024-05-09T05:04:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f13a0e00640 1 -- 172.21.15.100:0/3768824962 learned_addr learned my addr 172.21.15.100:0/3768824962 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:36.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f139be00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 0x7f139c15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.747+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325854158 0 0) 0x7f1394001110 con 0x7f139c0afb70 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139b400640 1 --2- 172.21.15.100:0/3768824962 >> v2:172.21.15.133:3300/0 conn(0x7f139c0ade90 0x7f139c0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1380003520 con 0x7f139c0afb70 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3123551462 0 0) 0x7f1380003520 con 0x7f139c0afb70 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 msgr2=0x7f139c15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 0x7f139c15e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 >> v2:172.21.15.133:3300/0 conn(0x7f139c0ade90 msgr2=0x7f139c0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 --2- 172.21.15.100:0/3768824962 >> v2:172.21.15.133:3300/0 conn(0x7f139c0ade90 0x7f139c0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c0b4590 con 0x7f139c0afb70 2024-05-09T05:04:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f13940018c0 con 0x7f139c0afb70 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139b400640 1 --2- 172.21.15.100:0/3768824962 >> v2:172.21.15.133:3300/0 conn(0x7f139c0ade90 0x7f139c0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 >> v1:172.21.15.100:6789/0 conn(0x7f139c0afb70 legacy=0x7f139c0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 0x7f1380003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380003fd0 0x7f1380004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1380004d40 0x7f13800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0b55b0 con 0x7f1380004d40 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0ae3a0 con 0x7f1380003fd0 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f138000bac0 con 0x7f139c0d0a70 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.748+0000 7f13a0e00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1380004d40 0x7f13800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f139be00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 0x7f1380003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f139b400640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380003fd0 0x7f1380004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f13a0e00640 1 -- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 msgr2=0x7f1380003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f13a0e00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c0d0a70 0x7f1380003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f13a0e00640 1 -- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380003fd0 msgr2=0x7f1380004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:36.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f13a0e00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380003fd0 0x7f1380004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.749+0000 7f13a0e00640 1 -- 172.21.15.100:0/3768824962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1380003520 con 0x7f1380004d40 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.750+0000 7f13a0e00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1380004d40 0x7f13800051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f139400c410 tx=0x7f1380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf1cabeb8a7dbbf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.750+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139400c0e0 con 0x7f1380004d40 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.750+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1394034070 con 0x7f1380004d40 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.750+0000 7f139aa00640 1 -- 172.21.15.100:0/3768824962 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394005d50 con 0x7f1380004d40 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a2e00640 1 -- 172.21.15.100:0/3768824962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1380004d40 msgr2=0x7f13800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3768824962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1380004d40 0x7f13800051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f139400c410 tx=0x7f1380005830 comp rx=0 tx=0).stop 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a0e00640 1 -- 172.21.15.100:0/3768824962 reap_dead start 2024-05-09T05:04:36.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a2e00640 1 -- 172.21.15.100:0/3768824962 shutdown_connections 2024-05-09T05:04:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a2e00640 1 -- 172.21.15.100:0/3768824962 >> 172.21.15.100:0/3768824962 conn(0x7f139c0b31e0 msgr2=0x7f139c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a2e00640 1 -- 172.21.15.100:0/3768824962 shutdown_connections 2024-05-09T05:04:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.751+0000 7f13a2e00640 1 -- 172.21.15.100:0/3768824962 wait complete. 2024-05-09T05:04:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.752+0000 7f13a2e00640 1 Processor -- start 2024-05-09T05:04:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.753+0000 7f13a2e00640 1 -- start start 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.753+0000 7f13a2e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380004d40 0x7f139c14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.753+0000 7f13a2e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 0x7f139c15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f13a2e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c09bc40 0x7f139c09c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f13a2e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0ae680 con 0x7f139c15f9b0 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f13a2e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f139c0b4b50 con 0x7f1380004d40 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f13a2e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f139c15e240 con 0x7f139c09bc40 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 0x7f139c15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 0x7f139c15fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35976/0 (socket says 172.21.15.100:35976) 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 -- 172.21.15.100:0/3048259847 learned_addr learned my addr 172.21.15.100:0/3048259847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139be00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380004d40 0x7f139c14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 -- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c09bc40 msgr2=0x7f139c09c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c09bc40 0x7f139c09c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 -- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380004d40 msgr2=0x7f139c14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380004d40 0x7f139c14a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 -- 172.21.15.100:0/3048259847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139c09c990 con 0x7f139c15f9b0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139be00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380004d40 0x7f139c14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.754+0000 7f139b400640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 0x7f139c15fe30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1388004710 tx=0x7f1388007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.755+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388014610 con 0x7f139c15f9b0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.755+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388019070 con 0x7f139c15f9b0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.755+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139c09cc70 con 0x7f139c15f9b0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.755+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13880149f0 con 0x7f139c15f9b0 2024-05-09T05:04:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.755+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139c09d230 con 0x7f139c15f9b0 2024-05-09T05:04:36.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.756+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139c076070 con 0x7f139c15f9b0 2024-05-09T05:04:36.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.757+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1388014b90 con 0x7f139c15f9b0 2024-05-09T05:04:36.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.758+0000 7f1393e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f137c0762d0 0x7f137c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:36.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.758+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1388097f90 con 0x7f139c15f9b0 2024-05-09T05:04:36.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.758+0000 7f139be00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f137c0762d0 0x7f137c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:36.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.759+0000 7f139be00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f137c0762d0 0x7f137c078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f138c009a00 tx=0x7f138c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:36.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:36.762+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1388061850 con 0x7f139c15f9b0 2024-05-09T05:04:37.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.009+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f139c15d320 con 0x7f139c15f9b0 2024-05-09T05:04:37.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.011+0000 7f1393e00640 1 -- 172.21.15.100:0/3048259847 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f1388061150 con 0x7f139c15f9b0 2024-05-09T05:04:37.012 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:37.012 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:04:37.012 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:04:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f137c0762d0 msgr2=0x7f137c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f137c0762d0 0x7f137c078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f138c009a00 tx=0x7f138c008040 comp rx=0 tx=0).stop 2024-05-09T05:04:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 msgr2=0x7f139c15fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 0x7f139c15fe30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1388004710 tx=0x7f1388007700 comp rx=0 tx=0).stop 2024-05-09T05:04:37.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 shutdown_connections 2024-05-09T05:04:37.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f137c0762d0 0x7f137c078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f139c09bc40 0x7f139c09c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f139c15f9b0 0x7f139c15fe30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 --2- 172.21.15.100:0/3048259847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1380004d40 0x7f139c14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.013+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 >> 172.21.15.100:0/3048259847 conn(0x7f139c0b31e0 msgr2=0x7f139c0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.014+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 shutdown_connections 2024-05-09T05:04:37.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.014+0000 7f13a2e00640 1 -- 172.21.15.100:0/3048259847 wait complete. 2024-05-09T05:04:37.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:04:23.613117+0000', 'modified': '2024-05-09T05:04:26.685469+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6837/3702528711', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 3702528711}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3702528711}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4255, 'qdb_cluster': [4255]} 2024-05-09T05:04:37.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T05:04:37.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-09T05:04:37.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.644+0000 7f588be00640 1 Processor -- start 2024-05-09T05:04:37.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.645+0000 7f588be00640 1 -- start start 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f588be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 0x7f58840b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f588be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58840ae350 0x7f58840ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f588be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58840cdd30 con 0x7f588406f590 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f588be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f58840ce010 con 0x7f58840ae350 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f588be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f58840ce2f0 con 0x7f588415c640 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f5889400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f588406f590 0x7f588406f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56938/0 (socket says 172.21.15.100:56938) 2024-05-09T05:04:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.646+0000 7f5889400640 1 -- 172.21.15.100:0/1232283546 learned_addr learned my addr 172.21.15.100:0/1232283546 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5888a00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 0x7f58840b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844454409 0 0) 0x7f58840cdd30 con 0x7f588406f590 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5889e00640 1 --2- 172.21.15.100:0/1232283546 >> v2:172.21.15.133:3300/0 conn(0x7f58840ae350 0x7f58840ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5868003520 con 0x7f588406f590 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4098253392 0 0) 0x7f5868003520 con 0x7f588406f590 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 msgr2=0x7f58840b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 0x7f58840b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 >> v2:172.21.15.133:3300/0 conn(0x7f58840ae350 msgr2=0x7f58840ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 --2- 172.21.15.100:0/1232283546 >> v2:172.21.15.133:3300/0 conn(0x7f58840ae350 0x7f58840ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58840ce5d0 con 0x7f588406f590 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f58740016f0 con 0x7f588406f590 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 >> v1:172.21.15.100:6789/0 conn(0x7f588406f590 legacy=0x7f588406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5868003a50 0x7f5868003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5868004800 0x7f5868004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 0x7f5868005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58840ce010 con 0x7f5868004800 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f58840ce2f0 con 0x7f5868003a50 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.647+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f586800de10 con 0x7f588415c640 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5888a00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5868004800 0x7f5868004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5889400640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5868003a50 0x7f5868003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5888a00640 1 -- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 msgr2=0x7f5868005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5888a00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f588415c640 0x7f5868005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5888a00640 1 -- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5868003a50 msgr2=0x7f5868003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5888a00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5868003a50 0x7f5868003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.648+0000 7f5888a00640 1 -- 172.21.15.100:0/1232283546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5868003520 con 0x7f5868004800 2024-05-09T05:04:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.649+0000 7f5888a00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5868004800 0x7f5868004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba30 tx=0x7f5868005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb4ab3f53de73c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.649+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870030070 con 0x7f5868004800 2024-05-09T05:04:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.649+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587002ae00 con 0x7f5868004800 2024-05-09T05:04:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.649+0000 7f5883e00640 1 -- 172.21.15.100:0/1232283546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587000b600 con 0x7f5868004800 2024-05-09T05:04:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f588be00640 1 -- 172.21.15.100:0/1232283546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5868004800 msgr2=0x7f5868004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f588be00640 1 --2- 172.21.15.100:0/1232283546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5868004800 0x7f5868004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba30 tx=0x7f5868005830 comp rx=0 tx=0).stop 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f5889e00640 1 -- 172.21.15.100:0/1232283546 reap_dead start 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f588be00640 1 -- 172.21.15.100:0/1232283546 shutdown_connections 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f588be00640 1 -- 172.21.15.100:0/1232283546 >> 172.21.15.100:0/1232283546 conn(0x7f58840b2c90 msgr2=0x7f58840b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f588be00640 1 -- 172.21.15.100:0/1232283546 shutdown_connections 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.650+0000 7f588be00640 1 -- 172.21.15.100:0/1232283546 wait complete. 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.652+0000 7f588be00640 1 Processor -- start 2024-05-09T05:04:37.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.652+0000 7f588be00640 1 -- start start 2024-05-09T05:04:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f588be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5868004800 0x7f58841517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f588be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 0x7f5884074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f588be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5884150f20 0x7f588406e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f588be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58840d07e0 con 0x7f5884151d80 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f588be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f58840d0660 con 0x7f5884150f20 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f588be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f58840b4800 con 0x7f5868004800 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 0x7f5884074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 0x7f5884074120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35988/0 (socket says 172.21.15.100:35988) 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 -- 172.21.15.100:0/2743058430 learned_addr learned my addr 172.21.15.100:0/2743058430 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 -- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5868004800 msgr2=0x7f58841517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5889400640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5868004800 0x7f58841517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5868004800 0x7f58841517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 -- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5884150f20 msgr2=0x7f588406e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5889e00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5884150f20 0x7f588406e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5884150f20 0x7f588406e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.653+0000 7f5888a00640 1 -- 172.21.15.100:0/2743058430 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5884073080 con 0x7f5884151d80 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.654+0000 7f5888a00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 0x7f5884074120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f587000bb20 tx=0x7f5870004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.654+0000 7f5881600640 1 -- 172.21.15.100:0/2743058430 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870042030 con 0x7f5884151d80 2024-05-09T05:04:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.654+0000 7f5881600640 1 -- 172.21.15.100:0/2743058430 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587002ac00 con 0x7f5884151d80 2024-05-09T05:04:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.654+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5884073360 con 0x7f5884151d80 2024-05-09T05:04:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.654+0000 7f5881600640 1 -- 172.21.15.100:0/2743058430 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870004240 con 0x7f5884151d80 2024-05-09T05:04:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.654+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5884073920 con 0x7f5884151d80 2024-05-09T05:04:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.657+0000 7f5881600640 1 -- 172.21.15.100:0/2743058430 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5870045070 con 0x7f5884151d80 2024-05-09T05:04:37.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.658+0000 7f5881600640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5864076300 0x7f58640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.659+0000 7f5881600640 1 -- 172.21.15.100:0/2743058430 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58700b7c60 con 0x7f5884151d80 2024-05-09T05:04:37.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.659+0000 7f588ed9f740 1 Processor -- start 2024-05-09T05:04:37.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.659+0000 7f5889400640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5864076300 0x7f58640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.659+0000 7f588ed9f740 1 -- start start 2024-05-09T05:04:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.659+0000 7f5889400640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5864076300 0x7f58640787c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5874000fb0 tx=0x7f58740014b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc0ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc096d0 0x55d48cc0d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f588ed9f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d48cb72790 con 0x55d48cc0d980 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d48cb17f20 con 0x55d48cc096d0 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55d48cb6e750 con 0x55d48cc0e840 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f5889e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f5889e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35996/0 (socket says 172.21.15.100:35996) 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f5889e00640 1 -- 172.21.15.100:0/3515457144 learned_addr learned my addr 172.21.15.100:0/3515457144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f5888a00640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc096d0 0x55d48cc0d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.660+0000 7f5889400640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc0ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889e00640 1 -- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 msgr2=0x55d48cc0ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889e00640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc0ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889e00640 1 -- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc096d0 msgr2=0x55d48cc0d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889e00640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc096d0 0x55d48cc0d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889e00640 1 -- 172.21.15.100:0/3515457144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48c8842d0 con 0x55d48cc0d980 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5888a00640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc096d0 0x55d48cc0d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889400640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc0ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5889e00640 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0ddc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5884076160 tx=0x7f587c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ffb099074813f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5879c00640 1 -- 172.21.15.100:0/3515457144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c014610 con 0x55d48cc0d980 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5879c00640 1 -- 172.21.15.100:0/3515457144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c019070 con 0x55d48cc0d980 2024-05-09T05:04:37.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.661+0000 7f5879c00640 1 -- 172.21.15.100:0/3515457144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c0149d0 con 0x55d48cc0d980 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 -- 172.21.15.100:0/3515457144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 msgr2=0x55d48cc0ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0ddc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5884076160 tx=0x7f587c007700 comp rx=0 tx=0).stop 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 -- 172.21.15.100:0/3515457144 shutdown_connections 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0ddc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc096d0 0x55d48cc0d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3515457144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc0ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 -- 172.21.15.100:0/3515457144 >> 172.21.15.100:0/3515457144 conn(0x55d48cc0b940 msgr2=0x55d48cc54400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 -- 172.21.15.100:0/3515457144 shutdown_connections 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.662+0000 7f588ed9f740 1 -- 172.21.15.100:0/3515457144 wait complete. 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.663+0000 7f588ed9f740 1 -- start start 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.663+0000 7f588ed9f740 1 Processor -- start 2024-05-09T05:04:37.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc58ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc5b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d48cc3a3d0 con 0x55d48cc0d980 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d48cb2b9c0 con 0x55d48cc21120 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55d48cc39850 con 0x55d48cc0e840 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f588ed9f740 10 client.0 _ll_register_callbacks cb 0x55d48caf8120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f5889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc58ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f5889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc58ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36004/0 (socket says 172.21.15.100:36004) 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.664+0000 7f5889400640 1 -- 172.21.15.100:0/4150076643 learned_addr learned my addr 172.21.15.100:0/4150076643 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5888a00640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc5b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889e00640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889400640 1 -- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 msgr2=0x55d48cc5b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889400640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc5b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889400640 1 -- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 msgr2=0x55d48cc215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889400640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889400640 1 -- 172.21.15.100:0/4150076643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48c94e6b0 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f5889400640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc58ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f587400fef0 tx=0x7f5874009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b28c25ab560c20 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f586e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f586e000640 1 -- 172.21.15.100:0/4150076643 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874010040 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f586e000640 1 -- 172.21.15.100:0/4150076643 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5874022a80 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f587c019070 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f586e000640 1 -- 172.21.15.100:0/4150076643 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5874022c80 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f588ed9f740 10 client.4554 fetch_fsmap learned FSMap version 8 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.665+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d48cc5c620 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f586e000640 1 -- 172.21.15.100:0/4150076643 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c019070 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f586e000640 1 -- 172.21.15.100:0/4150076643 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f5874013070 con 0x55d48cc0d980 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f588ed9f740 10 client.4554 fetch_fsmap finished waiting for FSMap version 8 2024-05-09T05:04:37.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f588ed9f740 10 client.4554 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:04:37.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f588ed9f740 20 client.4554 populate_metadata read hostname 'smithi100' 2024-05-09T05:04:37.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc37d80 0x55d48cc38160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f588ed9f740 4 client.4554 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:04:37.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 --> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d48cb803a0 con 0x55d48cc37d80 2024-05-09T05:04:37.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.666+0000 7f5888a00640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc37d80 0x55d48cc38160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.667+0000 7f5888a00640 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc37d80 0x55d48cc38160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95c9514950ff476 server_cookie=894ac40df1f22e6b in_seq=0 out_seq=0 2024-05-09T05:04:37.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.667+0000 7f586e000640 10 client.4554 ms_handle_connect on v2:172.21.15.100:6835/3702528711 2024-05-09T05:04:37.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f586e000640 1 -- 172.21.15.100:0/4150076643 <== mds.0 v2:172.21.15.100:6835/3702528711 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d48cb803a0 con 0x55d48cc37d80 2024-05-09T05:04:37.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f586e000640 10 client.4554 handle_command_reply: tid=0 2024-05-09T05:04:37.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 client.4554 shutdown 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 msgr2=0x55d48cc58ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc58ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f587400fef0 tx=0x7f5874009070 comp rx=0 tx=0).stop 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 shutdown_connections 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc37d80 0x55d48cc38160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc5b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4150076643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc58ed0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f586e000640 0 client.4554 ms_handle_reset on v2:172.21.15.100:6835/3702528711 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 >> 172.21.15.100:0/4150076643 conn(0x55d48cc096d0 msgr2=0x55d48cc0f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 shutdown_connections 2024-05-09T05:04:37.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 1 -- 172.21.15.100:0/4150076643 wait complete. 2024-05-09T05:04:37.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.668+0000 7f588ed9f740 20 client.4554 trim_cache size 0 max 16384 2024-05-09T05:04:37.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.689+0000 7f588ed9f740 1 Processor -- start 2024-05-09T05:04:37.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.689+0000 7f588ed9f740 1 -- start start 2024-05-09T05:04:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.689+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc0e840 0x55d48cc38350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc21120 0x55d48cc62db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f588ed9f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58841fcf70 con 0x55d48cc0d980 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5884157420 con 0x55d48cc0e840 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f58841fc920 con 0x55d48cc21120 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36020/0 (socket says 172.21.15.100:36020) 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 -- 172.21.15.100:0/4178306533 learned_addr learned my addr 172.21.15.100:0/4178306533 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5888a00640 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc0e840 0x55d48cc38350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 -- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc21120 msgr2=0x55d48cc62db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889e00640 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc21120 0x55d48cc62db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc21120 0x55d48cc62db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 -- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc0e840 msgr2=0x55d48cc38350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc0e840 0x55d48cc38350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5889400640 1 -- 172.21.15.100:0/4178306533 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48cc59bc0 con 0x55d48cc0d980 2024-05-09T05:04:37.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.690+0000 7f5888a00640 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc0e840 0x55d48cc38350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.691+0000 7f5889400640 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0f550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5874001a40 tx=0x7f5874013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f4d868db8551f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.691+0000 7f5879200640 1 -- 172.21.15.100:0/4178306533 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874033070 con 0x55d48cc0d980 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.691+0000 7f5879200640 1 -- 172.21.15.100:0/4178306533 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5874016cb0 con 0x55d48cc0d980 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.691+0000 7f5879200640 1 -- 172.21.15.100:0/4178306533 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874022760 con 0x55d48cc0d980 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.691+0000 7f588ed9f740 1 -- 172.21.15.100:0/4178306533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 msgr2=0x55d48cc0f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.691+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0f550 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5874001a40 tx=0x7f5874013000 comp rx=0 tx=0).stop 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 -- 172.21.15.100:0/4178306533 shutdown_connections 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc21120 0x55d48cc62db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc0e840 0x55d48cc38350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 --2- 172.21.15.100:0/4178306533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cc0f550 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 -- 172.21.15.100:0/4178306533 >> 172.21.15.100:0/4178306533 conn(0x55d48cc096d0 msgr2=0x55d48cc58ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 -- 172.21.15.100:0/4178306533 shutdown_connections 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 -- 172.21.15.100:0/4178306533 wait complete. 2024-05-09T05:04:37.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 -- start start 2024-05-09T05:04:37.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.692+0000 7f588ed9f740 1 Processor -- start 2024-05-09T05:04:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.693+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cccd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.693+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc7b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.693+0000 7f588ed9f740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc7bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.693+0000 7f588ed9f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d48cc29a50 con 0x55d48cc0d980 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.693+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55d48cc5c900 con 0x55d48cc21120 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.693+0000 7f588ed9f740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55d48cc28cb0 con 0x55d48cc0e840 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f588ed9f740 10 client.0 _ll_register_callbacks cb 0x7f5874005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cccd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cccd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36026/0 (socket says 172.21.15.100:36026) 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 -- 172.21.15.100:0/3256787209 learned_addr learned my addr 172.21.15.100:0/3256787209 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 -- 172.21.15.100:0/3256787209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 msgr2=0x55d48cc7b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc7b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 -- 172.21.15.100:0/3256787209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 msgr2=0x55d48cc7bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc7bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 -- 172.21.15.100:0/3256787209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48cc09300 con 0x55d48cc0d980 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f5889400640 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cccd8d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5874025040 tx=0x7f58740019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e83dbbd2b91995c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f586e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.694+0000 7f586e000640 1 -- 172.21.15.100:0/3256787209 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587402d480 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f586e000640 1 -- 172.21.15.100:0/3256787209 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f587402d620 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5874016cb0 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f586e000640 1 -- 172.21.15.100:0/3256787209 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f5874048050 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 10 client.4560 fetch_fsmap learned FSMap version 8 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d48cc55f40 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f586e000640 1 -- 172.21.15.100:0/3256787209 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5874016cb0 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f586e000640 1 -- 172.21.15.100:0/3256787209 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f5874013040 con 0x55d48cc0d980 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 10 client.4560 fetch_fsmap finished waiting for FSMap version 8 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 10 client.4560 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 20 client.4560 populate_metadata read hostname 'smithi100' 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc557d0 0x55d48cc26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 4 client.4560 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:04:37.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 --> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] -- command(tid 0: {"prefix": "status"}) -- 0x55d48cb7a210 con 0x55d48cc557d0 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.695+0000 7f5888a00640 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc557d0 0x55d48cc26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f5888a00640 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc557d0 0x55d48cc26f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10866b3d8fe3cc1 server_cookie=3c5b8a2b4a2af449 in_seq=0 out_seq=0 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f586e000640 10 client.4560 ms_handle_connect on v2:172.21.15.100:6835/3702528711 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f586e000640 1 -- 172.21.15.100:0/3256787209 <== mds.0 v2:172.21.15.100:6835/3702528711 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55d48cb7a210 con 0x55d48cc557d0 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f586e000640 10 client.4560 handle_command_reply: tid=0 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 client.4560 shutdown 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 msgr2=0x55d48cccd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cccd8d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5874025040 tx=0x7f58740019a0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 shutdown_connections 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:6835/3702528711,v1:172.21.15.100:6837/3702528711] conn(0x55d48cc557d0 0x55d48cc26f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d48cc21120 0x55d48cc7bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55d48cc0e840 0x55d48cc7b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f586e000640 0 client.4560 ms_handle_reset on v2:172.21.15.100:6835/3702528711 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 --2- 172.21.15.100:0/3256787209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d48cc0d980 0x55d48cccd8d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.696+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 >> 172.21.15.100:0/3256787209 conn(0x55d48cc096d0 msgr2=0x55d48cc0f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 shutdown_connections 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588ed9f740 1 -- 172.21.15.100:0/3256787209 wait complete. 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588ed9f740 20 client.4560 trim_cache size 0 max 16384 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "11e43d29-3063-46a7-bef1-2ecadce2fdc5", 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4255, 2024-05-09T05:04:37.703 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 13.548604836999999, 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 8, 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 20, 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 20, 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 19.622225153999999 2024-05-09T05:04:37.704 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5864076300 msgr2=0x7f58640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5864076300 0x7f58640787c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5874000fb0 tx=0x7f58740014b0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 msgr2=0x7f5884074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 0x7f5884074120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f587000bb20 tx=0x7f5870004730 comp rx=0 tx=0).stop 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 shutdown_connections 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5864076300 0x7f58640787c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5884150f20 0x7f588406e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5884151d80 0x7f5884074120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 --2- 172.21.15.100:0/2743058430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5868004800 0x7f58841517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:37.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.697+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 >> 172.21.15.100:0/2743058430 conn(0x7f58840b2c90 msgr2=0x7f58840754c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:37.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.698+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 shutdown_connections 2024-05-09T05:04:37.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:37.698+0000 7f588be00640 1 -- 172.21.15.100:0/2743058430 wait complete. 2024-05-09T05:04:37.715 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T05:04:37.725 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T05:04:37.725 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T05:04:37.726 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T05:04:37.727 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T05:04:37.766 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T05:04:37.766 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-09T05:04:37.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:37.767 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:04:37.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:37.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-05-09T05:04:37.912 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-05-09T05:04:37.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:04:37.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:37.916 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:04:37.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:37.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-05-09T05:04:38.054 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-05-09T05:04:38.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:04:38.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:38.057 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-05-09T05:04:38.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:38.115 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-05-09T05:04:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-05-09T05:04:38.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:04:38.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:38.208 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-05-09T05:04:38.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:38.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-05-09T05:04:38.348 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-05-09T05:04:38.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:04:38.352 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-09T05:04:38.353 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:04:38.353 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:04:38.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:04:38.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.559+0000 7fbe2e400640 1 Processor -- start 2024-05-09T05:04:38.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.559+0000 7fbe2e400640 1 -- start start 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2e400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbe280742b0 0x7fbe280b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2e400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbe2815f9c0 0x7fbe28151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2e400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe280cf150 con 0x7fbe280b55f0 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2e400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbe280cfd60 con 0x7fbe2815f9c0 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2e400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fbe2806f470 con 0x7fbe280742b0 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2da00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbe2815f9c0 0x7fbe28151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2da00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbe2815f9c0 0x7fbe28151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36030/0 (socket says 172.21.15.100:36030) 2024-05-09T05:04:38.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2da00640 1 -- 172.21.15.100:0/3414300453 learned_addr learned my addr 172.21.15.100:0/3414300453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:38.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.561+0000 7fbe2d000640 1 --2- 172.21.15.100:0/3414300453 >> v2:172.21.15.133:3300/0 conn(0x7fbe280742b0 0x7fbe280b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:38.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.562+0000 7fbe2da00640 1 -- 172.21.15.100:0/3414300453 >> v2:172.21.15.133:3300/0 conn(0x7fbe280742b0 msgr2=0x7fbe280b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.562+0000 7fbe2da00640 1 --2- 172.21.15.100:0/3414300453 >> v2:172.21.15.133:3300/0 conn(0x7fbe280742b0 0x7fbe280b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.562+0000 7fbe2da00640 1 -- 172.21.15.100:0/3414300453 >> v1:172.21.15.100:6789/0 conn(0x7fbe280b55f0 legacy=0x7fbe2815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.562+0000 7fbe2da00640 1 -- 172.21.15.100:0/3414300453 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe280cf430 con 0x7fbe2815f9c0 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe2da00640 1 --2- 172.21.15.100:0/3414300453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe28151e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ceab0 tx=0x7fbe2002b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dba90132fa810b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe27400640 1 -- 172.21.15.100:0/3414300453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2000b040 con 0x7fbe2815f9c0 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe27400640 1 -- 172.21.15.100:0/3414300453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20030710 con 0x7fbe2815f9c0 2024-05-09T05:04:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe27400640 1 -- 172.21.15.100:0/3414300453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20030ae0 con 0x7fbe2815f9c0 2024-05-09T05:04:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe2e400640 1 -- 172.21.15.100:0/3414300453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 msgr2=0x7fbe28151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3414300453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe28151e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ceab0 tx=0x7fbe2002b5e0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe2e400640 1 -- 172.21.15.100:0/3414300453 shutdown_connections 2024-05-09T05:04:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.563+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3414300453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe28151e10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.564+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3414300453 >> v2:172.21.15.133:3300/0 conn(0x7fbe280742b0 0x7fbe280b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.564+0000 7fbe2e400640 1 -- 172.21.15.100:0/3414300453 >> 172.21.15.100:0/3414300453 conn(0x7fbe2806c7f0 msgr2=0x7fbe2806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.564+0000 7fbe2e400640 1 -- 172.21.15.100:0/3414300453 shutdown_connections 2024-05-09T05:04:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.564+0000 7fbe2e400640 1 -- 172.21.15.100:0/3414300453 wait complete. 2024-05-09T05:04:38.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.565+0000 7fbe2e400640 1 Processor -- start 2024-05-09T05:04:38.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.565+0000 7fbe2e400640 1 -- start start 2024-05-09T05:04:38.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.566+0000 7fbe2e400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe280742b0 0x7fbe2814ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:38.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.566+0000 7fbe2e400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe280b55f0 0x7fbe28158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.566+0000 7fbe2e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe2814f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.566+0000 7fbe2e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280d0a20 con 0x7fbe2815f9c0 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.566+0000 7fbe2e400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280cf9f0 con 0x7fbe280742b0 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.566+0000 7fbe2e400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fbe28074690 con 0x7fbe280b55f0 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe2814f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe2814f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36044/0 (socket says 172.21.15.100:36044) 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 -- 172.21.15.100:0/3420720123 learned_addr learned my addr 172.21.15.100:0/3420720123 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2d000640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe280742b0 0x7fbe2814ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe27e00640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe280b55f0 0x7fbe28158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 -- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe280b55f0 msgr2=0x7fbe28158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe280b55f0 0x7fbe28158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 -- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe280742b0 msgr2=0x7fbe2814ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe280742b0 0x7fbe2814ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 -- 172.21.15.100:0/3420720123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2814efa0 con 0x7fbe2815f9c0 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.567+0000 7fbe2da00640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe2814f730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe2002b620 tx=0x7fbe200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.568+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2003f020 con 0x7fbe2815f9c0 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.568+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20030e10 con 0x7fbe2815f9c0 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.568+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe281591b0 con 0x7fbe2815f9c0 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.568+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2003b430 con 0x7fbe2815f9c0 2024-05-09T05:04:38.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.568+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2814dca0 con 0x7fbe2815f9c0 2024-05-09T05:04:38.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.569+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe280d0810 con 0x7fbe2815f9c0 2024-05-09T05:04:38.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.570+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe20042020 con 0x7fbe2815f9c0 2024-05-09T05:04:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.571+0000 7fbe24c00640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbe040762d0 0x7fbe04078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.571+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe200b8180 con 0x7fbe2815f9c0 2024-05-09T05:04:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.571+0000 7fbe2d000640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbe040762d0 0x7fbe04078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:38.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.572+0000 7fbe2d000640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbe040762d0 0x7fbe04078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe18006fd0 tx=0x7fbe18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:38.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.575+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe280d0810 con 0x7fbe2815f9c0 2024-05-09T05:04:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.821+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbe280d01f0 con 0x7fbe2815f9c0 2024-05-09T05:04:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.822+0000 7fbe24c00640 1 -- 172.21.15.100:0/3420720123 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fbe280d01f0 con 0x7fbe2815f9c0 2024-05-09T05:04:38.823 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbe040762d0 msgr2=0x7fbe04078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbe040762d0 0x7fbe04078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe18006fd0 tx=0x7fbe18008040 comp rx=0 tx=0).stop 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 msgr2=0x7fbe2814f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe2814f730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe2002b620 tx=0x7fbe200046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 shutdown_connections 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbe040762d0 0x7fbe04078790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe2815f9c0 0x7fbe2814f730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe280b55f0 0x7fbe28158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 --2- 172.21.15.100:0/3420720123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe280742b0 0x7fbe2814ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 >> 172.21.15.100:0/3420720123 conn(0x7fbe2806c7f0 msgr2=0x7fbe280b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 shutdown_connections 2024-05-09T05:04:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38.825+0000 7fbe2e400640 1 -- 172.21.15.100:0/3420720123 wait complete. 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:04:38.844 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:04:38.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:38.845 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:38.893 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42600sec preferred_lft 42600sec 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-05-09T05:04:38.894 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:38.895 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T05:04:38.895 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:38.895 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:38.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-05-09T05:04:38.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-05-09T05:04:38.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-05-09T05:04:38.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T05:04:38.896 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:38.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:39.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:39.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:39.399 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:04:39.462 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-05-09T05:04:39.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:39.466 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-05-09T05:04:39.522 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-05-09T05:04:39.522 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:04:39.522 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:04:39.523 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:04:39.523 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:04:39.523 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:39.524 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:39.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:04:39.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:04:39.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:04:39.524 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:39.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:40.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:40.265 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:04:40.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:40.318 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-05-09T05:04:40.369 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:40.369 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:40.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:04:40.370 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T05:04:40.370 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:40.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:40.554 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T05:04:40.554 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:40.554 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:40.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T05:04:40.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T05:04:40.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T05:04:40.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T05:04:40.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T05:04:40.555 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:40.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:40.850 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:40.850 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:40.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-05-09T05:04:40.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T05:04:40.851 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:40.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:40.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:04:40.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:04:41.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:41.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:41.037 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T05:04:41.075 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:04:41.076 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:41.076 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:04:41.170 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T05:04:41.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:41.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:04:41.318 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:04:41.318 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:04:41.318 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:04:41.973 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:04:41.973 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:04:41.974 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:04:41.974 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:41.974 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:42.010 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790" 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2024-05-09T05:04:42.011 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=11e43d29-3063-46a7-bef1-2ecadce2fdc5" will pass to kernel 2024-05-09T05:04:42.015 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T05:04:42.015 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:04:42.015 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:04:42.015 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:04:42.015 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:04:42.020 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:04:42.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:42.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:04:42.103 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:42.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:42.233 INFO:teuthology.orchestra.run.smithi100.stdout:client4403 2024-05-09T05:04:42.233 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:42.233 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:42.287 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:42.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:42.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:42.415 INFO:teuthology.orchestra.run.smithi100.stdout:client4403 2024-05-09T05:04:42.415 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:42.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:42.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:42.541 INFO:teuthology.orchestra.run.smithi100.stdout:client4403 2024-05-09T05:04:42.541 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/11e43d29-3063-46a7-bef1-2ecadce2fdc5.client4403/status') 2024-05-09T05:04:42.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:42.673 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.4403 (3)172.21.15.100:0/1291675329 2024-05-09T05:04:42.673 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-05-09T05:04:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-05-09T05:04:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-05-09T05:04:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:71 bytes copied, 9.7305e-05 s, 730 kB/s 2024-05-09T05:04:42.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:42.685 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-09T05:04:42.686 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:04:42.686 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-09T05:04:42.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:04:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.883+0000 7f3669000640 1 Processor -- start 2024-05-09T05:04:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.883+0000 7f3669000640 1 -- start start 2024-05-09T05:04:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3669000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 0x7f36640b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3669000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36640b55b0 con 0x7f36640d0a70 2024-05-09T05:04:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3669000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36640ae3a0 con 0x7f36640afb70 2024-05-09T05:04:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3669000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f36640b4590 con 0x7f36640ade90 2024-05-09T05:04:42.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3661e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f36640d0a70 0x7f366415e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57108/0 (socket says 172.21.15.100:57108) 2024-05-09T05:04:42.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3661e00640 1 -- 172.21.15.100:0/1983818020 learned_addr learned my addr 172.21.15.100:0/1983818020 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.885+0000 7f3661400640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 0x7f36640b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612821289 0 0) 0x7f3654001110 con 0x7f36640d0a70 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3648003520 con 0x7f36640d0a70 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 117461903 0 0) 0x7f3648003520 con 0x7f36640d0a70 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 msgr2=0x7f36640b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 0x7f36640b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 >> v1:172.21.15.133:6789/0 conn(0x7f36640afb70 legacy=0x7f36640affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36640b4870 con 0x7f36640d0a70 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f36540018c0 con 0x7f36640d0a70 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 >> v1:172.21.15.100:6789/0 conn(0x7f36640d0a70 legacy=0x7f366415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 0x7f3648003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3648004050 0x7f3648004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004d40 0x7f36480051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36640b4590 con 0x7f3648004050 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f364800bbb0 con 0x7f3648004d40 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f364800bdb0 con 0x7f36640ade90 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.886+0000 7f3661400640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3648004050 0x7f3648004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3662800640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004d40 0x7f36480051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3661e00640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 0x7f3648003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3661400640 1 -- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 msgr2=0x7f3648003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3661400640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36640ade90 0x7f3648003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3661400640 1 -- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004d40 msgr2=0x7f36480051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3661400640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004d40 0x7f36480051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:42.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.887+0000 7f3661400640 1 -- 172.21.15.100:0/1983818020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3648003520 con 0x7f3648004050 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.888+0000 7f3661400640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3648004050 0x7f3648004800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3650009a90 tx=0x7f3648005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7401ef1f85edfcd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.888+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650036070 con 0x7f3648004050 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.888+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3650031400 con 0x7f3648004050 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.888+0000 7f3660a00640 1 -- 172.21.15.100:0/1983818020 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650009690 con 0x7f3648004050 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3669000640 1 -- 172.21.15.100:0/1983818020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3648004050 msgr2=0x7f3648004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3669000640 1 --2- 172.21.15.100:0/1983818020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3648004050 0x7f3648004800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3650009a90 tx=0x7f3648005830 comp rx=0 tx=0).stop 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3662800640 1 -- 172.21.15.100:0/1983818020 reap_dead start 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3669000640 1 -- 172.21.15.100:0/1983818020 shutdown_connections 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3669000640 1 -- 172.21.15.100:0/1983818020 >> 172.21.15.100:0/1983818020 conn(0x7f36640b31e0 msgr2=0x7f36640d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3669000640 1 -- 172.21.15.100:0/1983818020 shutdown_connections 2024-05-09T05:04:42.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.889+0000 7f3669000640 1 -- 172.21.15.100:0/1983818020 wait complete. 2024-05-09T05:04:42.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.891+0000 7f3669000640 1 Processor -- start 2024-05-09T05:04:42.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.891+0000 7f3669000640 1 -- start start 2024-05-09T05:04:42.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3669000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004050 0x7f36641588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3669000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 0x7f3664157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3669000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f366409cef0 0x7f366409d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3669000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36640b5070 con 0x7f36641576e0 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3669000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f36640ae680 con 0x7f3648004050 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3669000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f36640b51f0 con 0x7f366409cef0 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3661400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 0x7f3664157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3661400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 0x7f3664157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34168/0 (socket says 172.21.15.100:34168) 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.892+0000 7f3661400640 1 -- 172.21.15.100:0/1432805872 learned_addr learned my addr 172.21.15.100:0/1432805872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661e00640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004050 0x7f36641588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3662800640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f366409cef0 0x7f366409d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661400640 1 -- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f366409cef0 msgr2=0x7f366409d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661400640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f366409cef0 0x7f366409d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661400640 1 -- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004050 msgr2=0x7f36641588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661400640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004050 0x7f36641588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661400640 1 -- 172.21.15.100:0/1432805872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366409c130 con 0x7f36641576e0 2024-05-09T05:04:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f3661400640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 0x7f3664157b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3650009bb0 tx=0x7f3650004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:42.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650040020 con 0x7f36641576e0 2024-05-09T05:04:42.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.893+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3650003c60 con 0x7f36641576e0 2024-05-09T05:04:42.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.894+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650036040 con 0x7f36641576e0 2024-05-09T05:04:42.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.894+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366409c410 con 0x7f36641576e0 2024-05-09T05:04:42.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.894+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3664158060 con 0x7f36641576e0 2024-05-09T05:04:42.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.895+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3664076070 con 0x7f36641576e0 2024-05-09T05:04:42.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.896+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3650043020 con 0x7f36641576e0 2024-05-09T05:04:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.897+0000 7f365a000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f36440762d0 0x7f3644078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.897+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f36500b71c0 con 0x7f36641576e0 2024-05-09T05:04:42.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.897+0000 7f3661e00640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f36440762d0 0x7f3644078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:42.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.898+0000 7f3661e00640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f36440762d0 0x7f3644078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3654001330 tx=0x7f3654009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:42.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:42.902+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36500044e0 con 0x7f36641576e0 2024-05-09T05:04:43.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.148+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f366406a5c0 con 0x7f36641576e0 2024-05-09T05:04:43.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.149+0000 7f365a000640 1 -- 172.21.15.100:0/1432805872 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3650080b10 con 0x7f36641576e0 2024-05-09T05:04:43.150 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.151+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f36440762d0 msgr2=0x7f3644078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.151+0000 7f3669000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f36440762d0 0x7f3644078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3654001330 tx=0x7f3654009040 comp rx=0 tx=0).stop 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.151+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 msgr2=0x7f3664157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.151+0000 7f3669000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 0x7f3664157b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3650009bb0 tx=0x7f3650004730 comp rx=0 tx=0).stop 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 shutdown_connections 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f36440762d0 0x7f3644078790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f366409cef0 0x7f366409d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36641576e0 0x7f3664157b20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 --2- 172.21.15.100:0/1432805872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3648004050 0x7f36641588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 >> 172.21.15.100:0/1432805872 conn(0x7f36640b31e0 msgr2=0x7f366415ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:43.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 shutdown_connections 2024-05-09T05:04:43.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43.152+0000 7f3669000640 1 -- 172.21.15.100:0/1432805872 wait complete. 2024-05-09T05:04:43.172 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T05:04:43.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:04:43.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-05-09T05:04:43.172 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-09T05:04:43.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-09T05:04:43.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T05:04:43.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:04:43.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:04:43.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-09T05:04:43.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.173 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-05-09T05:04:43.223 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42596sec preferred_lft 42596sec 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:e9:b2:ad:ea:5a brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-09T05:04:43.224 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f4a7:a4ff:fe5e:5c5/64 scope link 2024-05-09T05:04:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.225 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-09T05:04:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:e9:b2:ad:ea:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:04:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8ce9:b2ff:fead:ea5a/64 scope link 2024-05-09T05:04:43.225 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.226 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:04:43.307 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-05-09T05:04:43.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.312 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-05-09T05:04:43.359 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-05-09T05:04:43.360 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:04:43.360 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:04:43.360 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:04:43.360 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:04:43.360 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:43.360 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:43.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:04:43.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:04:43.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:04:43.361 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:43.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:43.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.565 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:04:43.615 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T05:04:43.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.616 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-05-09T05:04:43.667 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-09T05:04:43.668 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:43.668 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:43.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-09T05:04:43.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-09T05:04:43.668 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:43.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:43.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:43.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-09T05:04:43.927 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:43.927 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:3e:03:ca:94:7b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::283e:3ff:feca:947b/64 scope link 2024-05-09T05:04:43.928 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:43.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:43.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-09T05:04:44.014 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:44.015 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:44.015 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:44.015 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:44.015 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:44.015 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:44.016 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:04:44.016 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 2a:3e:03:ca:94:7b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-09T05:04:44.016 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-09T05:04:44.016 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:44.016 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::283e:3ff:feca:947b/64 scope link 2024-05-09T05:04:44.016 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:44.019 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-09T05:04:44.019 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:44.019 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:44.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-09T05:04:44.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-09T05:04:44.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-09T05:04:44.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-09T05:04:44.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-09T05:04:44.020 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:44.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:44.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:44.304 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:44.304 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:04:44.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2024-05-09T05:04:44.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2024-05-09T05:04:44.304 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:04:44.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:44.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:44.508 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-09T05:04:44.553 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-09T05:04:44.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:44.554 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-09T05:04:44.647 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T05:04:44.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:44.647 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-09T05:04:44.775 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-09T05:04:44.776 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-09T05:04:44.776 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:04:44.796 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-09T05:04:44.796 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-09T05:04:44.796 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:04:44.796 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:44.797 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:44.823 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-09T05:04:44.823 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-09T05:04:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:04:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790" 2024-05-09T05:04:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2024-05-09T05:04:44.824 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=11e43d29-3063-46a7-bef1-2ecadce2fdc5" will pass to kernel 2024-05-09T05:04:44.825 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-09T05:04:44.825 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:04:44.825 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:04:44.825 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:04:44.826 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:04:44.829 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:04:44.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:44.829 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-09T05:04:44.898 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:44.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:45.012 INFO:teuthology.orchestra.run.smithi100.stdout:client4412 2024-05-09T05:04:45.012 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:45.012 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:45.062 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:45.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:45.227 INFO:teuthology.orchestra.run.smithi100.stdout:client4412 2024-05-09T05:04:45.227 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:45.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:45.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:45.344 INFO:teuthology.orchestra.run.smithi100.stdout:client4412 2024-05-09T05:04:45.344 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/11e43d29-3063-46a7-bef1-2ecadce2fdc5.client4412/status') 2024-05-09T05:04:45.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:45.475 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.4412 (3)172.21.15.100:0/16868585 2024-05-09T05:04:45.475 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-05-09T05:04:45.475 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-05-09T05:04:45.475 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-05-09T05:04:45.475 INFO:teuthology.orchestra.run.smithi100.stderr:69 bytes copied, 7.6265e-05 s, 905 kB/s 2024-05-09T05:04:45.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:45.488 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-09T05:04:45.488 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:04:45.488 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T05:04:45.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:04:45.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.685+0000 7eff51c00640 1 Processor -- start 2024-05-09T05:04:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.685+0000 7eff51c00640 1 -- start start 2024-05-09T05:04:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.686+0000 7eff51c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff4c0d3660 0x7eff4c0d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.686+0000 7eff51c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4c0d2f80 con 0x7eff4c0d1a10 2024-05-09T05:04:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.686+0000 7eff51c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4c0b51e0 con 0x7eff4c0b4530 2024-05-09T05:04:45.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.686+0000 7eff51c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7eff4c0d4010 con 0x7eff4c0d3660 2024-05-09T05:04:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.687+0000 7eff51200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7eff4c0d1a10 0x7eff4c0d1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57124/0 (socket says 172.21.15.100:57124) 2024-05-09T05:04:45.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.687+0000 7eff51200640 1 -- 172.21.15.100:0/1753672780 learned_addr learned my addr 172.21.15.100:0/1753672780 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.687+0000 7eff4b400640 1 --2- 172.21.15.100:0/1753672780 >> v2:172.21.15.133:3300/0 conn(0x7eff4c0d3660 0x7eff4c0d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.687+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255732411 0 0) 0x7eff4c0d2f80 con 0x7eff4c0d1a10 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.687+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff30003520 con 0x7eff4c0d1a10 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2682174281 0 0) 0x7eff30003520 con 0x7eff4c0d1a10 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 >> v2:172.21.15.133:3300/0 conn(0x7eff4c0d3660 msgr2=0x7eff4c0d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 --2- 172.21.15.100:0/1753672780 >> v2:172.21.15.133:3300/0 conn(0x7eff4c0d3660 0x7eff4c0d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 >> v1:172.21.15.133:6789/0 conn(0x7eff4c0b4530 legacy=0x7eff4c0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c0d25f0 con 0x7eff4c0d1a10 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7eff44001a70 con 0x7eff4c0d1a10 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 >> v1:172.21.15.100:6789/0 conn(0x7eff4c0d1a10 legacy=0x7eff4c0d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff30003aa0 0x7eff30003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30004800 0x7eff30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff30005210 0x7eff3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c0d4010 con 0x7eff30003aa0 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7eff3000c160 con 0x7eff30005210 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7eff3000c360 con 0x7eff30004800 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.688+0000 7eff4be00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff30003aa0 0x7eff30003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff51200640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff30005210 0x7eff3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff4b400640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30004800 0x7eff30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff4be00640 1 -- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30004800 msgr2=0x7eff30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff4be00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30004800 0x7eff30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff4be00640 1 -- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff30005210 msgr2=0x7eff3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff4be00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff30005210 0x7eff3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff4be00640 1 -- 172.21.15.100:0/1753672780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff30003520 con 0x7eff30003aa0 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff51200640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff30005210 0x7eff3000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:45.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.689+0000 7eff51200640 1 -- 172.21.15.100:0/1753672780 reap_dead start 2024-05-09T05:04:45.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.690+0000 7eff4be00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff30003aa0 0x7eff30003ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff3c001760 tx=0x7eff30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e9d5be363613d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.690+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0013b0 con 0x7eff30003aa0 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.690+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c0052d0 con 0x7eff30003aa0 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.690+0000 7eff4aa00640 1 -- 172.21.15.100:0/1753672780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c02aa70 con 0x7eff30003aa0 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 -- 172.21.15.100:0/1753672780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff30003aa0 msgr2=0x7eff30003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff30003aa0 0x7eff30003ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7eff3c001760 tx=0x7eff30005830 comp rx=0 tx=0).stop 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 -- 172.21.15.100:0/1753672780 shutdown_connections 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 --2- 172.21.15.100:0/1753672780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff30003aa0 0x7eff30003ec0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 -- 172.21.15.100:0/1753672780 >> 172.21.15.100:0/1753672780 conn(0x7eff4c08eb30 msgr2=0x7eff4c09e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 -- 172.21.15.100:0/1753672780 shutdown_connections 2024-05-09T05:04:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.691+0000 7eff51c00640 1 -- 172.21.15.100:0/1753672780 wait complete. 2024-05-09T05:04:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.693+0000 7eff51c00640 1 Processor -- start 2024-05-09T05:04:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.693+0000 7eff51c00640 1 -- start start 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30003aa0 0x7eff4c0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff4c1575f0 0x7eff4c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 0x7eff4c160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c0d28d0 con 0x7eff4c15fbc0 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c0b5730 con 0x7eff4c1575f0 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7eff4c0b4910 con 0x7eff30003aa0 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 0x7eff4c160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 0x7eff4c160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34190/0 (socket says 172.21.15.100:34190) 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51200640 1 -- 172.21.15.100:0/956379648 learned_addr learned my addr 172.21.15.100:0/956379648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff4b400640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff4c1575f0 0x7eff4c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51200640 1 -- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30003aa0 msgr2=0x7eff4c0b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff4be00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30003aa0 0x7eff4c0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.694+0000 7eff51200640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30003aa0 0x7eff4c0b8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff51200640 1 -- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff4c1575f0 msgr2=0x7eff4c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff51200640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff4c1575f0 0x7eff4c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff51200640 1 -- 172.21.15.100:0/956379648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c0b8b60 con 0x7eff4c15fbc0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff4b400640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff4c1575f0 0x7eff4c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff51200640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 0x7eff4c160040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff4c08e580 tx=0x7eff44007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4400ea00 con 0x7eff4c15fbc0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4400eba0 con 0x7eff4c15fbc0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff44014430 con 0x7eff4c15fbc0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4c0cc3b0 con 0x7eff4c15fbc0 2024-05-09T05:04:45.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.695+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4c0cc970 con 0x7eff4c15fbc0 2024-05-09T05:04:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.696+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4c06a550 con 0x7eff4c15fbc0 2024-05-09T05:04:45.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.697+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff4401b060 con 0x7eff4c15fbc0 2024-05-09T05:04:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.698+0000 7eff43e00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff2c0762d0 0x7eff2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.699+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7eff44097110 con 0x7eff4c15fbc0 2024-05-09T05:04:45.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.699+0000 7eff4be00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff2c0762d0 0x7eff2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:45.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.700+0000 7eff4be00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff2c0762d0 0x7eff2c078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff3c032000 tx=0x7eff3c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:45.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.704+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff440609d0 con 0x7eff4c15fbc0 2024-05-09T05:04:45.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.951+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7eff4c0b4bd0 con 0x7eff4c15fbc0 2024-05-09T05:04:45.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.952+0000 7eff43e00640 1 -- 172.21.15.100:0/956379648 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7eff440602d0 con 0x7eff4c15fbc0 2024-05-09T05:04:45.953 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:04:45.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.954+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff2c0762d0 msgr2=0x7eff2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.954+0000 7eff51c00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff2c0762d0 0x7eff2c078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff3c032000 tx=0x7eff3c02e000 comp rx=0 tx=0).stop 2024-05-09T05:04:45.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.954+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 msgr2=0x7eff4c160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.954+0000 7eff51c00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 0x7eff4c160040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff4c08e580 tx=0x7eff44007bc0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 shutdown_connections 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff2c0762d0 0x7eff2c078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff4c15fbc0 0x7eff4c160040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff4c1575f0 0x7eff4c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 --2- 172.21.15.100:0/956379648 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff30003aa0 0x7eff4c0b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 >> 172.21.15.100:0/956379648 conn(0x7eff4c08eb30 msgr2=0x7eff4c0cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 shutdown_connections 2024-05-09T05:04:45.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:45.955+0000 7eff51c00640 1 -- 172.21.15.100:0/956379648 wait complete. 2024-05-09T05:04:45.975 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T05:04:45.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:04:45.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-05-09T05:04:45.976 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-09T05:04:45.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-09T05:04:45.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T05:04:45.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:04:45.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:04:45.976 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-09T05:04:45.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:45.976 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-05-09T05:04:46.033 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-05-09T05:04:46.034 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42617sec preferred_lft 42617sec 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-05-09T05:04:46.035 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:46.036 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T05:04:46.036 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:46.036 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:46.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2024-05-09T05:04:46.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2024-05-09T05:04:46.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2024-05-09T05:04:46.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T05:04:46.037 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:46.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:46.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:46.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:46.528 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:04:46.597 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-05-09T05:04:46.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:46.601 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-05-09T05:04:46.658 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-05-09T05:04:46.658 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:04:46.658 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:04:46.658 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:04:46.658 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:04:46.659 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:46.659 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:46.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:04:46.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:04:46.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:04:46.660 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:47.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:47.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:47.471 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-05-09T05:04:47.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:47.525 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-05-09T05:04:47.576 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:47.576 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:47.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T05:04:47.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-09T05:04:47.576 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:47.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:47.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:47.756 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-09T05:04:47.756 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:48.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:48.043 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:48.043 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:48.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-05-09T05:04:48.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T05:04:48.043 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:48.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:48.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:48.252 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-09T05:04:48.296 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-09T05:04:48.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:48.296 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-09T05:04:48.388 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T05:04:48.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:48.388 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T05:04:48.524 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T05:04:48.524 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T05:04:48.524 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-05-09T05:04:49.248 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T05:04:49.248 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T05:04:49.248 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-05-09T05:04:49.248 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:49.248 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:49.285 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-09T05:04:49.285 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-09T05:04:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-05-09T05:04:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790" 2024-05-09T05:04:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2024-05-09T05:04:49.286 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=11e43d29-3063-46a7-bef1-2ecadce2fdc5" will pass to kernel 2024-05-09T05:04:49.290 INFO:teuthology.orchestra.run.smithi133.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-09T05:04:49.290 INFO:teuthology.orchestra.run.smithi133.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:04:49.290 INFO:teuthology.orchestra.run.smithi133.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:04:49.290 INFO:teuthology.orchestra.run.smithi133.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:04:49.290 INFO:teuthology.orchestra.run.smithi133.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:04:49.295 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:04:49.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:49.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-09T05:04:49.376 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:49.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:49.501 INFO:teuthology.orchestra.run.smithi133.stdout:client4584 2024-05-09T05:04:49.501 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:49.501 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:49.551 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:49.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:49.716 INFO:teuthology.orchestra.run.smithi133.stdout:client4584 2024-05-09T05:04:49.717 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:49.834 INFO:teuthology.orchestra.run.smithi133.stdout:client4584 2024-05-09T05:04:49.834 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/11e43d29-3063-46a7-bef1-2ecadce2fdc5.client4584/status') 2024-05-09T05:04:49.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:49.967 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4584 (3)172.21.15.133:0/3667743084 2024-05-09T05:04:49.967 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2024-05-09T05:04:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2024-05-09T05:04:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2024-05-09T05:04:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:71 bytes copied, 8.3064e-05 s, 855 kB/s 2024-05-09T05:04:49.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:49.981 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-09T05:04:49.981 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:04:49.981 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-09T05:04:49.981 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:04:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.178+0000 7f694ca00640 1 Processor -- start 2024-05-09T05:04:50.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.178+0000 7f694ca00640 1 -- start start 2024-05-09T05:04:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.179+0000 7f694ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69480d4e40 0x7f69480d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.179+0000 7f694ca00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f69480b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.179+0000 7f694ca00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69480d3da0 con 0x7f694815f420 2024-05-09T05:04:50.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f694ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f69480d4080 con 0x7f69480d4e40 2024-05-09T05:04:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f694ca00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f69480d4360 con 0x7f69480d27b0 2024-05-09T05:04:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69480d4e40 0x7f69480d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f69480d4e40 0x7f69480d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34206/0 (socket says 172.21.15.100:34206) 2024-05-09T05:04:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 -- 172.21.15.100:0/2651893061 learned_addr learned my addr 172.21.15.100:0/2651893061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:50.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 -- 172.21.15.100:0/2651893061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 msgr2=0x7f69480b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 --2- 172.21.15.100:0/2651893061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f69480b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 -- 172.21.15.100:0/2651893061 >> v1:172.21.15.133:6789/0 conn(0x7f694815f420 legacy=0x7f69480d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:50.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.180+0000 7f6945400640 1 -- 172.21.15.100:0/2651893061 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480d4640 con 0x7f69480d4e40 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.182+0000 7f6945400640 1 --2- 172.21.15.100:0/2651893061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480d4e40 0x7f69480d2270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42e667133d82543 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.182+0000 7f6944a00640 1 -- 172.21.15.100:0/2651893061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934037070 con 0x7f69480d4e40 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.182+0000 7f6944a00640 1 -- 172.21.15.100:0/2651893061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934032440 con 0x7f69480d4e40 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.182+0000 7f6944a00640 1 -- 172.21.15.100:0/2651893061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032810 con 0x7f69480d4e40 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.182+0000 7f694ca00640 1 -- 172.21.15.100:0/2651893061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480d4e40 msgr2=0x7f69480d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.182+0000 7f694ca00640 1 --2- 172.21.15.100:0/2651893061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480d4e40 0x7f69480d2270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6934009870 tx=0x7f693402a1c0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.183+0000 7f694ca00640 1 -- 172.21.15.100:0/2651893061 shutdown_connections 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.183+0000 7f694ca00640 1 --2- 172.21.15.100:0/2651893061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f69480b8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.183+0000 7f694ca00640 1 --2- 172.21.15.100:0/2651893061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69480d4e40 0x7f69480d2270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.183+0000 7f694ca00640 1 -- 172.21.15.100:0/2651893061 >> 172.21.15.100:0/2651893061 conn(0x7f6948073f20 msgr2=0x7f6948074330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.183+0000 7f694ca00640 1 -- 172.21.15.100:0/2651893061 shutdown_connections 2024-05-09T05:04:50.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.183+0000 7f694ca00640 1 -- 172.21.15.100:0/2651893061 wait complete. 2024-05-09T05:04:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.184+0000 7f694ca00640 1 Processor -- start 2024-05-09T05:04:50.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.184+0000 7f694ca00640 1 -- start start 2024-05-09T05:04:50.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.185+0000 7f694ca00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f694814d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:50.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.185+0000 7f694ca00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480d4e40 0x7f69480cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:50.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.185+0000 7f694ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 0x7f69481622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:50.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.185+0000 7f694ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f694815f800 con 0x7f694815f420 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.185+0000 7f694ca00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f69480d3ac0 con 0x7f69480d4e40 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.185+0000 7f694ca00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6948161230 con 0x7f69480d27b0 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 0x7f69481622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 0x7f69481622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34220/0 (socket says 172.21.15.100:34220) 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 -- 172.21.15.100:0/1013653858 learned_addr learned my addr 172.21.15.100:0/1013653858 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6945e00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f694814d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 -- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 msgr2=0x7f694814d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6945400640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480d4e40 0x7f69480cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f694814d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 -- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480d4e40 msgr2=0x7f69480cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480d4e40 0x7f69480cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 -- 172.21.15.100:0/1013653858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948161510 con 0x7f694815f420 2024-05-09T05:04:50.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6945e00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f694814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.186+0000 7f6946800640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 0x7f69481622d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f694000b970 tx=0x7f694000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.187+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940019070 con 0x7f694815f420 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.187+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694000cb60 con 0x7f694815f420 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.187+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940014440 con 0x7f694815f420 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.187+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69481617f0 con 0x7f694815f420 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.187+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6948161db0 con 0x7f694815f420 2024-05-09T05:04:50.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.188+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694806e120 con 0x7f694815f420 2024-05-09T05:04:50.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.189+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f694001c070 con 0x7f694815f420 2024-05-09T05:04:50.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.190+0000 7f693e000640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f69280762d0 0x7f6928078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.190+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f69400973e0 con 0x7f694815f420 2024-05-09T05:04:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.191+0000 7f6945e00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f69280762d0 0x7f6928078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:50.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.191+0000 7f6945e00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f69280762d0 0x7f6928078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6938003eb0 tx=0x7f6938009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:50.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.195+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f694806e120 con 0x7f694815f420 2024-05-09T05:04:50.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.443+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f694806a5c0 con 0x7f694815f420 2024-05-09T05:04:50.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.443+0000 7f693e000640 1 -- 172.21.15.100:0/1013653858 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f6940060d30 con 0x7f694815f420 2024-05-09T05:04:50.444 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f69280762d0 msgr2=0x7f6928078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f69280762d0 0x7f6928078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6938003eb0 tx=0x7f6938009040 comp rx=0 tx=0).stop 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 msgr2=0x7f69481622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 0x7f69481622d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f694000b970 tx=0x7f694000be30 comp rx=0 tx=0).stop 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 shutdown_connections 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f69280762d0 0x7f6928078790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694815f420 0x7f69481622d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69480d4e40 0x7f69480cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 --2- 172.21.15.100:0/1013653858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69480d27b0 0x7f694814d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:50.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 >> 172.21.15.100:0/1013653858 conn(0x7f6948073f20 msgr2=0x7f69480c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:50.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 shutdown_connections 2024-05-09T05:04:50.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:50.446+0000 7f694ca00640 1 -- 172.21.15.100:0/1013653858 wait complete. 2024-05-09T05:04:50.464 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T05:04:50.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:04:50.465 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-09T05:04:50.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:50.465 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-05-09T05:04:50.523 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42612sec preferred_lft 42612sec 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ca:52:62:a8:dd:0c brd ff:ff:ff:ff:ff:ff 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-09T05:04:50.524 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:50.525 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::7446:88ff:fed2:e3f8/64 scope link 2024-05-09T05:04:50.525 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:50.525 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-09T05:04:50.525 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ca:52:62:a8:dd:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T05:04:50.525 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c852:62ff:fea8:dd0c/64 scope link 2024-05-09T05:04:50.525 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:50.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:50.526 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:04:50.607 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-05-09T05:04:50.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:50.611 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-05-09T05:04:50.660 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-05-09T05:04:50.660 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:04:50.660 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:04:50.660 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:04:50.660 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:04:50.661 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:50.661 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:50.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:04:50.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:04:50.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:04:50.662 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:50.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:50.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:50.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:50.867 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-05-09T05:04:50.916 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T05:04:50.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:50.917 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-05-09T05:04:50.968 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-09T05:04:50.969 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:50.969 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:50.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-09T05:04:50.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-09T05:04:50.969 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:51.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:51.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:04:51.222 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ba:43:8e:8b:36:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-09T05:04:51.223 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-09T05:04:51.223 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.223 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::b843:8eff:fe8b:364d/64 scope link 2024-05-09T05:04:51.223 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:51.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ba:43:8e:8b:36:4d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.308 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::b843:8eff:fe8b:364d/64 scope link 2024-05-09T05:04:51.309 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:04:51.312 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-09T05:04:51.312 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:51.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:51.592 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:04:51.593 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-05-09T05:04:51.593 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2024-05-09T05:04:51.593 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2024-05-09T05:04:51.593 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-05-09T05:04:51.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:51.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:51.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:51.800 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-09T05:04:51.842 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-09T05:04:51.843 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:04:51.843 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-09T05:04:51.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T05:04:51.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:51.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-09T05:04:52.067 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-09T05:04:52.067 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-09T05:04:52.067 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-05-09T05:04:52.087 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-09T05:04:52.087 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-09T05:04:52.088 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-05-09T05:04:52.088 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:52.088 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:invalid new device string format 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790" 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2024-05-09T05:04:52.116 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=11e43d29-3063-46a7-bef1-2ecadce2fdc5" will pass to kernel 2024-05-09T05:04:52.118 INFO:teuthology.orchestra.run.smithi133.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-09T05:04:52.118 INFO:teuthology.orchestra.run.smithi133.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:04:52.118 INFO:teuthology.orchestra.run.smithi133.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:04:52.118 INFO:teuthology.orchestra.run.smithi133.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:04:52.118 INFO:teuthology.orchestra.run.smithi133.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:04:52.125 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:04:52.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:52.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-09T05:04:52.196 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:52.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:52.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:52.311 INFO:teuthology.orchestra.run.smithi133.stdout:client4486 2024-05-09T05:04:52.311 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:52.311 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:52.358 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:52.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:52.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:52.520 INFO:teuthology.orchestra.run.smithi133.stdout:client4486 2024-05-09T05:04:52.521 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:04:52.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:04:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:52.641 INFO:teuthology.orchestra.run.smithi133.stdout:client4486 2024-05-09T05:04:52.642 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/11e43d29-3063-46a7-bef1-2ecadce2fdc5.client4486/status') 2024-05-09T05:04:52.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:04:52.777 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4486 (3)192.168.0.2:0/4089785934 2024-05-09T05:04:52.777 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2024-05-09T05:04:52.777 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2024-05-09T05:04:52.777 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2024-05-09T05:04:52.777 INFO:teuthology.orchestra.run.smithi133.stderr:69 bytes copied, 9.3943e-05 s, 734 kB/s 2024-05-09T05:04:52.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-05-09T05:04:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:04:52.790 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-09T05:04:52.814 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-05-09T05:04:52.814 INFO:tasks.cephfs_test_runner:test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-05-09T05:04:52.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:04:53.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.030+0000 7fae1d600640 1 Processor -- start 2024-05-09T05:04:53.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.030+0000 7fae1d600640 1 -- start start 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae1d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 0x7fae1815e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae1d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae180afb70 0x7fae180affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae1d600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1815e780 con 0x7fae180ade90 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae1d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fae180ae3a0 con 0x7fae180afb70 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae1d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fae180b4590 con 0x7fae180d0a70 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae16000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fae180ade90 0x7fae180b5070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55442/0 (socket says 172.21.15.100:55442) 2024-05-09T05:04:53.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.032+0000 7fae16000640 1 -- 172.21.15.100:0/2177048189 learned_addr learned my addr 172.21.15.100:0/2177048189 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae17400640 1 --2- 172.21.15.100:0/2177048189 >> v2:172.21.15.133:3300/0 conn(0x7fae180afb70 0x7fae180affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612499308 0 0) 0x7fae04001110 con 0x7fae180ade90 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadfc003520 con 0x7fae180ade90 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae16a00640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 0x7fae1815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2530059506 0 0) 0x7fadfc003520 con 0x7fae180ade90 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 msgr2=0x7fae1815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 0x7fae1815e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 >> v2:172.21.15.133:3300/0 conn(0x7fae180afb70 msgr2=0x7fae180affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 --2- 172.21.15.100:0/2177048189 >> v2:172.21.15.133:3300/0 conn(0x7fae180afb70 0x7fae180affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae180b4870 con 0x7fae180ade90 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fae040018c0 con 0x7fae180ade90 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 >> v1:172.21.15.100:6789/0 conn(0x7fae180ade90 legacy=0x7fae180b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc003a50 0x7fadfc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc004800 0x7fadfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 0x7fadfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae180ae3a0 con 0x7fadfc004800 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fae180b4590 con 0x7fadfc003a50 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.033+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc00ba10 con 0x7fae180d0a70 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16000640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc004800 0x7fadfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16a00640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc003a50 0x7fadfc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16000640 1 -- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 msgr2=0x7fadfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16000640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae180d0a70 0x7fadfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16000640 1 -- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc003a50 msgr2=0x7fadfc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16000640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc003a50 0x7fadfc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.034+0000 7fae16000640 1 -- 172.21.15.100:0/2177048189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc003520 con 0x7fadfc004800 2024-05-09T05:04:53.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.035+0000 7fae16000640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc004800 0x7fadfc004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c4c0 tx=0x7fadfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cdd5ed39fa1c22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.035+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04036070 con 0x7fadfc004800 2024-05-09T05:04:53.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.035+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04005ad0 con 0x7fadfc004800 2024-05-09T05:04:53.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.035+0000 7fae15600640 1 -- 172.21.15.100:0/2177048189 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400c0e0 con 0x7fadfc004800 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae1d600640 1 -- 172.21.15.100:0/2177048189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc004800 msgr2=0x7fadfc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae1d600640 1 --2- 172.21.15.100:0/2177048189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc004800 0x7fadfc004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c4c0 tx=0x7fadfc005830 comp rx=0 tx=0).stop 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae17400640 1 -- 172.21.15.100:0/2177048189 reap_dead start 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae1d600640 1 -- 172.21.15.100:0/2177048189 shutdown_connections 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae1d600640 1 -- 172.21.15.100:0/2177048189 >> 172.21.15.100:0/2177048189 conn(0x7fae180b31e0 msgr2=0x7fae180d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae1d600640 1 -- 172.21.15.100:0/2177048189 shutdown_connections 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.036+0000 7fae1d600640 1 -- 172.21.15.100:0/2177048189 wait complete. 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.038+0000 7fae1d600640 1 Processor -- start 2024-05-09T05:04:53.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.038+0000 7fae1d600640 1 -- start start 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae1d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc004800 0x7fae1814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae1d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae18158140 0x7fae1809dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae1d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 0x7fae1815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae1d600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae180b0500 con 0x7fae1815f9b0 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae1d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fae180ae680 con 0x7fadfc004800 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae1d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fae1815e240 con 0x7fae18158140 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae17400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 0x7fae1815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae17400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 0x7fae1815fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50248/0 (socket says 172.21.15.100:50248) 2024-05-09T05:04:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.039+0000 7fae17400640 1 -- 172.21.15.100:0/3709574800 learned_addr learned my addr 172.21.15.100:0/3709574800 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae17400640 1 -- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae18158140 msgr2=0x7fae1809dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae17400640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae18158140 0x7fae1809dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae17400640 1 -- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc004800 msgr2=0x7fae1814d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae16a00640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc004800 0x7fae1814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae17400640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc004800 0x7fae1814d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae17400640 1 -- 172.21.15.100:0/3709574800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1814dca0 con 0x7fae1815f9b0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae17400640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 0x7fae1815fe30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae18070950 tx=0x7fae1000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1000bce0 con 0x7fae1815f9b0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1001a070 con 0x7fae1815f9b0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1814df80 con 0x7fae1815f9b0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.040+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10014640 con 0x7fae1815f9b0 2024-05-09T05:04:53.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.041+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1814e540 con 0x7fae1815f9b0 2024-05-09T05:04:53.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.042+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae18076070 con 0x7fae1815f9b0 2024-05-09T05:04:53.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.043+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fae10005d10 con 0x7fae1815f9b0 2024-05-09T05:04:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.044+0000 7fae0ea00640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fadf8076300 0x7fadf80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.044+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fae10097940 con 0x7fae1815f9b0 2024-05-09T05:04:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.044+0000 7fae16a00640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fadf8076300 0x7fadf80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.045+0000 7fae16a00640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fadf8076300 0x7fadf80787c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fae080097f0 tx=0x7fae08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.048+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fae10024020 con 0x7fae1815f9b0 2024-05-09T05:04:53.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.258+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae1815d320 con 0x7fae1815f9b0 2024-05-09T05:04:53.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.260+0000 7fae0ea00640 1 -- 172.21.15.100:0/3709574800 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fae10061200 con 0x7fae1815f9b0 2024-05-09T05:04:53.261 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:53.261 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fadf8076300 msgr2=0x7fadf80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fadf8076300 0x7fadf80787c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fae080097f0 tx=0x7fae08008040 comp rx=0 tx=0).stop 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 msgr2=0x7fae1815fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 0x7fae1815fe30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae18070950 tx=0x7fae1000b480 comp rx=0 tx=0).stop 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 shutdown_connections 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fadf8076300 0x7fadf80787c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1815f9b0 0x7fae1815fe30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae18158140 0x7fae1809dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 --2- 172.21.15.100:0/3709574800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadfc004800 0x7fae1814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 >> 172.21.15.100:0/3709574800 conn(0x7fae180b31e0 msgr2=0x7fae180b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:53.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 shutdown_connections 2024-05-09T05:04:53.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.263+0000 7fae1d600640 1 -- 172.21.15.100:0/3709574800 wait complete. 2024-05-09T05:04:53.281 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T05:04:11.914841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T05:04:21.773351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T05:04:22.585138+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T05:04:53.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T05:04:53.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.474+0000 7f1191200640 1 Processor -- start 2024-05-09T05:04:53.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.475+0000 7f1191200640 1 -- start start 2024-05-09T05:04:53.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f1191200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f118c0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f1191200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f118c0d5c40 0x7f118c0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f1191200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118c15fdc0 con 0x7f118c0d3700 2024-05-09T05:04:53.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f1191200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f118c1600a0 con 0x7f118c0d5c40 2024-05-09T05:04:53.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f1191200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f118c160380 con 0x7f118c15f860 2024-05-09T05:04:53.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f118b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f118c0d3700 0x7f118c0d3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55444/0 (socket says 172.21.15.100:55444) 2024-05-09T05:04:53.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.476+0000 7f118b400640 1 -- 172.21.15.100:0/716986083 learned_addr learned my addr 172.21.15.100:0/716986083 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118be00640 1 --2- 172.21.15.100:0/716986083 >> v2:172.21.15.133:3300/0 conn(0x7f118c0d5c40 0x7f118c0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118aa00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f118c0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938894148 0 0) 0x7f118c15fdc0 con 0x7f118c0d3700 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f116c003520 con 0x7f118c0d3700 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2063054784 0 0) 0x7f116c003520 con 0x7f118c0d3700 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 msgr2=0x7f118c0d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f118c0d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 >> v2:172.21.15.133:3300/0 conn(0x7f118c0d5c40 msgr2=0x7f118c0cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 --2- 172.21.15.100:0/716986083 >> v2:172.21.15.133:3300/0 conn(0x7f118c0d5c40 0x7f118c0cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c160660 con 0x7f118c0d3700 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f117c0016f0 con 0x7f118c0d3700 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 >> v1:172.21.15.100:6789/0 conn(0x7f118c0d3700 legacy=0x7f118c0d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f116c003a50 0x7f116c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f116c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f116c004d40 0x7f116c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f118c1600a0 con 0x7f116c004d40 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f118c160380 con 0x7f116c003a50 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.477+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f116c00ba80 con 0x7f118c15f860 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118be00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f116c004d40 0x7f116c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118b400640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f116c003a50 0x7f116c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118aa00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f116c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118be00640 1 -- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 msgr2=0x7f116c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118be00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f116c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118be00640 1 -- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f116c003a50 msgr2=0x7f116c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118be00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f116c003a50 0x7f116c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118be00640 1 -- 172.21.15.100:0/716986083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116c003520 con 0x7f116c004d40 2024-05-09T05:04:53.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.478+0000 7f118aa00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c15f860 0x7f116c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.479+0000 7f118be00640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f116c004d40 0x7f116c0051c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1184009ac0 tx=0x7f116c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2393f13efd37a11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.479+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1184036070 con 0x7f116c004d40 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1184031400 con 0x7f116c004d40 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f118a000640 1 -- 172.21.15.100:0/716986083 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1184009690 con 0x7f116c004d40 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f1191200640 1 -- 172.21.15.100:0/716986083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f116c004d40 msgr2=0x7f116c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f1191200640 1 --2- 172.21.15.100:0/716986083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f116c004d40 0x7f116c0051c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1184009ac0 tx=0x7f116c005830 comp rx=0 tx=0).stop 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f118be00640 1 -- 172.21.15.100:0/716986083 reap_dead start 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f1191200640 1 -- 172.21.15.100:0/716986083 shutdown_connections 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f1191200640 1 -- 172.21.15.100:0/716986083 >> 172.21.15.100:0/716986083 conn(0x7f118c0d5120 msgr2=0x7f118c0d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f1191200640 1 -- 172.21.15.100:0/716986083 shutdown_connections 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.480+0000 7f1191200640 1 -- 172.21.15.100:0/716986083 wait complete. 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.482+0000 7f1191200640 1 Processor -- start 2024-05-09T05:04:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.482+0000 7f1191200640 1 -- start start 2024-05-09T05:04:53.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f1191200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 0x7f118c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f1191200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c1f5eb0 0x7f118c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f1191200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0ce740 0x7f118c0b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f1191200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f118c0d3080 con 0x7f118c15a880 2024-05-09T05:04:53.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f1191200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f118c0d2f00 con 0x7f118c0ce740 2024-05-09T05:04:53.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f1191200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f118c0d3200 con 0x7f118c1f5eb0 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f118b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 0x7f118c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f118b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 0x7f118c1f5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50262/0 (socket says 172.21.15.100:50262) 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.483+0000 7f118b400640 1 -- 172.21.15.100:0/3599387312 learned_addr learned my addr 172.21.15.100:0/3599387312 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118be00640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0ce740 0x7f118c0b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118b400640 1 -- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c1f5eb0 msgr2=0x7f118c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118aa00640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c1f5eb0 0x7f118c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118b400640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c1f5eb0 0x7f118c0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118b400640 1 -- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0ce740 msgr2=0x7f118c0b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118b400640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0ce740 0x7f118c0b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118b400640 1 -- 172.21.15.100:0/3599387312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c1f69f0 con 0x7f118c15a880 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118be00640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0ce740 0x7f118c0b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f118b400640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 0x7f118c1f5970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f117c00eb20 tx=0x7f117c001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c00c8d0 con 0x7f118c15a880 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c018070 con 0x7f118c15a880 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c00ccb0 con 0x7f118c15a880 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.484+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c1f6430 con 0x7f118c15a880 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.485+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c1f6cb0 con 0x7f118c15a880 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.486+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c0d4b80 con 0x7f118c15a880 2024-05-09T05:04:53.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.487+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f117c01d460 con 0x7f118c15a880 2024-05-09T05:04:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.487+0000 7f1183400640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f11680762d0 0x7f1168078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.488+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f117c097470 con 0x7f118c15a880 2024-05-09T05:04:53.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.488+0000 7f118aa00640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f11680762d0 0x7f1168078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.488+0000 7f118aa00640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f11680762d0 0x7f1168078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f118c0b75b0 tx=0x7f117400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.492+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f118c0d4b80 con 0x7f118c15a880 2024-05-09T05:04:53.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.679+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f118c0ceb20 con 0x7f118c15a880 2024-05-09T05:04:53.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.680+0000 7f1183400640 1 -- 172.21.15.100:0/3599387312 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f117c060dd0 con 0x7f118c15a880 2024-05-09T05:04:53.681 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f11680762d0 msgr2=0x7f1168078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f11680762d0 0x7f1168078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f118c0b75b0 tx=0x7f117400b040 comp rx=0 tx=0).stop 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 msgr2=0x7f118c1f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 0x7f118c1f5970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f117c00eb20 tx=0x7f117c001740 comp rx=0 tx=0).stop 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 shutdown_connections 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f11680762d0 0x7f1168078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0ce740 0x7f118c0b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f118c1f5eb0 0x7f118c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 --2- 172.21.15.100:0/3599387312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c15a880 0x7f118c1f5970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 >> 172.21.15.100:0/3599387312 conn(0x7f118c0d5120 msgr2=0x7f118c15c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 shutdown_connections 2024-05-09T05:04:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.683+0000 7f1191200640 1 -- 172.21.15.100:0/3599387312 wait complete. 2024-05-09T05:04:53.702 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T05:04:53.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.905+0000 7fdcd1400640 1 Processor -- start 2024-05-09T05:04:53.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.906+0000 7fdcd1400640 1 -- start start 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.907+0000 7fdcd1400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdccc0b8940 0x7fdccc0d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.907+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc06e600 0x7fdccc15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.907+0000 7fdcd1400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdccc0cd650 con 0x7fdccc06d780 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.907+0000 7fdcd1400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fdccc0d2590 con 0x7fdccc0b8940 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.907+0000 7fdcd1400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc0cdf80 con 0x7fdccc06e600 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.908+0000 7fdcc3400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdccc06d780 0x7fdccc06def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:39724/0 (socket says 172.21.15.100:39724) 2024-05-09T05:04:53.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.908+0000 7fdcc3400640 1 -- 172.21.15.100:0/1881472184 learned_addr learned my addr 172.21.15.100:0/1881472184 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:53.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.908+0000 7fdcd0a00640 1 --2- 172.21.15.100:0/1881472184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc06e600 0x7fdccc15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.908+0000 7fdccbe00640 1 --2- 172.21.15.100:0/1881472184 >> v2:172.21.15.133:3300/0 conn(0x7fdccc0b8940 0x7fdccc0d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.909+0000 7fdcd0a00640 1 -- 172.21.15.100:0/1881472184 >> v2:172.21.15.133:3300/0 conn(0x7fdccc0b8940 msgr2=0x7fdccc0d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:53.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.909+0000 7fdcd0a00640 1 --2- 172.21.15.100:0/1881472184 >> v2:172.21.15.133:3300/0 conn(0x7fdccc0b8940 0x7fdccc0d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.909+0000 7fdcd0a00640 1 -- 172.21.15.100:0/1881472184 >> v1:172.21.15.133:6789/0 conn(0x7fdccc06d780 legacy=0x7fdccc06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.909+0000 7fdcd0a00640 1 -- 172.21.15.100:0/1881472184 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc0cd930 con 0x7fdccc06e600 2024-05-09T05:04:53.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.910+0000 7fdcd0a00640 1 --2- 172.21.15.100:0/1881472184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc06e600 0x7fdccc15eb40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d260e16e6384463 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.910+0000 7fdccb400640 1 -- 172.21.15.100:0/1881472184 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4037070 con 0x7fdccc06e600 2024-05-09T05:04:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdccb400640 1 -- 172.21.15.100:0/1881472184 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc402ae50 con 0x7fdccc06e600 2024-05-09T05:04:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdccb400640 1 -- 172.21.15.100:0/1881472184 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4032660 con 0x7fdccc06e600 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 -- 172.21.15.100:0/1881472184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc06e600 msgr2=0x7fdccc15eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 --2- 172.21.15.100:0/1881472184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc06e600 0x7fdccc15eb40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402a100 comp rx=0 tx=0).stop 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 -- 172.21.15.100:0/1881472184 shutdown_connections 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 --2- 172.21.15.100:0/1881472184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc06e600 0x7fdccc15eb40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 --2- 172.21.15.100:0/1881472184 >> v2:172.21.15.133:3300/0 conn(0x7fdccc0b8940 0x7fdccc0d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 -- 172.21.15.100:0/1881472184 >> 172.21.15.100:0/1881472184 conn(0x7fdccc0d2ed0 msgr2=0x7fdccc0d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.911+0000 7fdcd1400640 1 -- 172.21.15.100:0/1881472184 shutdown_connections 2024-05-09T05:04:53.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.912+0000 7fdcd1400640 1 -- 172.21.15.100:0/1881472184 wait complete. 2024-05-09T05:04:53.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.913+0000 7fdcd1400640 1 Processor -- start 2024-05-09T05:04:53.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.914+0000 7fdcd1400640 1 -- start start 2024-05-09T05:04:53.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdccc06d780 0x7fdccc1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 0x7fdccc0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcd1400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc0b8940 0x7fdccc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcd1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc0d2160 con 0x7fdccc06e600 2024-05-09T05:04:53.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcd1400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc0b8d20 con 0x7fdccc06d780 2024-05-09T05:04:53.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcd1400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdccc0d22e0 con 0x7fdccc0b8940 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcc3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 0x7fdccc0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcc3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 0x7fdccc0c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50264/0 (socket says 172.21.15.100:50264) 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdcc3400640 1 -- 172.21.15.100:0/459214321 learned_addr learned my addr 172.21.15.100:0/459214321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.915+0000 7fdccbe00640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdccc06d780 0x7fdccc1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcd0a00640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc0b8940 0x7fdccc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc3400640 1 -- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc0b8940 msgr2=0x7fdccc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc3400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc0b8940 0x7fdccc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc3400640 1 -- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdccc06d780 msgr2=0x7fdccc1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc3400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdccc06d780 0x7fdccc1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc3400640 1 -- 172.21.15.100:0/459214321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc154930 con 0x7fdccc06e600 2024-05-09T05:04:53.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcd0a00640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc0b8940 0x7fdccc0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:53.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc3400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 0x7fdccc0c6a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c3a0 tx=0x7fdcb400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4017070 con 0x7fdccc06e600 2024-05-09T05:04:53.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb4005ce0 con 0x7fdccc06e600 2024-05-09T05:04:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc0c74c0 con 0x7fdccc06e600 2024-05-09T05:04:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4007310 con 0x7fdccc06e600 2024-05-09T05:04:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.916+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc0c7a80 con 0x7fdccc06e600 2024-05-09T05:04:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.918+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdccc06a550 con 0x7fdccc06e600 2024-05-09T05:04:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.919+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdcb401a070 con 0x7fdccc06e600 2024-05-09T05:04:53.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.920+0000 7fdcc8c00640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdca8076300 0x7fdca80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:53.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.920+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdcb40968b0 con 0x7fdccc06e600 2024-05-09T05:04:53.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.920+0000 7fdccbe00640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdca8076300 0x7fdca80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:53.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.921+0000 7fdccbe00640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdca8076300 0x7fdca80787c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0073f0 tx=0x7fdcbc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:53.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:53.925+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdcb40602a0 con 0x7fdccc06e600 2024-05-09T05:04:54.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.129+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdccc06e3c0 con 0x7fdccc06e600 2024-05-09T05:04:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.130+0000 7fdcc8c00640 1 -- 172.21.15.100:0/459214321 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fdcb4068290 con 0x7fdccc06e600 2024-05-09T05:04:54.130 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-05-09T05:04:54.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.132+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdca8076300 msgr2=0x7fdca80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.132+0000 7fdcd1400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdca8076300 0x7fdca80787c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0073f0 tx=0x7fdcbc00b040 comp rx=0 tx=0).stop 2024-05-09T05:04:54.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.132+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 msgr2=0x7fdccc0c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.132+0000 7fdcd1400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 0x7fdccc0c6a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c3a0 tx=0x7fdcb400c860 comp rx=0 tx=0).stop 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.132+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 shutdown_connections 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdca8076300 0x7fdca80787c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdccc0b8940 0x7fdccc0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdccc06e600 0x7fdccc0c6a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 --2- 172.21.15.100:0/459214321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdccc06d780 0x7fdccc1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 >> 172.21.15.100:0/459214321 conn(0x7fdccc0d2ed0 msgr2=0x7fdccc0cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 shutdown_connections 2024-05-09T05:04:54.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.133+0000 7fdcd1400640 1 -- 172.21.15.100:0/459214321 wait complete. 2024-05-09T05:04:54.151 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T05:04:54.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.346+0000 7f8511600640 1 Processor -- start 2024-05-09T05:04:54.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.346+0000 7f8511600640 1 -- start start 2024-05-09T05:04:54.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.347+0000 7f8511600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f850c15d630 0x7f850c0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f8511600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f850c06f090 con 0x7f850c06eb90 2024-05-09T05:04:54.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f8511600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f850c06f370 con 0x7f850c0b6980 2024-05-09T05:04:54.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f8511600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f850c0b5fb0 con 0x7f850c15d630 2024-05-09T05:04:54.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f850be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f850c15d630 0x7f850c0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f8510c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f850c06eb90 0x7f850c0721e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55446/0 (socket says 172.21.15.100:55446) 2024-05-09T05:04:54.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f8510c00640 1 -- 172.21.15.100:0/973849947 learned_addr learned my addr 172.21.15.100:0/973849947 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:54.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f850be00640 1 -- 172.21.15.100:0/973849947 >> v1:172.21.15.133:6789/0 conn(0x7f850c0b6980 legacy=0x7f850c06e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:54.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f850be00640 1 -- 172.21.15.100:0/973849947 >> v1:172.21.15.100:6789/0 conn(0x7f850c06eb90 legacy=0x7f850c0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f850be00640 1 -- 172.21.15.100:0/973849947 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c0b5960 con 0x7f850c15d630 2024-05-09T05:04:54.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.348+0000 7f850b400640 1 -- 172.21.15.100:0/973849947 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274252989 0 0) 0x7f850c06f090 con 0x7f850c06eb90 2024-05-09T05:04:54.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.350+0000 7f850be00640 1 --2- 172.21.15.100:0/973849947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c0b6440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0097a0 tx=0x7f84fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6708df4f533d7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:54.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.350+0000 7f850b400640 1 -- 172.21.15.100:0/973849947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc037070 con 0x7f850c15d630 2024-05-09T05:04:54.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.350+0000 7f850b400640 1 -- 172.21.15.100:0/973849947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc032440 con 0x7f850c15d630 2024-05-09T05:04:54.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.350+0000 7f850b400640 1 -- 172.21.15.100:0/973849947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc032810 con 0x7f850c15d630 2024-05-09T05:04:54.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.350+0000 7f8511600640 1 -- 172.21.15.100:0/973849947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 msgr2=0x7f850c0b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.350+0000 7f8511600640 1 --2- 172.21.15.100:0/973849947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c0b6440 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0097a0 tx=0x7f84fc02a180 comp rx=0 tx=0).stop 2024-05-09T05:04:54.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.351+0000 7f8511600640 1 -- 172.21.15.100:0/973849947 shutdown_connections 2024-05-09T05:04:54.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.351+0000 7f8511600640 1 --2- 172.21.15.100:0/973849947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c0b6440 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.351+0000 7f8511600640 1 -- 172.21.15.100:0/973849947 >> 172.21.15.100:0/973849947 conn(0x7f850c0b29b0 msgr2=0x7f850c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:54.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.351+0000 7f8511600640 1 -- 172.21.15.100:0/973849947 shutdown_connections 2024-05-09T05:04:54.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.351+0000 7f8511600640 1 -- 172.21.15.100:0/973849947 wait complete. 2024-05-09T05:04:54.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.352+0000 7f8511600640 1 Processor -- start 2024-05-09T05:04:54.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.353+0000 7f8511600640 1 -- start start 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8511600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f850c06eb90 0x7f850c1447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8511600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850c0b6980 0x7f850c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8511600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8511600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0728f0 con 0x7f850c15d630 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8511600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f850c0b4000 con 0x7f850c0b6980 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8511600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f850c072a70 con 0x7f850c06eb90 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50278/0 (socket says 172.21.15.100:50278) 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 -- 172.21.15.100:0/2993756539 learned_addr learned my addr 172.21.15.100:0/2993756539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:54.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 -- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f850c06eb90 msgr2=0x7f850c1447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f850c06eb90 0x7f850c1447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 -- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850c0b6980 msgr2=0x7f850c15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8503400640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850c0b6980 0x7f850c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850c0b6980 0x7f850c15fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.354+0000 7f8510c00640 1 -- 172.21.15.100:0/2993756539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c159780 con 0x7f850c15d630 2024-05-09T05:04:54.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.355+0000 7f8510c00640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c150150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f850400c730 tx=0x7f850400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:54.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.355+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8504018070 con 0x7f850c15d630 2024-05-09T05:04:54.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.355+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8504004d60 con 0x7f850c15d630 2024-05-09T05:04:54.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.355+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850400a880 con 0x7f850c15d630 2024-05-09T05:04:54.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.355+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c159a60 con 0x7f850c15d630 2024-05-09T05:04:54.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.355+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c15a540 con 0x7f850c15d630 2024-05-09T05:04:54.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.356+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c0b4df0 con 0x7f850c15d630 2024-05-09T05:04:54.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.357+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f850400ac30 con 0x7f850c15d630 2024-05-09T05:04:54.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.358+0000 7f8508c00640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f84e80762d0 0x7f84e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.359+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8504096dc0 con 0x7f850c15d630 2024-05-09T05:04:54.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.359+0000 7f850be00640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f84e80762d0 0x7f84e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.359+0000 7f850be00640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f84e80762d0 0x7f84e8078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84fc034000 tx=0x7f84fc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:54.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.363+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f850c0b4df0 con 0x7f850c15d630 2024-05-09T05:04:54.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.571+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f850c06a550 con 0x7f850c15d630 2024-05-09T05:04:54.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.572+0000 7f8508c00640 1 -- 172.21.15.100:0/2993756539 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f8504060680 con 0x7f850c15d630 2024-05-09T05:04:54.573 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f84e80762d0 msgr2=0x7f84e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f84e80762d0 0x7f84e8078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f84fc034000 tx=0x7f84fc02c000 comp rx=0 tx=0).stop 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 msgr2=0x7f850c150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c150150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f850400c730 tx=0x7f850400cbf0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 shutdown_connections 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f84e80762d0 0x7f84e8078790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f850c15d630 0x7f850c150150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850c0b6980 0x7f850c15fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 --2- 172.21.15.100:0/2993756539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f850c06eb90 0x7f850c1447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 >> 172.21.15.100:0/2993756539 conn(0x7f850c0b29b0 msgr2=0x7f850c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:54.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 shutdown_connections 2024-05-09T05:04:54.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.575+0000 7f8511600640 1 -- 172.21.15.100:0/2993756539 wait complete. 2024-05-09T05:04:54.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-05-09T05:04:54.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.795+0000 7fc54d000640 1 Processor -- start 2024-05-09T05:04:54.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.796+0000 7fc54d000640 1 -- start start 2024-05-09T05:04:54.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.797+0000 7fc54d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 0x7fc5480b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.797+0000 7fc54d000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5480b55b0 con 0x7fc5480d0a70 2024-05-09T05:04:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.797+0000 7fc54d000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5480ae3a0 con 0x7fc5480afb70 2024-05-09T05:04:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.797+0000 7fc54d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc5480b4590 con 0x7fc5480ade90 2024-05-09T05:04:54.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.797+0000 7fc545e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc5480d0a70 0x7fc54815e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55462/0 (socket says 172.21.15.100:55462) 2024-05-09T05:04:54.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.798+0000 7fc545e00640 1 -- 172.21.15.100:0/2849210280 learned_addr learned my addr 172.21.15.100:0/2849210280 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:54.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.798+0000 7fc545400640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 0x7fc5480b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.798+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638080619 0 0) 0x7fc538001110 con 0x7fc5480d0a70 2024-05-09T05:04:54.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.798+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc528003520 con 0x7fc5480d0a70 2024-05-09T05:04:54.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.798+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2794417988 0 0) 0x7fc528003520 con 0x7fc5480d0a70 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 msgr2=0x7fc5480b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 0x7fc5480b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 >> v1:172.21.15.133:6789/0 conn(0x7fc5480afb70 legacy=0x7fc5480affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5480b4870 con 0x7fc5480d0a70 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fc5380018c0 con 0x7fc5480d0a70 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 >> v1:172.21.15.100:6789/0 conn(0x7fc5480d0a70 legacy=0x7fc54815e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 0x7fc528003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004000 0x7fc528004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc528004d40 0x7fc5280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5480b4590 con 0x7fc528004d40 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc52800bb50 con 0x7fc528004000 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc52800bd50 con 0x7fc5480ade90 2024-05-09T05:04:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc546800640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc528004d40 0x7fc5280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc545400640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004000 0x7fc528004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.799+0000 7fc545e00640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 0x7fc528003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.800+0000 7fc546800640 1 -- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 msgr2=0x7fc528003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.800+0000 7fc546800640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5480ade90 0x7fc528003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.800+0000 7fc546800640 1 -- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004000 msgr2=0x7fc528004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.800+0000 7fc546800640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004000 0x7fc528004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.800+0000 7fc546800640 1 -- 172.21.15.100:0/2849210280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc528003520 con 0x7fc528004d40 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.800+0000 7fc545400640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004000 0x7fc528004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.801+0000 7fc546800640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc528004d40 0x7fc5280051c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc540001790 tx=0x7fc528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8fe90c6fde9957 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.801+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400013b0 con 0x7fc528004d40 2024-05-09T05:04:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.801+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5400052d0 con 0x7fc528004d40 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.801+0000 7fc544a00640 1 -- 172.21.15.100:0/2849210280 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54002aae0 con 0x7fc528004d40 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc54d000640 1 -- 172.21.15.100:0/2849210280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc528004d40 msgr2=0x7fc5280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc54d000640 1 --2- 172.21.15.100:0/2849210280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc528004d40 0x7fc5280051c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc540001790 tx=0x7fc528005830 comp rx=0 tx=0).stop 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc546800640 1 -- 172.21.15.100:0/2849210280 reap_dead start 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc54d000640 1 -- 172.21.15.100:0/2849210280 shutdown_connections 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc54d000640 1 -- 172.21.15.100:0/2849210280 >> 172.21.15.100:0/2849210280 conn(0x7fc5480b31e0 msgr2=0x7fc5480d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc54d000640 1 -- 172.21.15.100:0/2849210280 shutdown_connections 2024-05-09T05:04:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.802+0000 7fc54d000640 1 -- 172.21.15.100:0/2849210280 wait complete. 2024-05-09T05:04:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.804+0000 7fc54d000640 1 Processor -- start 2024-05-09T05:04:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.804+0000 7fc54d000640 1 -- start start 2024-05-09T05:04:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.805+0000 7fc54d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004d40 0x7fc5481f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.805+0000 7fc54d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5481435b0 0x7fc54815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.805+0000 7fc54d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 0x7fc54815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.805+0000 7fc54d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5480b5070 con 0x7fc54815ca50 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.805+0000 7fc54d000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5480ae680 con 0x7fc528004d40 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.805+0000 7fc54d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc5480b51f0 con 0x7fc5481435b0 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 0x7fc54815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 0x7fc54815ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50300/0 (socket says 172.21.15.100:50300) 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 -- 172.21.15.100:0/2763212322 learned_addr learned my addr 172.21.15.100:0/2763212322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc545e00640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004d40 0x7fc5481f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc545400640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5481435b0 0x7fc54815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 -- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5481435b0 msgr2=0x7fc54815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5481435b0 0x7fc54815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 -- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004d40 msgr2=0x7fc5481f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004d40 0x7fc5481f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.806+0000 7fc546800640 1 -- 172.21.15.100:0/2763212322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc548143e70 con 0x7fc54815ca50 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.807+0000 7fc546800640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 0x7fc54815ee60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5400018b0 tx=0x7fc540001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.807+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540037040 con 0x7fc54815ca50 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.807+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc540040070 con 0x7fc54815ca50 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.807+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400013b0 con 0x7fc54815ca50 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.807+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc548146250 con 0x7fc54815ca50 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.807+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc548146810 con 0x7fc54815ca50 2024-05-09T05:04:54.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.808+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc548076070 con 0x7fc54815ca50 2024-05-09T05:04:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.809+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5400052d0 con 0x7fc54815ca50 2024-05-09T05:04:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.811+0000 7fc53e000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc524076300 0x7fc5240787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.811+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc5400b6ed0 con 0x7fc54815ca50 2024-05-09T05:04:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.811+0000 7fc545e00640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc524076300 0x7fc5240787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.812+0000 7fc545e00640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc524076300 0x7fc5240787c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc538001410 tx=0x7fc538009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:54.815+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc540080810 con 0x7fc54815ca50 2024-05-09T05:04:55.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.099+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7fc54806a5c0 con 0x7fc54815ca50 2024-05-09T05:04:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.338+0000 7fc53e000640 1 -- 172.21.15.100:0/2763212322 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v50) ==== 138+0+0 (secure 0 0 0) 0x7fc540080110 con 0x7fc54815ca50 2024-05-09T05:04:55.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.342+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc524076300 msgr2=0x7fc5240787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.342+0000 7fc54d000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc524076300 0x7fc5240787c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc538001410 tx=0x7fc538009040 comp rx=0 tx=0).stop 2024-05-09T05:04:55.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.342+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 msgr2=0x7fc54815ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.342+0000 7fc54d000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 0x7fc54815ee60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5400018b0 tx=0x7fc540001120 comp rx=0 tx=0).stop 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.342+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 shutdown_connections 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.342+0000 7fc54d000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc524076300 0x7fc5240787c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.343+0000 7fc54d000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc54815ca50 0x7fc54815ee60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.343+0000 7fc54d000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5481435b0 0x7fc54815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.343+0000 7fc54d000640 1 --2- 172.21.15.100:0/2763212322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc528004d40 0x7fc5481f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.343+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 >> 172.21.15.100:0/2763212322 conn(0x7fc5480b31e0 msgr2=0x7fc54815bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.343+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 shutdown_connections 2024-05-09T05:04:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.343+0000 7fc54d000640 1 -- 172.21.15.100:0/2763212322 wait complete. 2024-05-09T05:04:55.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-09T05:04:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.575+0000 7f56b0e00640 1 Processor -- start 2024-05-09T05:04:55.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.576+0000 7f56b0e00640 1 -- start start 2024-05-09T05:04:55.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.577+0000 7f56b0e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac1465b0 0x7f56ac0b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:55.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.577+0000 7f56b0e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f56ac0b2940 0x7f56ac0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:55.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.577+0000 7f56b0e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56ac0b5940 con 0x7f56ac06f020 2024-05-09T05:04:55.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.577+0000 7f56b0e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f56ac0b32f0 con 0x7f56ac0b2940 2024-05-09T05:04:55.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.577+0000 7f56b0e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac0745f0 con 0x7f56ac1465b0 2024-05-09T05:04:55.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f56ac0b2940 0x7f56ac0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:55.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f56ac0b2940 0x7f56ac0b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50314/0 (socket says 172.21.15.100:50314) 2024-05-09T05:04:55.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 -- 172.21.15.100:0/674042165 learned_addr learned my addr 172.21.15.100:0/674042165 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:55.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 -- 172.21.15.100:0/674042165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac1465b0 msgr2=0x7f56ac0b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:55.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56ab400640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac1465b0 0x7f56ac0b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:55.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac1465b0 0x7f56ac0b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 -- 172.21.15.100:0/674042165 >> v1:172.21.15.133:6789/0 conn(0x7f56ac06f020 legacy=0x7f56ac073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:55.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56abe00640 1 -- 172.21.15.100:0/674042165 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac0b5c20 con 0x7f56ac0b2940 2024-05-09T05:04:55.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.578+0000 7f56ab400640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac1465b0 0x7f56ac0b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.579+0000 7f56abe00640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac0b2940 0x7f56ac0b2db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009e50 tx=0x7f56a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90231ca9a1fceff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56aaa00640 1 -- 172.21.15.100:0/674042165 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4036070 con 0x7f56ac0b2940 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56aaa00640 1 -- 172.21.15.100:0/674042165 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a4031600 con 0x7f56ac0b2940 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56aaa00640 1 -- 172.21.15.100:0/674042165 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a40319d0 con 0x7f56ac0b2940 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 -- 172.21.15.100:0/674042165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac0b2940 msgr2=0x7f56ac0b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac0b2940 0x7f56ac0b2db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f56a4009e50 tx=0x7f56a402a660 comp rx=0 tx=0).stop 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 -- 172.21.15.100:0/674042165 shutdown_connections 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac0b2940 0x7f56ac0b2db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 --2- 172.21.15.100:0/674042165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac1465b0 0x7f56ac0b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 -- 172.21.15.100:0/674042165 >> 172.21.15.100:0/674042165 conn(0x7f56ac0cd700 msgr2=0x7f56ac0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:55.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 -- 172.21.15.100:0/674042165 shutdown_connections 2024-05-09T05:04:55.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.580+0000 7f56b0e00640 1 -- 172.21.15.100:0/674042165 wait complete. 2024-05-09T05:04:55.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.582+0000 7f56b0e00640 1 Processor -- start 2024-05-09T05:04:55.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.582+0000 7f56b0e00640 1 -- start start 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56b0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 0x7f56ac15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56b0e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac0b2940 0x7f56ac0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56b0e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56ac1465b0 0x7f56ac0af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56b0e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0b64c0 con 0x7f56ac06f020 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56b0e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac0b61e0 con 0x7f56ac1465b0 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56b0e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac146990 con 0x7f56ac0b2940 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.583+0000 7f56ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 0x7f56ac15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 0x7f56ac15c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50316/0 (socket says 172.21.15.100:50316) 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 -- 172.21.15.100:0/3606458789 learned_addr learned my addr 172.21.15.100:0/3606458789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56abe00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56ac1465b0 0x7f56ac0af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:55.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 -- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac0b2940 msgr2=0x7f56ac0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac0b2940 0x7f56ac0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 -- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56ac1465b0 msgr2=0x7f56ac0af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56ac1465b0 0x7f56ac0af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 -- 172.21.15.100:0/3606458789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac0adf90 con 0x7f56ac06f020 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.584+0000 7f56ab400640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 0x7f56ac15c840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c7f0 tx=0x7f569c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.585+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c015070 con 0x7f56ac06f020 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.585+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c007820 con 0x7f56ac06f020 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.585+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac0ae270 con 0x7f56ac06f020 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.585+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c007bd0 con 0x7f56ac06f020 2024-05-09T05:04:55.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.585+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac0ae830 con 0x7f56ac06f020 2024-05-09T05:04:55.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.586+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac06a550 con 0x7f56ac06f020 2024-05-09T05:04:55.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.587+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f569c018070 con 0x7f56ac06f020 2024-05-09T05:04:55.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.588+0000 7f56a3400640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56880762d0 0x7f5688078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:55.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.588+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f569c0977a0 con 0x7f56ac06f020 2024-05-09T05:04:55.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.589+0000 7f56a3e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56880762d0 0x7f5688078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:55.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.589+0000 7f56a3e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56880762d0 0x7f5688078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0b6a90 tx=0x7f56940079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:55.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.593+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f569c061060 con 0x7f56ac06f020 2024-05-09T05:04:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.799+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f56ac0b0540 con 0x7f56ac06f020 2024-05-09T05:04:55.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.804+0000 7f56a3400640 1 -- 172.21.15.100:0/3606458789 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f569c060960 con 0x7f56ac06f020 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.807+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56880762d0 msgr2=0x7f5688078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.807+0000 7f56b0e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56880762d0 0x7f5688078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0b6a90 tx=0x7f56940079b0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 msgr2=0x7f56ac15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 0x7f56ac15c840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c7f0 tx=0x7f569c00ccb0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 shutdown_connections 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56880762d0 0x7f5688078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56ac1465b0 0x7f56ac0af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f56ac0b2940 0x7f56ac0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 --2- 172.21.15.100:0/3606458789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56ac06f020 0x7f56ac15c840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 >> 172.21.15.100:0/3606458789 conn(0x7f56ac0cd700 msgr2=0x7f56ac144290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 shutdown_connections 2024-05-09T05:04:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:55.808+0000 7f56b0e00640 1 -- 172.21.15.100:0/3606458789 wait complete. 2024-05-09T05:04:55.828 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-09T05:04:55.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:04:55.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:04:56.050 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-09T05:04:56.050 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:56.050 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:56.108 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:56.109 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:56.155 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:56.155 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:56.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:04:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.445+0000 7f7002200640 1 Processor -- start 2024-05-09T05:04:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.446+0000 7f7002200640 1 -- start start 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.447+0000 7f7002200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ffc1599d0 0x7f6ffc15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.447+0000 7f7002200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ffc06fca0 0x7f6ffc15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.447+0000 7f7002200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc160240 con 0x7f6ffc15d670 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.447+0000 7f7002200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6ffc15ffe0 con 0x7f6ffc1599d0 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.447+0000 7f7002200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f6ffc160520 con 0x7f6ffc06fca0 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.447+0000 7f7000e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ffc1599d0 0x7f6ffc15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7000e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ffc1599d0 0x7f6ffc15d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50326/0 (socket says 172.21.15.100:50326) 2024-05-09T05:04:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f6ffbe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6ffc15d670 0x7f6ffc06f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55478/0 (socket says 172.21.15.100:55478) 2024-05-09T05:04:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7000e00640 1 -- 172.21.15.100:0/285729945 learned_addr learned my addr 172.21.15.100:0/285729945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7001800640 1 --2- 172.21.15.100:0/285729945 >> v2:172.21.15.133:3300/0 conn(0x7f6ffc06fca0 0x7f6ffc15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7000e00640 1 -- 172.21.15.100:0/285729945 >> v2:172.21.15.133:3300/0 conn(0x7f6ffc06fca0 msgr2=0x7f6ffc15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7000e00640 1 --2- 172.21.15.100:0/285729945 >> v2:172.21.15.133:3300/0 conn(0x7f6ffc06fca0 0x7f6ffc15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7000e00640 1 -- 172.21.15.100:0/285729945 >> v1:172.21.15.100:6789/0 conn(0x7f6ffc15d670 legacy=0x7f6ffc06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.448+0000 7f7000e00640 1 -- 172.21.15.100:0/285729945 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc160800 con 0x7f6ffc1599d0 2024-05-09T05:04:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.449+0000 7f7000e00640 1 --2- 172.21.15.100:0/285729945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc1599d0 0x7f6ffc15d030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc15db50 tx=0x7f6ff002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cc49338e83cd7a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.449+0000 7f6ffb400640 1 -- 172.21.15.100:0/285729945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0037070 con 0x7f6ffc1599d0 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f6ffb400640 1 -- 172.21.15.100:0/285729945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff0032440 con 0x7f6ffc1599d0 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f6ffb400640 1 -- 172.21.15.100:0/285729945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0032810 con 0x7f6ffc1599d0 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 -- 172.21.15.100:0/285729945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc1599d0 msgr2=0x7f6ffc15d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 --2- 172.21.15.100:0/285729945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc1599d0 0x7f6ffc15d030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc15db50 tx=0x7f6ff002a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 -- 172.21.15.100:0/285729945 shutdown_connections 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 --2- 172.21.15.100:0/285729945 >> v2:172.21.15.133:3300/0 conn(0x7f6ffc06fca0 0x7f6ffc15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 --2- 172.21.15.100:0/285729945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc1599d0 0x7f6ffc15d030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 -- 172.21.15.100:0/285729945 >> 172.21.15.100:0/285729945 conn(0x7f6ffc0b29b0 msgr2=0x7f6ffc0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 -- 172.21.15.100:0/285729945 shutdown_connections 2024-05-09T05:04:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.450+0000 7f7002200640 1 -- 172.21.15.100:0/285729945 wait complete. 2024-05-09T05:04:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.452+0000 7f7002200640 1 Processor -- start 2024-05-09T05:04:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.452+0000 7f7002200640 1 -- start start 2024-05-09T05:04:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7002200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 0x7f6ffc151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7002200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ffc1599d0 0x7f6ffc15b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7002200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ffc15d670 0x7f6ffc0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7002200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc159f30 con 0x7f6ffc06fca0 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7002200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc159db0 con 0x7f6ffc1599d0 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7002200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6ffc0cfbd0 con 0x7f6ffc15d670 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7000e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 0x7f6ffc151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7000e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 0x7f6ffc151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50338/0 (socket says 172.21.15.100:50338) 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.453+0000 7f7000e00640 1 -- 172.21.15.100:0/3428330733 learned_addr learned my addr 172.21.15.100:0/3428330733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f7000e00640 1 -- 172.21.15.100:0/3428330733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ffc15d670 msgr2=0x7f6ffc0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f7000e00640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ffc15d670 0x7f6ffc0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f7000e00640 1 -- 172.21.15.100:0/3428330733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ffc1599d0 msgr2=0x7f6ffc15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f7000e00640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ffc1599d0 0x7f6ffc15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f7000e00640 1 -- 172.21.15.100:0/3428330733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc1f9e40 con 0x7f6ffc06fca0 2024-05-09T05:04:56.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f7000e00640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 0x7f6ffc151090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ff002a220 tx=0x7f6ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0041020 con 0x7f6ffc06fca0 2024-05-09T05:04:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff00306c0 con 0x7f6ffc06fca0 2024-05-09T05:04:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.454+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0037040 con 0x7f6ffc06fca0 2024-05-09T05:04:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.455+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc1f92c0 con 0x7f6ffc06fca0 2024-05-09T05:04:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.455+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc1f9880 con 0x7f6ffc06fca0 2024-05-09T05:04:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.456+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ffc06a550 con 0x7f6ffc06fca0 2024-05-09T05:04:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.457+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ff0044020 con 0x7f6ffc06fca0 2024-05-09T05:04:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.458+0000 7f6ff8c00640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6fe00762d0 0x7f6fe0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.458+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6ff00b7dd0 con 0x7f6ffc06fca0 2024-05-09T05:04:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.458+0000 7f6ffbe00640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6fe00762d0 0x7f6fe0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.459+0000 7f6ffbe00640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6fe00762d0 0x7f6fe0078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc15b4c0 tx=0x7f6fec0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:56.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.463+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ff004b030 con 0x7f6ffc06fca0 2024-05-09T05:04:56.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.681+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ffc0ae910 con 0x7f6ffc06fca0 2024-05-09T05:04:56.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.682+0000 7f6ff8c00640 1 -- 172.21.15.100:0/3428330733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f6ff0081720 con 0x7f6ffc06fca0 2024-05-09T05:04:56.683 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-05-09T05:04:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6fe00762d0 msgr2=0x7f6fe0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:56.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6fe00762d0 0x7f6fe0078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc15b4c0 tx=0x7f6fec0079c0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 msgr2=0x7f6ffc151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 0x7f6ffc151090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ff002a220 tx=0x7f6ff00046c0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 shutdown_connections 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6fe00762d0 0x7f6fe0078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6ffc15d670 0x7f6ffc0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ffc1599d0 0x7f6ffc15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 --2- 172.21.15.100:0/3428330733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ffc06fca0 0x7f6ffc151090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 >> 172.21.15.100:0/3428330733 conn(0x7f6ffc0b29b0 msgr2=0x7f6ffc0cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 shutdown_connections 2024-05-09T05:04:56.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:56.685+0000 7f7002200640 1 -- 172.21.15.100:0/3428330733 wait complete. 2024-05-09T05:04:56.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T05:04:56.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:56.704 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-09T05:04:56.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:04:56.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:56.782 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T05:04:56.840 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:56.841 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:56.900 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:56.900 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:56.951 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:56.951 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:57.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:04:57.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.214+0000 7f1ea1400640 1 Processor -- start 2024-05-09T05:04:57.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.214+0000 7f1ea1400640 1 -- start start 2024-05-09T05:04:57.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1ea1400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e9c06f590 0x7f1e9c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1ea1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e9c0ae350 0x7f1e9c0ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1ea1400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e9c06feb0 con 0x7f1e9c15c640 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1ea1400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9c0cdd30 con 0x7f1e9c0ae350 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1ea1400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9c0ce010 con 0x7f1e9c06f590 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1e93e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1e9c15c640 0x7f1e9c0b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55484/0 (socket says 172.21.15.100:55484) 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1e93e00640 1 -- 172.21.15.100:0/1009173036 learned_addr learned my addr 172.21.15.100:0/1009173036 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:57.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.216+0000 7f1e9b200640 1 --2- 172.21.15.100:0/1009173036 >> v2:172.21.15.100:3300/0 conn(0x7f1e9c0ae350 0x7f1e9c0ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e99e00640 1 -- 172.21.15.100:0/1009173036 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799560814 0 0) 0x7f1e9c06feb0 con 0x7f1e9c15c640 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e9a800640 1 --2- 172.21.15.100:0/1009173036 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c06f590 0x7f1e9c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e99e00640 1 -- 172.21.15.100:0/1009173036 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e80003520 con 0x7f1e9c15c640 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e9b200640 1 -- 172.21.15.100:0/1009173036 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c06f590 msgr2=0x7f1e9c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e9b200640 1 --2- 172.21.15.100:0/1009173036 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c06f590 0x7f1e9c06f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e9b200640 1 -- 172.21.15.100:0/1009173036 >> v1:172.21.15.100:6789/0 conn(0x7f1e9c15c640 legacy=0x7f1e9c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e9b200640 1 -- 172.21.15.100:0/1009173036 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c0ce2f0 con 0x7f1e9c0ae350 2024-05-09T05:04:57.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.217+0000 7f1e9a800640 1 --2- 172.21.15.100:0/1009173036 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c06f590 0x7f1e9c06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:57.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.218+0000 7f1e9b200640 1 --2- 172.21.15.100:0/1009173036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0ae800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c06d8b0 tx=0x7f1e9402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d176e15361ae43fc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.218+0000 7f1e99e00640 1 -- 172.21.15.100:0/1009173036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94007740 con 0x7f1e9c0ae350 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.218+0000 7f1e99e00640 1 -- 172.21.15.100:0/1009173036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e940078e0 con 0x7f1e9c0ae350 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.218+0000 7f1e99e00640 1 -- 172.21.15.100:0/1009173036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94007c90 con 0x7f1e9c0ae350 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 -- 172.21.15.100:0/1009173036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0ae350 msgr2=0x7f1e9c0ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 --2- 172.21.15.100:0/1009173036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0ae800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c06d8b0 tx=0x7f1e9402a5f0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 -- 172.21.15.100:0/1009173036 shutdown_connections 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 --2- 172.21.15.100:0/1009173036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0ae800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 --2- 172.21.15.100:0/1009173036 >> v2:172.21.15.133:3300/0 conn(0x7f1e9c06f590 0x7f1e9c06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 -- 172.21.15.100:0/1009173036 >> 172.21.15.100:0/1009173036 conn(0x7f1e9c0b2c90 msgr2=0x7f1e9c0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 -- 172.21.15.100:0/1009173036 shutdown_connections 2024-05-09T05:04:57.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.219+0000 7f1ea1400640 1 -- 172.21.15.100:0/1009173036 wait complete. 2024-05-09T05:04:57.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.220+0000 7f1ea1400640 1 Processor -- start 2024-05-09T05:04:57.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.221+0000 7f1ea1400640 1 -- start start 2024-05-09T05:04:57.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.221+0000 7f1ea1400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06f590 0x7f1e9c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.221+0000 7f1ea1400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1ea1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 0x7f1e9c0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1ea1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c0cdaf0 con 0x7f1e9c15c640 2024-05-09T05:04:57.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1ea1400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c0cd970 con 0x7f1e9c0ae350 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1ea1400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c0d0660 con 0x7f1e9c06f590 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 0x7f1e9c0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 0x7f1e9c0ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50364/0 (socket says 172.21.15.100:50364) 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 -- 172.21.15.100:0/3186195588 learned_addr learned my addr 172.21.15.100:0/3186195588 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e93e00640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 -- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06f590 msgr2=0x7f1e9c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06f590 0x7f1e9c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 -- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c0ae350 msgr2=0x7f1e9c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 -- 172.21.15.100:0/3186195588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c1f8730 con 0x7f1e9c15c640 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.222+0000 7f1e9b200640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 0x7f1e9c0ae730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009e80 tx=0x7f1e94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.223+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94040070 con 0x7f1e9c15c640 2024-05-09T05:04:57.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.223+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e94031c40 con 0x7f1e9c15c640 2024-05-09T05:04:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.223+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94009450 con 0x7f1e9c15c640 2024-05-09T05:04:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.223+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c1f8a10 con 0x7f1e9c15c640 2024-05-09T05:04:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.223+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c1f8fd0 con 0x7f1e9c15c640 2024-05-09T05:04:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.224+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9c06a630 con 0x7f1e9c15c640 2024-05-09T05:04:57.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.225+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e94039040 con 0x7f1e9c15c640 2024-05-09T05:04:57.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.226+0000 7f1e92a00640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e78076300 0x7f1e780787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.226+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1e940b8820 con 0x7f1e9c15c640 2024-05-09T05:04:57.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.226+0000 7f1e9a800640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e78076300 0x7f1e780787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.227+0000 7f1e9a800640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e78076300 0x7f1e780787c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c006fd0 tx=0x7f1e8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:57.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.231+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1e940820e0 con 0x7f1e9c15c640 2024-05-09T05:04:57.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.446+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1e9c0b16f0 con 0x7f1e9c15c640 2024-05-09T05:04:57.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.447+0000 7f1e92a00640 1 -- 172.21.15.100:0/3186195588 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f1e9408a0d0 con 0x7f1e9c15c640 2024-05-09T05:04:57.448 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-05-09T05:04:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.449+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e78076300 msgr2=0x7f1e780787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.449+0000 7f1ea1400640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e78076300 0x7f1e780787c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c006fd0 tx=0x7f1e8c008040 comp rx=0 tx=0).stop 2024-05-09T05:04:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.449+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 msgr2=0x7f1e9c0ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.449+0000 7f1ea1400640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 0x7f1e9c0ae730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009e80 tx=0x7f1e94004a40 comp rx=0 tx=0).stop 2024-05-09T05:04:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 shutdown_connections 2024-05-09T05:04:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e78076300 0x7f1e780787c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c15c640 0x7f1e9c0ae730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c0ae350 0x7f1e9c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 --2- 172.21.15.100:0/3186195588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e9c06f590 0x7f1e9c154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 >> 172.21.15.100:0/3186195588 conn(0x7f1e9c0b2c90 msgr2=0x7f1e9c0af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 shutdown_connections 2024-05-09T05:04:57.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.450+0000 7f1ea1400640 1 -- 172.21.15.100:0/3186195588 wait complete. 2024-05-09T05:04:57.469 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-09T05:04:57.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:57.469 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-09T05:04:57.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:04:57.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:57.559 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-09T05:04:57.623 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:57.623 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:57.680 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:57.680 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:57.731 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:04:57.732 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:57.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:04:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.987+0000 7fe11f000640 1 Processor -- start 2024-05-09T05:04:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.987+0000 7fe11f000640 1 -- start start 2024-05-09T05:04:57.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe11f000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe11815d5a0 0x7fe118073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe11f000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1180d0110 0x7fe11806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe11f000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe11806e520 con 0x7fe118074490 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe11f000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe11815d980 con 0x7fe11815d5a0 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe11f000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fe1180cf440 con 0x7fe1180d0110 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe117e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe11815d5a0 0x7fe118073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe117e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe11815d5a0 0x7fe118073f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50378/0 (socket says 172.21.15.100:50378) 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe117400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe118074490 0x7fe1180cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55490/0 (socket says 172.21.15.100:55490) 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.989+0000 7fe117e00640 1 -- 172.21.15.100:0/3277588490 learned_addr learned my addr 172.21.15.100:0/3277588490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.990+0000 7fe11d000640 1 --2- 172.21.15.100:0/3277588490 >> v2:172.21.15.133:3300/0 conn(0x7fe1180d0110 0x7fe11806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.990+0000 7fe117e00640 1 -- 172.21.15.100:0/3277588490 >> v2:172.21.15.133:3300/0 conn(0x7fe1180d0110 msgr2=0x7fe11806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:57.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.990+0000 7fe117e00640 1 --2- 172.21.15.100:0/3277588490 >> v2:172.21.15.133:3300/0 conn(0x7fe1180d0110 0x7fe11806ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.990+0000 7fe117e00640 1 -- 172.21.15.100:0/3277588490 >> v1:172.21.15.100:6789/0 conn(0x7fe118074490 legacy=0x7fe1180cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.990+0000 7fe117e00640 1 -- 172.21.15.100:0/3277588490 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1180cf720 con 0x7fe11815d5a0 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.991+0000 7fe117e00640 1 --2- 172.21.15.100:0/3277588490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe118073f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe118160f60 tx=0x7fe10802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0078d233f80c65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.991+0000 7fe116a00640 1 -- 172.21.15.100:0/3277588490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108037070 con 0x7fe11815d5a0 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.991+0000 7fe116a00640 1 -- 172.21.15.100:0/3277588490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe108032440 con 0x7fe11815d5a0 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.991+0000 7fe116a00640 1 -- 172.21.15.100:0/3277588490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe108032810 con 0x7fe11815d5a0 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 -- 172.21.15.100:0/3277588490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 msgr2=0x7fe118073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 --2- 172.21.15.100:0/3277588490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe118073f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe118160f60 tx=0x7fe10802a1e0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 -- 172.21.15.100:0/3277588490 shutdown_connections 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 --2- 172.21.15.100:0/3277588490 >> v2:172.21.15.133:3300/0 conn(0x7fe1180d0110 0x7fe11806ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 --2- 172.21.15.100:0/3277588490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe118073f50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 -- 172.21.15.100:0/3277588490 >> 172.21.15.100:0/3277588490 conn(0x7fe1180b2c90 msgr2=0x7fe1180b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 -- 172.21.15.100:0/3277588490 shutdown_connections 2024-05-09T05:04:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.992+0000 7fe11f000640 1 -- 172.21.15.100:0/3277588490 wait complete. 2024-05-09T05:04:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.994+0000 7fe11f000640 1 Processor -- start 2024-05-09T05:04:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.994+0000 7fe11f000640 1 -- start start 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11f000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe118074490 0x7fe1180b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180d0110 0x7fe11809d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11f000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe1181f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11f000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe11809ede0 con 0x7fe11815d5a0 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe1180d0520 con 0x7fe1180d0110 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11f000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fe11809ef60 con 0x7fe118074490 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe1181f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe1181f82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50388/0 (socket says 172.21.15.100:50388) 2024-05-09T05:04:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.995+0000 7fe11d000640 1 -- 172.21.15.100:0/973087598 learned_addr learned my addr 172.21.15.100:0/973087598 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11d000640 1 -- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe118074490 msgr2=0x7fe1180b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11d000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe118074490 0x7fe1180b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe117400640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180d0110 0x7fe11809d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11d000640 1 -- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180d0110 msgr2=0x7fe11809d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11d000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180d0110 0x7fe11809d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11d000640 1 -- 172.21.15.100:0/973087598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1181f8820 con 0x7fe11815d5a0 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11d000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe1181f82e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe11000cda0 tx=0x7fe11000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110003b90 con 0x7fe11815d5a0 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe110003d30 con 0x7fe11815d5a0 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1180b4fd0 con 0x7fe11815d5a0 2024-05-09T05:04:57.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.996+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110004240 con 0x7fe11815d5a0 2024-05-09T05:04:57.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.997+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1180b5590 con 0x7fe11815d5a0 2024-05-09T05:04:57.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.998+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe11806a630 con 0x7fe11815d5a0 2024-05-09T05:04:57.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:57.999+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe1100043e0 con 0x7fe11815d5a0 2024-05-09T05:04:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.000+0000 7fe10fe00640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe0f80762d0 0x7fe0f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.000+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe110098100 con 0x7fe11815d5a0 2024-05-09T05:04:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.000+0000 7fe117e00640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe0f80762d0 0x7fe0f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.001+0000 7fe117e00640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe0f80762d0 0x7fe0f8078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe108034000 tx=0x7fe10802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:58.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.004+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe1181f8820 con 0x7fe11815d5a0 2024-05-09T05:04:58.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.224+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe1180b1a60 con 0x7fe11815d5a0 2024-05-09T05:04:58.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.225+0000 7fe10fe00640 1 -- 172.21.15.100:0/973087598 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe110061a50 con 0x7fe11815d5a0 2024-05-09T05:04:58.225 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-05-09T05:04:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.227+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe0f80762d0 msgr2=0x7fe0f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.227+0000 7fe11f000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe0f80762d0 0x7fe0f8078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe108034000 tx=0x7fe10802c000 comp rx=0 tx=0).stop 2024-05-09T05:04:58.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.227+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 msgr2=0x7fe1181f82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.227+0000 7fe11f000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe1181f82e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe11000cda0 tx=0x7fe11000a660 comp rx=0 tx=0).stop 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 shutdown_connections 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe0f80762d0 0x7fe0f8078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11815d5a0 0x7fe1181f82e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180d0110 0x7fe11809d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 --2- 172.21.15.100:0/973087598 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe118074490 0x7fe1180b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 >> 172.21.15.100:0/973087598 conn(0x7fe1180b2c90 msgr2=0x7fe1180aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 shutdown_connections 2024-05-09T05:04:58.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.228+0000 7fe11f000640 1 -- 172.21.15.100:0/973087598 wait complete. 2024-05-09T05:04:58.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-09T05:04:58.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:58.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-09T05:04:58.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:04:58.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:58.340 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-09T05:04:58.391 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:58.391 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:58.448 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:58.448 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:58.500 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:04:58.500 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:04:58.551 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:04:58.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.761+0000 7f301ae00640 1 Processor -- start 2024-05-09T05:04:58.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.762+0000 7f301ae00640 1 -- start start 2024-05-09T05:04:58.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f301ae00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f301406f590 0x7f301406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f301ae00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 0x7f30140b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f301ae00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f301406feb0 con 0x7f30140cf2b0 2024-05-09T05:04:58.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f301ae00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f30140cdd30 con 0x7f301406f590 2024-05-09T05:04:58.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f301ae00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f30140ce010 con 0x7f301415c640 2024-05-09T05:04:58.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f3018e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f30140cf2b0 0x7f30140cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55500/0 (socket says 172.21.15.100:55500) 2024-05-09T05:04:58.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.763+0000 7f3018e00640 1 -- 172.21.15.100:0/3625981222 learned_addr learned my addr 172.21.15.100:0/3625981222 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:58.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3013e00640 1 --2- 172.21.15.100:0/3625981222 >> v2:172.21.15.133:3300/0 conn(0x7f301406f590 0x7f301406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3013400640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 0x7f30140b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200751389 0 0) 0x7f301406feb0 con 0x7f30140cf2b0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff8003520 con 0x7f30140cf2b0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 321600203 0 0) 0x7f2ff8003520 con 0x7f30140cf2b0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 msgr2=0x7f30140b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 0x7f30140b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 >> v2:172.21.15.133:3300/0 conn(0x7f301406f590 msgr2=0x7f301406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 --2- 172.21.15.100:0/3625981222 >> v2:172.21.15.133:3300/0 conn(0x7f301406f590 0x7f301406f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30140ce2f0 con 0x7f30140cf2b0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f300c0016f0 con 0x7f30140cf2b0 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 >> v1:172.21.15.100:6789/0 conn(0x7f30140cf2b0 legacy=0x7f30140cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:58.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 0x7f2ff8003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff8004020 0x7f2ff8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff8004d40 0x7f2ff80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30140cdd30 con 0x7f2ff8004d40 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30140ce010 con 0x7f2ff8004020 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.764+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff800dd00 con 0x7f301415c640 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3018e00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff8004d40 0x7f2ff80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3013400640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff8004020 0x7f2ff8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3018e00640 1 -- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 msgr2=0x7f2ff8003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3018e00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f301415c640 0x7f2ff8003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3018e00640 1 -- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff8004020 msgr2=0x7f2ff8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3018e00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ff8004020 0x7f2ff8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.765+0000 7f3018e00640 1 -- 172.21.15.100:0/3625981222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff8003520 con 0x7f2ff8004d40 2024-05-09T05:04:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.766+0000 7f3018e00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff8004d40 0x7f2ff80051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f300c00c190 tx=0x7f2ff8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efc4fa591b1596c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:58.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.766+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c007cc0 con 0x7f2ff8004d40 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.766+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c005ad0 con 0x7f2ff8004d40 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.766+0000 7f3012a00640 1 -- 172.21.15.100:0/3625981222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c007070 con 0x7f2ff8004d40 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f301ae00640 1 -- 172.21.15.100:0/3625981222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff8004d40 msgr2=0x7f2ff80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f301ae00640 1 --2- 172.21.15.100:0/3625981222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ff8004d40 0x7f2ff80051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f300c00c190 tx=0x7f2ff8005830 comp rx=0 tx=0).stop 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f3018e00640 1 -- 172.21.15.100:0/3625981222 reap_dead start 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f301ae00640 1 -- 172.21.15.100:0/3625981222 shutdown_connections 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f301ae00640 1 -- 172.21.15.100:0/3625981222 >> 172.21.15.100:0/3625981222 conn(0x7f30140b2c90 msgr2=0x7f30140b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f301ae00640 1 -- 172.21.15.100:0/3625981222 shutdown_connections 2024-05-09T05:04:58.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.767+0000 7f301ae00640 1 -- 172.21.15.100:0/3625981222 wait complete. 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.769+0000 7f301ae00640 1 Processor -- start 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.769+0000 7f301ae00640 1 -- start start 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f301ae00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff8004d40 0x7f3014154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f301ae00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f301415ac70 0x7f301415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f301ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 0x7f3014073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f301ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30140cdaf0 con 0x7f3014072f00 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f301ae00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f30140cd970 con 0x7f301415ac70 2024-05-09T05:04:58.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f301ae00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f30140d0660 con 0x7f2ff8004d40 2024-05-09T05:04:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f3018e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 0x7f3014073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f3018e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 0x7f3014073380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50414/0 (socket says 172.21.15.100:50414) 2024-05-09T05:04:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.770+0000 7f3018e00640 1 -- 172.21.15.100:0/2552006162 learned_addr learned my addr 172.21.15.100:0/2552006162 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3013e00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff8004d40 0x7f3014154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3013400640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f301415ac70 0x7f301415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3018e00640 1 -- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff8004d40 msgr2=0x7f3014154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3018e00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff8004d40 0x7f3014154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3018e00640 1 -- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f301415ac70 msgr2=0x7f301415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3018e00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f301415ac70 0x7f301415b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3018e00640 1 -- 172.21.15.100:0/2552006162 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301415cb20 con 0x7f3014072f00 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f3018e00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 0x7f3014073380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f300c02ac70 tx=0x7f300c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c037040 con 0x7f3014072f00 2024-05-09T05:04:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c041070 con 0x7f3014072f00 2024-05-09T05:04:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c0016f0 con 0x7f3014072f00 2024-05-09T05:04:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.771+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301415ce00 con 0x7f3014072f00 2024-05-09T05:04:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.772+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f301415d3c0 con 0x7f3014072f00 2024-05-09T05:04:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.773+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301415d6f0 con 0x7f3014072f00 2024-05-09T05:04:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.774+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f300c0072b0 con 0x7f3014072f00 2024-05-09T05:04:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.775+0000 7f300be00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ff40762d0 0x7f2ff4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.775+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f300c0b7670 con 0x7f3014072f00 2024-05-09T05:04:58.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.775+0000 7f3013e00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ff40762d0 0x7f2ff4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:58.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.776+0000 7f3013e00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ff40762d0 0x7f2ff4078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3004004b30 tx=0x7f300400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:58.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.780+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f300c080f30 con 0x7f3014072f00 2024-05-09T05:04:59.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:58.999+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f301406a630 con 0x7f3014072f00 2024-05-09T05:04:59.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.000+0000 7f300be00640 1 -- 172.21.15.100:0/2552006162 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f300c080830 con 0x7f3014072f00 2024-05-09T05:04:59.001 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-05-09T05:04:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ff40762d0 msgr2=0x7f2ff4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ff40762d0 0x7f2ff4078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3004004b30 tx=0x7f300400b040 comp rx=0 tx=0).stop 2024-05-09T05:04:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 msgr2=0x7f3014073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 0x7f3014073380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f300c02ac70 tx=0x7f300c001930 comp rx=0 tx=0).stop 2024-05-09T05:04:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 shutdown_connections 2024-05-09T05:04:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ff40762d0 0x7f2ff4078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3014072f00 0x7f3014073380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f301415ac70 0x7f301415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 --2- 172.21.15.100:0/2552006162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ff8004d40 0x7f3014154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 >> 172.21.15.100:0/2552006162 conn(0x7f30140b2c90 msgr2=0x7f30140ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.003+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 shutdown_connections 2024-05-09T05:04:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.004+0000 7f301ae00640 1 -- 172.21.15.100:0/2552006162 wait complete. 2024-05-09T05:04:59.024 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-09T05:04:59.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:59.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-09T05:04:59.117 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:04:59.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:04:59.117 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-09T05:04:59.170 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-09T05:04:59.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:59.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.381+0000 7fc2e2200640 1 Processor -- start 2024-05-09T05:04:59.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.381+0000 7fc2e2200640 1 -- start start 2024-05-09T05:04:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.382+0000 7fc2e2200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 0x7fc2dc15e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.382+0000 7fc2e2200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc15e780 con 0x7fc2dc0ade90 2024-05-09T05:04:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.382+0000 7fc2e2200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc0ae3a0 con 0x7fc2dc0afb70 2024-05-09T05:04:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.382+0000 7fc2e2200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc0b4590 con 0x7fc2dc0d0a70 2024-05-09T05:04:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.383+0000 7fc2daa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc2dc0ade90 0x7fc2dc0b5070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55510/0 (socket says 172.21.15.100:55510) 2024-05-09T05:04:59.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.383+0000 7fc2daa00640 1 -- 172.21.15.100:0/1064323881 learned_addr learned my addr 172.21.15.100:0/1064323881 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:59.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.383+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842049907 0 0) 0x7fc2c8001110 con 0x7fc2dc0ade90 2024-05-09T05:04:59.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.383+0000 7fc2db400640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 0x7fc2dc15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.383+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2c0003520 con 0x7fc2dc0ade90 2024-05-09T05:04:59.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 613956573 0 0) 0x7fc2c0003520 con 0x7fc2dc0ade90 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 msgr2=0x7fc2dc15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 0x7fc2dc15e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 >> v1:172.21.15.133:6789/0 conn(0x7fc2dc0afb70 legacy=0x7fc2dc0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc0b4870 con 0x7fc2dc0ade90 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fc2c80018c0 con 0x7fc2dc0ade90 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 >> v1:172.21.15.100:6789/0 conn(0x7fc2dc0ade90 legacy=0x7fc2dc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c0003a80 0x7fc2c0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 0x7fc2c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc0b4590 con 0x7fc2c0004e60 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c00054f0 con 0x7fc2c0003a80 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c000bf00 con 0x7fc2dc0d0a70 2024-05-09T05:04:59.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2dbe00640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2daa00640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 0x7fc2c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.384+0000 7fc2db400640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c0003a80 0x7fc2c0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.385+0000 7fc2dbe00640 1 -- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 msgr2=0x7fc2c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.385+0000 7fc2dbe00640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc0d0a70 0x7fc2c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.385+0000 7fc2dbe00640 1 -- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c0003a80 msgr2=0x7fc2c0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.385+0000 7fc2dbe00640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c0003a80 0x7fc2c0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.385+0000 7fc2dbe00640 1 -- 172.21.15.100:0/1064323881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c0003520 con 0x7fc2c0004e60 2024-05-09T05:04:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.385+0000 7fc2db400640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2c0003a80 0x7fc2c0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2dbe00640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2c000b9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4001790 tx=0x7fc2c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0022f7b3f0cc27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40013b0 con 0x7fc2c0004e60 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d40052d0 con 0x7fc2c0004e60 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2da000640 1 -- 172.21.15.100:0/1064323881 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d402aaa0 con 0x7fc2c0004e60 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2e2200640 1 -- 172.21.15.100:0/1064323881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 msgr2=0x7fc2c000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1064323881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2c000b9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4001790 tx=0x7fc2c0005830 comp rx=0 tx=0).stop 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.386+0000 7fc2dbe00640 1 -- 172.21.15.100:0/1064323881 reap_dead start 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.387+0000 7fc2e2200640 1 -- 172.21.15.100:0/1064323881 shutdown_connections 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.387+0000 7fc2e2200640 1 -- 172.21.15.100:0/1064323881 >> 172.21.15.100:0/1064323881 conn(0x7fc2dc0b31e0 msgr2=0x7fc2dc0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:59.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.387+0000 7fc2e2200640 1 -- 172.21.15.100:0/1064323881 shutdown_connections 2024-05-09T05:04:59.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.387+0000 7fc2e2200640 1 -- 172.21.15.100:0/1064323881 wait complete. 2024-05-09T05:04:59.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.388+0000 7fc2e2200640 1 Processor -- start 2024-05-09T05:04:59.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.389+0000 7fc2e2200640 1 -- start start 2024-05-09T05:04:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.389+0000 7fc2e2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2dc146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.389+0000 7fc2e2200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2dc09ba50 0x7fc2dc09c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2e2200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc09beb0 0x7fc2dc09c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2e2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc15e240 con 0x7fc2c0004e60 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2e2200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc0ae680 con 0x7fc2dc09ba50 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2e2200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc15e3c0 con 0x7fc2dc09beb0 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2dc146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2dc146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50428/0 (socket says 172.21.15.100:50428) 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 -- 172.21.15.100:0/1479172506 learned_addr learned my addr 172.21.15.100:0/1479172506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 -- 172.21.15.100:0/1479172506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc09beb0 msgr2=0x7fc2dc09c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc09beb0 0x7fc2dc09c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 -- 172.21.15.100:0/1479172506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2dc09ba50 msgr2=0x7fc2dc09c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2dc09ba50 0x7fc2dc09c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.390+0000 7fc2db400640 1 -- 172.21.15.100:0/1479172506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc1471d0 con 0x7fc2c0004e60 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.391+0000 7fc2db400640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2dc146910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009fd0 tx=0x7fc2cc00f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.391+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc018020 con 0x7fc2c0004e60 2024-05-09T05:04:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.391+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc014610 con 0x7fc2c0004e60 2024-05-09T05:04:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.391+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc1474b0 con 0x7fc2c0004e60 2024-05-09T05:04:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.391+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc014a00 con 0x7fc2c0004e60 2024-05-09T05:04:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.391+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc147a70 con 0x7fc2c0004e60 2024-05-09T05:04:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.392+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc076070 con 0x7fc2c0004e60 2024-05-09T05:04:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.393+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc2cc01b020 con 0x7fc2c0004e60 2024-05-09T05:04:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.394+0000 7fc2d3400640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc2bc0762d0 0x7fc2bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.394+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc2cc097fe0 con 0x7fc2c0004e60 2024-05-09T05:04:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.394+0000 7fc2daa00640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc2bc0762d0 0x7fc2bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.395+0000 7fc2daa00640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc2bc0762d0 0x7fc2bc078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8001330 tx=0x7fc2c8000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:59.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.401+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc2cc022030 con 0x7fc2c0004e60 2024-05-09T05:04:59.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.647+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2dc06a5c0 con 0x7fc2c0004e60 2024-05-09T05:04:59.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.648+0000 7fc2d3400640 1 -- 172.21.15.100:0/1479172506 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fc2cc061830 con 0x7fc2c0004e60 2024-05-09T05:04:59.649 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:04:59.649 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:04:59.649 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc2bc0762d0 msgr2=0x7fc2bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc2bc0762d0 0x7fc2bc078790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8001330 tx=0x7fc2c8000f50 comp rx=0 tx=0).stop 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 msgr2=0x7fc2dc146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2dc146910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009fd0 tx=0x7fc2cc00f5e0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 shutdown_connections 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc2bc0762d0 0x7fc2bc078790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc2dc09beb0 0x7fc2dc09c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2dc09ba50 0x7fc2dc09c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 --2- 172.21.15.100:0/1479172506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2c0004e60 0x7fc2dc146910 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 >> 172.21.15.100:0/1479172506 conn(0x7fc2dc0b31e0 msgr2=0x7fc2dc15eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:59.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 shutdown_connections 2024-05-09T05:04:59.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.651+0000 7fc2e2200640 1 -- 172.21.15.100:0/1479172506 wait complete. 2024-05-09T05:04:59.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:04:59.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.871+0000 7fcba2200640 1 Processor -- start 2024-05-09T05:04:59.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.871+0000 7fcba2200640 1 -- start start 2024-05-09T05:04:59.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcba2200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb9c0d4e40 0x7fcb9c0d2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcba2200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcb9c0d27b0 0x7fcb9c0b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcba2200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9c0d3da0 con 0x7fcb9c15f420 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcba2200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c0d4080 con 0x7fcb9c0d27b0 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcba2200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c0d4360 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcb9b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcb9c15f420 0x7fcb9c0d33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55524/0 (socket says 172.21.15.100:55524) 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcb9b400640 1 -- 172.21.15.100:0/2333888721 learned_addr learned my addr 172.21.15.100:0/2333888721 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:04:59.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcb9be00640 1 --2- 172.21.15.100:0/2333888721 >> v2:172.21.15.100:3300/0 conn(0x7fcb9c0d27b0 0x7fcb9c0b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcb9aa00640 1 --2- 172.21.15.100:0/2333888721 >> v2:172.21.15.133:3300/0 conn(0x7fcb9c0d4e40 0x7fcb9c0d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcb9be00640 1 -- 172.21.15.100:0/2333888721 >> v2:172.21.15.133:3300/0 conn(0x7fcb9c0d4e40 msgr2=0x7fcb9c0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:04:59.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.873+0000 7fcb9be00640 1 --2- 172.21.15.100:0/2333888721 >> v2:172.21.15.133:3300/0 conn(0x7fcb9c0d4e40 0x7fcb9c0d2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.874+0000 7fcb9be00640 1 -- 172.21.15.100:0/2333888721 >> v1:172.21.15.100:6789/0 conn(0x7fcb9c15f420 legacy=0x7fcb9c0d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.874+0000 7fcb9be00640 1 -- 172.21.15.100:0/2333888721 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c0d4640 con 0x7fcb9c0d27b0 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.874+0000 7fcb9a000640 1 -- 172.21.15.100:0/2333888721 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800373866 0 0) 0x7fcb9c0d3da0 con 0x7fcb9c15f420 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcb9be00640 1 --2- 172.21.15.100:0/2333888721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d27b0 0x7fcb9c0b8440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0d1a40 tx=0x7fcb9402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ec7bde79c16134 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcb9a000640 1 -- 172.21.15.100:0/2333888721 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007740 con 0x7fcb9c0d27b0 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcb9a000640 1 -- 172.21.15.100:0/2333888721 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb940078e0 con 0x7fcb9c0d27b0 2024-05-09T05:04:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcb9a000640 1 -- 172.21.15.100:0/2333888721 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007cb0 con 0x7fcb9c0d27b0 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcba2200640 1 -- 172.21.15.100:0/2333888721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d27b0 msgr2=0x7fcb9c0b8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcba2200640 1 --2- 172.21.15.100:0/2333888721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d27b0 0x7fcb9c0b8440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0d1a40 tx=0x7fcb9402a5f0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcba2200640 1 -- 172.21.15.100:0/2333888721 shutdown_connections 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcba2200640 1 --2- 172.21.15.100:0/2333888721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d27b0 0x7fcb9c0b8440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcba2200640 1 --2- 172.21.15.100:0/2333888721 >> v2:172.21.15.133:3300/0 conn(0x7fcb9c0d4e40 0x7fcb9c0d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.875+0000 7fcba2200640 1 -- 172.21.15.100:0/2333888721 >> 172.21.15.100:0/2333888721 conn(0x7fcb9c073f20 msgr2=0x7fcb9c074330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.876+0000 7fcba2200640 1 -- 172.21.15.100:0/2333888721 shutdown_connections 2024-05-09T05:04:59.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.876+0000 7fcba2200640 1 -- 172.21.15.100:0/2333888721 wait complete. 2024-05-09T05:04:59.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.877+0000 7fcba2200640 1 Processor -- start 2024-05-09T05:04:59.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.877+0000 7fcba2200640 1 -- start start 2024-05-09T05:04:59.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcba2200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c0d27b0 0x7fcb9c158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcba2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 0x7fcb9c1f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcba2200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c15f420 0x7fcb9c15b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcba2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c15f800 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcba2200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0d3ac0 con 0x7fcb9c15f420 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcba2200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c1591b0 con 0x7fcb9c0d27b0 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.878+0000 7fcb9aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 0x7fcb9c1f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 0x7fcb9c1f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50442/0 (socket says 172.21.15.100:50442) 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 -- 172.21.15.100:0/950273956 learned_addr learned my addr 172.21.15.100:0/950273956 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9be00640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c15f420 0x7fcb9c15b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9b400640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c0d27b0 0x7fcb9c158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 -- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c0d27b0 msgr2=0x7fcb9c158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c0d27b0 0x7fcb9c158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 -- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c15f420 msgr2=0x7fcb9c15b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c15f420 0x7fcb9c15b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:04:59.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 -- 172.21.15.100:0/950273956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c15bef0 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.879+0000 7fcb9aa00640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 0x7fcb9c1f6030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800c7f0 tx=0x7fcb8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.880+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88015070 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.880+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb88004220 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.880+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c159400 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.880+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb88007620 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.880+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c1599c0 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.881+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c06a5c0 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.882+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb880079d0 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.883+0000 7fcb93400640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb7c0762d0 0x7fcb7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:04:59.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.883+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcb88097a10 con 0x7fcb9c0d4e40 2024-05-09T05:04:59.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.884+0000 7fcb9b400640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb7c0762d0 0x7fcb7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:04:59.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.884+0000 7fcb9b400640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb7c0762d0 0x7fcb7c078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c000f60 tx=0x7fcb8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:04:59.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:04:59.887+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcb88061360 con 0x7fcb9c0d4e40 2024-05-09T05:05:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.131+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb9c074680 con 0x7fcb9c0d4e40 2024-05-09T05:05:00.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.133+0000 7fcb93400640 1 -- 172.21.15.100:0/950273956 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fcb88069350 con 0x7fcb9c0d4e40 2024-05-09T05:05:00.134 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:00.134 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:05:00.134 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:05:00.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.135+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb7c0762d0 msgr2=0x7fcb7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.135+0000 7fcba2200640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb7c0762d0 0x7fcb7c078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c000f60 tx=0x7fcb8c009040 comp rx=0 tx=0).stop 2024-05-09T05:05:00.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.135+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 msgr2=0x7fcb9c1f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.135+0000 7fcba2200640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 0x7fcb9c1f6030 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800c7f0 tx=0x7fcb8800ccb0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 shutdown_connections 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb7c0762d0 0x7fcb7c078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb9c15f420 0x7fcb9c15b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9c0d4e40 0x7fcb9c1f6030 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 --2- 172.21.15.100:0/950273956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb9c0d27b0 0x7fcb9c158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 >> 172.21.15.100:0/950273956 conn(0x7fcb9c073f20 msgr2=0x7fcb9c0c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 shutdown_connections 2024-05-09T05:05:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.136+0000 7fcba2200640 1 -- 172.21.15.100:0/950273956 wait complete. 2024-05-09T05:05:00.154 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.337+0000 7fb7ffe00640 1 Processor -- start 2024-05-09T05:05:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.337+0000 7fb7ffe00640 1 -- start start 2024-05-09T05:05:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.338+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800143710 0x7fb800161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.338+0000 7fb7ffe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8000ce330 0x7fb80015db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.338+0000 7fb7ffe00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb800143af0 con 0x7fb80015d6c0 2024-05-09T05:05:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.338+0000 7fb7ffe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb800160ce0 con 0x7fb8000ce330 2024-05-09T05:05:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.338+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb800161c70 con 0x7fb800143710 2024-05-09T05:05:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8000ce330 0x7fb80015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8000ce330 0x7fb80015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50452/0 (socket says 172.21.15.100:50452) 2024-05-09T05:05:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 -- 172.21.15.100:0/3303922945 learned_addr learned my addr 172.21.15.100:0/3303922945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7fea00640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800143710 0x7fb800161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 -- 172.21.15.100:0/3303922945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800143710 msgr2=0x7fb800161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800143710 0x7fb800161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 -- 172.21.15.100:0/3303922945 >> v1:172.21.15.133:6789/0 conn(0x7fb80015d6c0 legacy=0x7fb8000cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7ff400640 1 -- 172.21.15.100:0/3303922945 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80015e240 con 0x7fb8000ce330 2024-05-09T05:05:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.339+0000 7fb7fea00640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800143710 0x7fb800161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.340+0000 7fb7ff400640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8000ce330 0x7fb80015db20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb800146fd0 tx=0x7fb7f802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2976ed7bd81a8e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7fe000640 1 -- 172.21.15.100:0/3303922945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8036070 con 0x7fb8000ce330 2024-05-09T05:05:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7fe000640 1 -- 172.21.15.100:0/3303922945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8031600 con 0x7fb8000ce330 2024-05-09T05:05:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7fe000640 1 -- 172.21.15.100:0/3303922945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80319d0 con 0x7fb8000ce330 2024-05-09T05:05:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3303922945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8000ce330 msgr2=0x7fb80015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8000ce330 0x7fb80015db20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb800146fd0 tx=0x7fb7f802a5b0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3303922945 shutdown_connections 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8000ce330 0x7fb80015db20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/3303922945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb800143710 0x7fb800161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3303922945 >> 172.21.15.100:0/3303922945 conn(0x7fb80006c7f0 msgr2=0x7fb80006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3303922945 shutdown_connections 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.341+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3303922945 wait complete. 2024-05-09T05:05:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.343+0000 7fb7ffe00640 1 Processor -- start 2024-05-09T05:05:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.343+0000 7fb7ffe00640 1 -- start start 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8000ce330 0x7fb800146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800143710 0x7fb80013a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 0x7fb80015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb800161210 con 0x7fb80015d6c0 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb800160f30 con 0x7fb800143710 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ffe00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb800072490 con 0x7fb8000ce330 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 0x7fb80015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 0x7fb80015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50454/0 (socket says 172.21.15.100:50454) 2024-05-09T05:05:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.344+0000 7fb7ff400640 1 -- 172.21.15.100:0/734153281 learned_addr learned my addr 172.21.15.100:0/734153281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7fea00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8000ce330 0x7fb800146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ff400640 1 -- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8000ce330 msgr2=0x7fb800146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ff400640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8000ce330 0x7fb800146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7f7e00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800143710 0x7fb80013a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ff400640 1 -- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800143710 msgr2=0x7fb80013a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ff400640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800143710 0x7fb80013a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ff400640 1 -- 172.21.15.100:0/734153281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8001f5dd0 con 0x7fb80015d6c0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ff400640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 0x7fb80015f570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7f802aba0 tx=0x7fb7f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8041020 con 0x7fb80015d6c0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8008710 con 0x7fb80015d6c0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8036040 con 0x7fb80015d6c0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.345+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb800143ed0 con 0x7fb80015d6c0 2024-05-09T05:05:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.346+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb800144490 con 0x7fb80015d6c0 2024-05-09T05:05:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.347+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80006a550 con 0x7fb80015d6c0 2024-05-09T05:05:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.348+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb7f8044020 con 0x7fb80015d6c0 2024-05-09T05:05:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.349+0000 7fb7f6a00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7dc0762d0 0x7fb7dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.349+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7f80b8650 con 0x7fb80015d6c0 2024-05-09T05:05:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.349+0000 7fb7fea00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7dc0762d0 0x7fb7dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.350+0000 7fb7fea00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7dc0762d0 0x7fb7dc078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0008850 tx=0x7fb7f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:00.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.353+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb7f804b020 con 0x7fb80015d6c0 2024-05-09T05:05:00.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.559+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb80006fc30 con 0x7fb80015d6c0 2024-05-09T05:05:00.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.561+0000 7fb7f6a00640 1 -- 172.21.15.100:0/734153281 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7fb7f8082040 con 0x7fb80015d6c0 2024-05-09T05:05:00.562 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:00.562 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7dc0762d0 msgr2=0x7fb7dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7dc0762d0 0x7fb7dc078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0008850 tx=0x7fb7f0008040 comp rx=0 tx=0).stop 2024-05-09T05:05:00.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 msgr2=0x7fb80015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 0x7fb80015f570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7f802aba0 tx=0x7fb7f8004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 shutdown_connections 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7dc0762d0 0x7fb7dc078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb80015d6c0 0x7fb80015f570 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800143710 0x7fb80013a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/734153281 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8000ce330 0x7fb800146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 >> 172.21.15.100:0/734153281 conn(0x7fb80006c7f0 msgr2=0x7fb80006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 shutdown_connections 2024-05-09T05:05:00.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.564+0000 7fb7ffe00640 1 -- 172.21.15.100:0/734153281 wait complete. 2024-05-09T05:05:00.584 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T05:05:00.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.782+0000 7f352f200640 1 Processor -- start 2024-05-09T05:05:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.782+0000 7f352f200640 1 -- start start 2024-05-09T05:05:00.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f35300d3660 0x7f35300d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35300d2f80 con 0x7f35300d1a10 2024-05-09T05:05:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352f200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35300b51e0 con 0x7f35300b4530 2024-05-09T05:05:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f35300d4010 con 0x7f35300d3660 2024-05-09T05:05:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f35300d3660 0x7f35300d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f35300d3660 0x7f35300d3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50466/0 (socket says 172.21.15.100:50466) 2024-05-09T05:05:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352d400640 1 -- 172.21.15.100:0/273027807 learned_addr learned my addr 172.21.15.100:0/273027807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.784+0000 7f352e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f35300d1a10 0x7f35300d1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55536/0 (socket says 172.21.15.100:55536) 2024-05-09T05:05:00.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.785+0000 7f352d400640 1 -- 172.21.15.100:0/273027807 >> v1:172.21.15.133:6789/0 conn(0x7f35300b4530 legacy=0x7f35300b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:00.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.785+0000 7f352d400640 1 -- 172.21.15.100:0/273027807 >> v1:172.21.15.100:6789/0 conn(0x7f35300d1a10 legacy=0x7f35300d1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.785+0000 7f352ca00640 1 -- 172.21.15.100:0/273027807 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873055075 0 0) 0x7f35300d2f80 con 0x7f35300d1a10 2024-05-09T05:05:00.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.785+0000 7f352d400640 1 -- 172.21.15.100:0/273027807 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35300d25f0 con 0x7f35300d3660 2024-05-09T05:05:00.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.786+0000 7f352d400640 1 --2- 172.21.15.100:0/273027807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300d3660 0x7f35300d3ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f351c009870 tx=0x7f351c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbd69a3d9d03a16 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:00.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.786+0000 7f352ca00640 1 -- 172.21.15.100:0/273027807 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c037070 con 0x7f35300d3660 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.786+0000 7f352ca00640 1 -- 172.21.15.100:0/273027807 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f351c032440 con 0x7f35300d3660 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.786+0000 7f352ca00640 1 -- 172.21.15.100:0/273027807 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c032810 con 0x7f35300d3660 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.786+0000 7f352f200640 1 -- 172.21.15.100:0/273027807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300d3660 msgr2=0x7f35300d3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.786+0000 7f352f200640 1 --2- 172.21.15.100:0/273027807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300d3660 0x7f35300d3ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f351c009870 tx=0x7f351c02a270 comp rx=0 tx=0).stop 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.787+0000 7f352f200640 1 -- 172.21.15.100:0/273027807 shutdown_connections 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.787+0000 7f352f200640 1 --2- 172.21.15.100:0/273027807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300d3660 0x7f35300d3ad0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.787+0000 7f352f200640 1 -- 172.21.15.100:0/273027807 >> 172.21.15.100:0/273027807 conn(0x7f353008eb30 msgr2=0x7f353009e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.787+0000 7f352f200640 1 -- 172.21.15.100:0/273027807 shutdown_connections 2024-05-09T05:05:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.787+0000 7f352f200640 1 -- 172.21.15.100:0/273027807 wait complete. 2024-05-09T05:05:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.788+0000 7f352f200640 1 Processor -- start 2024-05-09T05:05:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.788+0000 7f352f200640 1 -- start start 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.789+0000 7f352f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 0x7f35300ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.789+0000 7f352f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35300d1a10 0x7f35300b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.789+0000 7f352f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35300d3660 0x7f3530154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.789+0000 7f352f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f35300d28d0 con 0x7f35300b4530 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.789+0000 7f352f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f35300b5730 con 0x7f35300d1a10 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.789+0000 7f352f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f35300b4910 con 0x7f35300d3660 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 0x7f35300ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 0x7f35300ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50474/0 (socket says 172.21.15.100:50474) 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 -- 172.21.15.100:0/2740168633 learned_addr learned my addr 172.21.15.100:0/2740168633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 -- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35300d3660 msgr2=0x7f3530154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35300d3660 0x7f3530154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352d400640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35300d1a10 0x7f35300b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 -- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35300d1a10 msgr2=0x7f35300b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35300d1a10 0x7f35300b9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.790+0000 7f352de00640 1 -- 172.21.15.100:0/2740168633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35300b7d10 con 0x7f35300b4530 2024-05-09T05:05:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.791+0000 7f352de00640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 0x7f35300ce770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f352000c430 tx=0x7f352000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.791+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520011790 con 0x7f35300b4530 2024-05-09T05:05:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.791+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520017070 con 0x7f35300b4530 2024-05-09T05:05:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.791+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520011b70 con 0x7f35300b4530 2024-05-09T05:05:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.791+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35300b7ff0 con 0x7f35300b4530 2024-05-09T05:05:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.791+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35300b85b0 con 0x7f35300b4530 2024-05-09T05:05:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.792+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353006a550 con 0x7f35300b4530 2024-05-09T05:05:00.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.793+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3520011d10 con 0x7f35300b4530 2024-05-09T05:05:00.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.794+0000 7f3526000640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f35100762d0 0x7f3510078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:00.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.794+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35200974f0 con 0x7f35300b4530 2024-05-09T05:05:00.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.795+0000 7f352d400640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f35100762d0 0x7f3510078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:00.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.795+0000 7f352d400640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f35100762d0 0x7f3510078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f351c034000 tx=0x7f351c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:00.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:00.799+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3520060db0 con 0x7f35300b4530 2024-05-09T05:05:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.032+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35300b4bd0 con 0x7f35300b4530 2024-05-09T05:05:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.033+0000 7f3526000640 1 -- 172.21.15.100:0/2740168633 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7f35200606b0 con 0x7f35300b4530 2024-05-09T05:05:01.034 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:01.034 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:05:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f35100762d0 msgr2=0x7f3510078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f35100762d0 0x7f3510078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f351c034000 tx=0x7f351c02e000 comp rx=0 tx=0).stop 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 msgr2=0x7f35300ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 0x7f35300ce770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f352000c430 tx=0x7f352000c8f0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 shutdown_connections 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f35100762d0 0x7f3510078790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35300d3660 0x7f3530154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35300d1a10 0x7f35300b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 --2- 172.21.15.100:0/2740168633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300b4530 0x7f35300ce770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 >> 172.21.15.100:0/2740168633 conn(0x7f353008eb30 msgr2=0x7f35300b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.036+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 shutdown_connections 2024-05-09T05:05:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.037+0000 7f352f200640 1 -- 172.21.15.100:0/2740168633 wait complete. 2024-05-09T05:05:01.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.244+0000 7fcbf4400640 1 Processor -- start 2024-05-09T05:05:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.244+0000 7fcbf4400640 1 -- start start 2024-05-09T05:05:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.245+0000 7fcbf4400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbec145900 0x7fcbec073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.245+0000 7fcbf4400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 0x7fcbec06f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.245+0000 7fcbf4400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec06ead0 con 0x7fcbec0739a0 2024-05-09T05:05:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.245+0000 7fcbf4400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fcbec06f390 con 0x7fcbec145900 2024-05-09T05:05:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.245+0000 7fcbf4400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec06ed40 con 0x7fcbec0b45c0 2024-05-09T05:05:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.246+0000 7fcbf2400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 0x7fcbec06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.246+0000 7fcbf2400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 0x7fcbec06f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:60064/0 (socket says 172.21.15.100:60064) 2024-05-09T05:05:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.246+0000 7fcbf2400640 1 -- 172.21.15.100:0/2665470456 learned_addr learned my addr 172.21.15.100:0/2665470456 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.246+0000 7fcbf1a00640 1 --2- 172.21.15.100:0/2665470456 >> v2:172.21.15.133:3300/0 conn(0x7fcbec145900 0x7fcbec073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.247+0000 7fcbf2400640 1 -- 172.21.15.100:0/2665470456 >> v2:172.21.15.133:3300/0 conn(0x7fcbec145900 msgr2=0x7fcbec073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:01.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.247+0000 7fcbf2400640 1 --2- 172.21.15.100:0/2665470456 >> v2:172.21.15.133:3300/0 conn(0x7fcbec145900 0x7fcbec073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.247+0000 7fcbf2400640 1 -- 172.21.15.100:0/2665470456 >> v1:172.21.15.133:6789/0 conn(0x7fcbec0739a0 legacy=0x7fcbec0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.247+0000 7fcbf2400640 1 -- 172.21.15.100:0/2665470456 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec06f020 con 0x7fcbec0b45c0 2024-05-09T05:05:01.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.248+0000 7fcbf2400640 1 --2- 172.21.15.100:0/2665470456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 0x7fcbec06f820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009870 tx=0x7fcbe402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=995942ee810fcd48 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:01.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.249+0000 7fcbebe00640 1 -- 172.21.15.100:0/2665470456 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4037070 con 0x7fcbec0b45c0 2024-05-09T05:05:01.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.249+0000 7fcbebe00640 1 -- 172.21.15.100:0/2665470456 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe4032440 con 0x7fcbec0b45c0 2024-05-09T05:05:01.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.249+0000 7fcbebe00640 1 -- 172.21.15.100:0/2665470456 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4032810 con 0x7fcbec0b45c0 2024-05-09T05:05:01.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 -- 172.21.15.100:0/2665470456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 msgr2=0x7fcbec06f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 --2- 172.21.15.100:0/2665470456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 0x7fcbec06f820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009870 tx=0x7fcbe402a270 comp rx=0 tx=0).stop 2024-05-09T05:05:01.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 -- 172.21.15.100:0/2665470456 shutdown_connections 2024-05-09T05:05:01.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 --2- 172.21.15.100:0/2665470456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec0b45c0 0x7fcbec06f820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 --2- 172.21.15.100:0/2665470456 >> v2:172.21.15.133:3300/0 conn(0x7fcbec145900 0x7fcbec073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 -- 172.21.15.100:0/2665470456 >> 172.21.15.100:0/2665470456 conn(0x7fcbec0b31e0 msgr2=0x7fcbec0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:01.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 -- 172.21.15.100:0/2665470456 shutdown_connections 2024-05-09T05:05:01.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.250+0000 7fcbf4400640 1 -- 172.21.15.100:0/2665470456 wait complete. 2024-05-09T05:05:01.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.251+0000 7fcbf4400640 1 Processor -- start 2024-05-09T05:05:01.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 -- start start 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbec0739a0 0x7fcbec138a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 0x7fcbec15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec145900 0x7fcbec09ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec145ce0 con 0x7fcbec0b45c0 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0ade90 con 0x7fcbec0739a0 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.252+0000 7fcbf4400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec145e60 con 0x7fcbec145900 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 0x7fcbec15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 0x7fcbec15ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50482/0 (socket says 172.21.15.100:50482) 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 -- 172.21.15.100:0/3521783575 learned_addr learned my addr 172.21.15.100:0/3521783575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1a00640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbec0739a0 0x7fcbec138a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf2400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec145900 0x7fcbec09ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 -- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec145900 msgr2=0x7fcbec09ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec145900 0x7fcbec09ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 -- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbec0739a0 msgr2=0x7fcbec138a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbec0739a0 0x7fcbec138a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 -- 172.21.15.100:0/3521783575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec09dc20 con 0x7fcbec0b45c0 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf2400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec145900 0x7fcbec09ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:01.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.253+0000 7fcbf1000640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 0x7fcbec15ed30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800c420 tx=0x7fcbd800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.254+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8017070 con 0x7fcbec0b45c0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.254+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd80052d0 con 0x7fcbec0b45c0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.254+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8003830 con 0x7fcbec0b45c0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.254+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec09df00 con 0x7fcbec0b45c0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.254+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec09c630 con 0x7fcbec0b45c0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.255+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec076070 con 0x7fcbec0b45c0 2024-05-09T05:05:01.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.256+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcbd801a070 con 0x7fcbec0b45c0 2024-05-09T05:05:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.258+0000 7fcbe9600640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcbcc0762d0 0x7fcbcc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.258+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcbd80968d0 con 0x7fcbec0b45c0 2024-05-09T05:05:01.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.258+0000 7fcbf1a00640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcbcc0762d0 0x7fcbcc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.258+0000 7fcbf1a00640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcbcc0762d0 0x7fcbcc078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00073f0 tx=0x7fcbe000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:01.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.262+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcbd80602c0 con 0x7fcbec0b45c0 2024-05-09T05:05:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.491+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbec09c420 con 0x7fcbec0b45c0 2024-05-09T05:05:01.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.493+0000 7fcbe9600640 1 -- 172.21.15.100:0/3521783575 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5184 (secure 0 0 0) 0x7fcbd80682b0 con 0x7fcbec0b45c0 2024-05-09T05:05:01.493 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:01.493 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2789873969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2789873969},{"type":"v1","addr":"172.21.15.100:6836","nonce":2789873969}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/1998213065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1998213065},{"type":"v1","addr":"172.21.15.133:6833","nonce":1998213065}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/312470000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":312470000},{"type":"v1","addr":"172.21.15.133:6835","nonce":312470000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:04:23.613117+0000","modified":"2024-05-09T05:04:26.685469+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3702528711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":3702528711},{"type":"v1","addr":"172.21.15.100:6837","nonce":3702528711}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4255,"qdb_cluster":[4255]},"id":1}]} 2024-05-09T05:05:01.494 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-05-09T05:05:01.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.495+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcbcc0762d0 msgr2=0x7fcbcc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.495+0000 7fcbf4400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcbcc0762d0 0x7fcbcc078790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00073f0 tx=0x7fcbe000b040 comp rx=0 tx=0).stop 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.495+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 msgr2=0x7fcbec15ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.495+0000 7fcbf4400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 0x7fcbec15ed30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800c420 tx=0x7fcbd800c8e0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 shutdown_connections 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcbcc0762d0 0x7fcbcc078790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbec145900 0x7fcbec09ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbec0b45c0 0x7fcbec15ed30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 --2- 172.21.15.100:0/3521783575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbec0739a0 0x7fcbec138a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 >> 172.21.15.100:0/3521783575 conn(0x7fcbec0b31e0 msgr2=0x7fcbec0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 shutdown_connections 2024-05-09T05:05:01.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.496+0000 7fcbf4400640 1 -- 172.21.15.100:0/3521783575 wait complete. 2024-05-09T05:05:01.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:01.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.696+0000 7f37cda00640 1 Processor -- start 2024-05-09T05:05:01.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.696+0000 7f37cda00640 1 -- start start 2024-05-09T05:05:01.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.697+0000 7f37cda00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37c80d2980 0x7f37c816a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37cda00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80d3da0 con 0x7f37c815f420 2024-05-09T05:05:01.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37cda00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80d4080 con 0x7f37c80d4e40 2024-05-09T05:05:01.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37cda00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f37c80d4360 con 0x7f37c80d2980 2024-05-09T05:05:01.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c6a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f37c815f420 0x7f37c80d33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55542/0 (socket says 172.21.15.100:55542) 2024-05-09T05:05:01.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c6a00640 1 -- 172.21.15.100:0/2446464869 learned_addr learned my addr 172.21.15.100:0/2446464869 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:01.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c7400640 1 --2- 172.21.15.100:0/2446464869 >> v2:172.21.15.100:3300/0 conn(0x7f37c80d2980 0x7f37c816a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c5600640 1 -- 172.21.15.100:0/2446464869 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884301293 0 0) 0x7f37c80d3da0 con 0x7f37c815f420 2024-05-09T05:05:01.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c5600640 1 -- 172.21.15.100:0/2446464869 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37ac003520 con 0x7f37c815f420 2024-05-09T05:05:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c7400640 1 -- 172.21.15.100:0/2446464869 >> v1:172.21.15.133:6789/0 conn(0x7f37c80d4e40 legacy=0x7f37c80d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c7400640 1 -- 172.21.15.100:0/2446464869 >> v1:172.21.15.100:6789/0 conn(0x7f37c815f420 legacy=0x7f37c80d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.698+0000 7f37c7400640 1 -- 172.21.15.100:0/2446464869 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80d4640 con 0x7f37c80d2980 2024-05-09T05:05:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.699+0000 7f37c7400640 1 --2- 172.21.15.100:0/2446464869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c816a070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009d90 tx=0x7f37c002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f631534c686120 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:01.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.700+0000 7f37c5600640 1 -- 172.21.15.100:0/2446464869 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0031600 con 0x7f37c80d2980 2024-05-09T05:05:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.700+0000 7f37c5600640 1 -- 172.21.15.100:0/2446464869 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00317a0 con 0x7f37c80d2980 2024-05-09T05:05:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.700+0000 7f37c5600640 1 -- 172.21.15.100:0/2446464869 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0031b70 con 0x7f37c80d2980 2024-05-09T05:05:01.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.700+0000 7f37cda00640 1 -- 172.21.15.100:0/2446464869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 msgr2=0x7f37c816a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.700+0000 7f37cda00640 1 --2- 172.21.15.100:0/2446464869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c816a070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009d90 tx=0x7f37c002a5d0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.701+0000 7f37cda00640 1 -- 172.21.15.100:0/2446464869 shutdown_connections 2024-05-09T05:05:01.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.701+0000 7f37cda00640 1 --2- 172.21.15.100:0/2446464869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c816a070 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.701+0000 7f37cda00640 1 -- 172.21.15.100:0/2446464869 >> 172.21.15.100:0/2446464869 conn(0x7f37c8073f20 msgr2=0x7f37c8074330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:01.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.701+0000 7f37cda00640 1 -- 172.21.15.100:0/2446464869 shutdown_connections 2024-05-09T05:05:01.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.701+0000 7f37cda00640 1 -- 172.21.15.100:0/2446464869 wait complete. 2024-05-09T05:05:01.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.703+0000 7f37cda00640 1 Processor -- start 2024-05-09T05:05:01.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.703+0000 7f37cda00640 1 -- start start 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.704+0000 7f37cda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.704+0000 7f37cda00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c80d4e40 0x7f37c80b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37cda00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c815f420 0x7f37c80b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37cda00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37c815f800 con 0x7f37c80d2980 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37cda00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f37c80d3ac0 con 0x7f37c815f420 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37cda00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f37c80b67c0 con 0x7f37c80d4e40 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c814f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50504/0 (socket says 172.21.15.100:50504) 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 -- 172.21.15.100:0/2362765 learned_addr learned my addr 172.21.15.100:0/2362765 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6000640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c80d4e40 0x7f37c80b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c7400640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c815f420 0x7f37c80b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 -- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c80d4e40 msgr2=0x7f37c80b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c80d4e40 0x7f37c80b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 -- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c815f420 msgr2=0x7f37c80b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c815f420 0x7f37c80b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.705+0000 7f37c6a00640 1 -- 172.21.15.100:0/2362765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80b5770 con 0x7f37c80d2980 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.706+0000 7f37c6a00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c814f750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c440 tx=0x7f37b800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.706+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8017070 con 0x7f37c80d2980 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.706+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8005ce0 con 0x7f37c80d2980 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.706+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8007270 con 0x7f37c80d2980 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.706+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c80b5a50 con 0x7f37c80d2980 2024-05-09T05:05:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.706+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c81591b0 con 0x7f37c80d2980 2024-05-09T05:05:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.708+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c806a5c0 con 0x7f37c80d2980 2024-05-09T05:05:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.709+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37b801a070 con 0x7f37c80d2980 2024-05-09T05:05:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.710+0000 7f37bea00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f37a80762d0 0x7f37a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.710+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f37b8096770 con 0x7f37c80d2980 2024-05-09T05:05:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.710+0000 7f37c6000640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f37a80762d0 0x7f37a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.711+0000 7f37c6000640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f37a80762d0 0x7f37a8078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37c80cfbf0 tx=0x7f37b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:01.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.714+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37b805fa70 con 0x7f37c80d2980 2024-05-09T05:05:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.921+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37c815eae0 con 0x7f37c80d2980 2024-05-09T05:05:01.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.923+0000 7f37bea00640 1 -- 172.21.15.100:0/2362765 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16629 (secure 0 0 0) 0x7f37b8063d70 con 0x7f37c80d2980 2024-05-09T05:05:01.924 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:01.924 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:04:25.165748+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:04:21.773351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:04:22.585138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.925+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f37a80762d0 msgr2=0x7f37a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.925+0000 7f37cda00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f37a80762d0 0x7f37a8078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37c80cfbf0 tx=0x7f37b4009040 comp rx=0 tx=0).stop 2024-05-09T05:05:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 msgr2=0x7f37c814f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c814f750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c440 tx=0x7f37b800c900 comp rx=0 tx=0).stop 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 shutdown_connections 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f37a80762d0 0x7f37a8078790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c815f420 0x7f37c80b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c80d4e40 0x7f37c80b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 --2- 172.21.15.100:0/2362765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c80d2980 0x7f37c814f750 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 >> 172.21.15.100:0/2362765 conn(0x7f37c8073f20 msgr2=0x7f37c80c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 shutdown_connections 2024-05-09T05:05:01.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:01.926+0000 7f37cda00640 1 -- 172.21.15.100:0/2362765 wait complete. 2024-05-09T05:05:01.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T05:05:02.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.146+0000 7f59c5200640 1 Processor -- start 2024-05-09T05:05:02.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.147+0000 7f59c5200640 1 -- start start 2024-05-09T05:05:02.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59c5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59c00d3700 0x7f59c00d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59c5200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d5c40 0x7f59c00cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59c5200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c015fdc0 con 0x7f59c015f860 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59c5200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f59c01600a0 con 0x7f59c00d3700 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59c5200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f59c0160380 con 0x7f59c00d5c40 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59bf400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59c00d3700 0x7f59c00d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59bf400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59c00d3700 0x7f59c00d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35104/0 (socket says 172.21.15.100:35104) 2024-05-09T05:05:02.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.148+0000 7f59bf400640 1 -- 172.21.15.100:0/365851920 learned_addr learned my addr 172.21.15.100:0/365851920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:02.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.149+0000 7f59bf400640 1 -- 172.21.15.100:0/365851920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d5c40 msgr2=0x7f59c00cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:02.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.149+0000 7f59bf400640 1 --2- 172.21.15.100:0/365851920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d5c40 0x7f59c00cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.149+0000 7f59bf400640 1 -- 172.21.15.100:0/365851920 >> v1:172.21.15.133:6789/0 conn(0x7f59c015f860 legacy=0x7f59c00d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:02.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.149+0000 7f59bf400640 1 -- 172.21.15.100:0/365851920 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c0160660 con 0x7f59c00d3700 2024-05-09T05:05:02.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.150+0000 7f59bf400640 1 --2- 172.21.15.100:0/365851920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c00d3700 0x7f59c00d2f00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009870 tx=0x7f59b002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f366be99efdad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:02.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.150+0000 7f59be000640 1 -- 172.21.15.100:0/365851920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0037070 con 0x7f59c00d3700 2024-05-09T05:05:02.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.150+0000 7f59be000640 1 -- 172.21.15.100:0/365851920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b0032440 con 0x7f59c00d3700 2024-05-09T05:05:02.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.150+0000 7f59be000640 1 -- 172.21.15.100:0/365851920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0032810 con 0x7f59c00d3700 2024-05-09T05:05:02.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 -- 172.21.15.100:0/365851920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c00d3700 msgr2=0x7f59c00d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 --2- 172.21.15.100:0/365851920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c00d3700 0x7f59c00d2f00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009870 tx=0x7f59b002a250 comp rx=0 tx=0).stop 2024-05-09T05:05:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 -- 172.21.15.100:0/365851920 shutdown_connections 2024-05-09T05:05:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 --2- 172.21.15.100:0/365851920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d5c40 0x7f59c00cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 --2- 172.21.15.100:0/365851920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c00d3700 0x7f59c00d2f00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 -- 172.21.15.100:0/365851920 >> 172.21.15.100:0/365851920 conn(0x7f59c00d5120 msgr2=0x7f59c00d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 -- 172.21.15.100:0/365851920 shutdown_connections 2024-05-09T05:05:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.151+0000 7f59c5200640 1 -- 172.21.15.100:0/365851920 wait complete. 2024-05-09T05:05:02.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.152+0000 7f59c5200640 1 Processor -- start 2024-05-09T05:05:02.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.153+0000 7f59c5200640 1 -- start start 2024-05-09T05:05:02.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.153+0000 7f59c5200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d3700 0x7f59c00cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59c5200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c00d5c40 0x7f59c00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59c5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 0x7f59c0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59c5200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00d0460 con 0x7f59c015f860 2024-05-09T05:05:02.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59c5200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00d02e0 con 0x7f59c00d5c40 2024-05-09T05:05:02.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59c5200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f59c00d05e0 con 0x7f59c00d3700 2024-05-09T05:05:02.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 0x7f59c0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 0x7f59c0152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35108/0 (socket says 172.21.15.100:35108) 2024-05-09T05:05:02.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 -- 172.21.15.100:0/2382085315 learned_addr learned my addr 172.21.15.100:0/2382085315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bf400640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d3700 0x7f59c00cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 -- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d3700 msgr2=0x7f59c00cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d3700 0x7f59c00cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bea00640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c00d5c40 0x7f59c00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 -- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c00d5c40 msgr2=0x7f59c00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c00d5c40 0x7f59c00b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.154+0000 7f59bfe00640 1 -- 172.21.15.100:0/2382085315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c00cafb0 con 0x7f59c015f860 2024-05-09T05:05:02.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.155+0000 7f59bfe00640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 0x7f59c0152920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59b800b970 tx=0x7f59b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:02.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.155+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8019070 con 0x7f59c015f860 2024-05-09T05:05:02.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.155+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b800cb60 con 0x7f59c015f860 2024-05-09T05:05:02.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.155+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8014440 con 0x7f59c015f860 2024-05-09T05:05:02.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.155+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c00b4ae0 con 0x7f59c015f860 2024-05-09T05:05:02.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.155+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c00b50a0 con 0x7f59c015f860 2024-05-09T05:05:02.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.156+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c006a550 con 0x7f59c015f860 2024-05-09T05:05:02.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.157+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f59b801c070 con 0x7f59c015f860 2024-05-09T05:05:02.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.158+0000 7f59b7400640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f59a00762d0 0x7f59a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.158+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f59b8097400 con 0x7f59c015f860 2024-05-09T05:05:02.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.159+0000 7f59bf400640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f59a00762d0 0x7f59a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.159+0000 7f59bf400640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f59a00762d0 0x7f59a0078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59b0034000 tx=0x7f59b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:02.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.162+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f59c00cafb0 con 0x7f59c015f860 2024-05-09T05:05:02.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.409+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f59c00d34e0 con 0x7f59c015f860 2024-05-09T05:05:02.411 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-05-09T05:05:02.410+0000 7f475d400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T05:05:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.414+0000 7f59b7400640 1 -- 172.21.15.100:0/2382085315 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f59b8060cc0 con 0x7f59c015f860 2024-05-09T05:05:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f59a00762d0 msgr2=0x7f59a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f59a00762d0 0x7f59a0078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59b0034000 tx=0x7f59b002e000 comp rx=0 tx=0).stop 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 msgr2=0x7f59c0152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 0x7f59c0152920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59b800b970 tx=0x7f59b800be30 comp rx=0 tx=0).stop 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 shutdown_connections 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f59a00762d0 0x7f59a0078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c015f860 0x7f59c0152920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59c00d5c40 0x7f59c00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 --2- 172.21.15.100:0/2382085315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59c00d3700 0x7f59c00cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.418+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 >> 172.21.15.100:0/2382085315 conn(0x7f59c00d5120 msgr2=0x7f59c015e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.421+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 shutdown_connections 2024-05-09T05:05:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.421+0000 7f59c5200640 1 -- 172.21.15.100:0/2382085315 wait complete. 2024-05-09T05:05:02.433 INFO:tasks.ceph.mds.c.smithi100.stderr: -8336> 2024-05-09T05:04:18.072+0000 7fb789a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-09T05:05:02.438 INFO:tasks.ceph.mds.c.smithi100.stderr: -7126> 2024-05-09T05:04:28.087+0000 7fb782200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:05:02.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T05:05:02.496 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-05-09T05:05:02.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.628+0000 7f2593e00640 1 Processor -- start 2024-05-09T05:05:02.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.629+0000 7f2593e00640 1 -- start start 2024-05-09T05:05:02.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2593e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2594162800 0x7f25940cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2593e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25940cc330 0x7f259406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2593e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2594162be0 con 0x7f259406d7d0 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2593e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f25940cc780 con 0x7f25940cc330 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2593e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f25940d12b0 con 0x7f2594162800 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2592000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25940cc330 0x7f259406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2592000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25940cc330 0x7f259406d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35132/0 (socket says 172.21.15.100:35132) 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.630+0000 7f2592000640 1 -- 172.21.15.100:0/818590703 learned_addr learned my addr 172.21.15.100:0/818590703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.631+0000 7f2592a00640 1 --2- 172.21.15.100:0/818590703 >> v2:172.21.15.133:3300/0 conn(0x7f2594162800 0x7f25940cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.631+0000 7f2592000640 1 -- 172.21.15.100:0/818590703 >> v2:172.21.15.133:3300/0 conn(0x7f2594162800 msgr2=0x7f25940cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.631+0000 7f2592000640 1 --2- 172.21.15.100:0/818590703 >> v2:172.21.15.133:3300/0 conn(0x7f2594162800 0x7f25940cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.631+0000 7f2592000640 1 -- 172.21.15.100:0/818590703 >> v1:172.21.15.133:6789/0 conn(0x7f259406d7d0 legacy=0x7f2594162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.631+0000 7f2592000640 1 -- 172.21.15.100:0/818590703 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25940cf200 con 0x7f25940cc330 2024-05-09T05:05:02.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.631+0000 7f2592a00640 1 --2- 172.21.15.100:0/818590703 >> v2:172.21.15.133:3300/0 conn(0x7f2594162800 0x7f25940cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:02.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.632+0000 7f2592000640 1 --2- 172.21.15.100:0/818590703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25940cc330 0x7f259406d290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f259406df70 tx=0x7f257c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ec9c61be6f2ac6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:02.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.632+0000 7f2591600640 1 -- 172.21.15.100:0/818590703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c036070 con 0x7f25940cc330 2024-05-09T05:05:02.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.632+0000 7f2591600640 1 -- 172.21.15.100:0/818590703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257c031600 con 0x7f25940cc330 2024-05-09T05:05:02.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.632+0000 7f2591600640 1 -- 172.21.15.100:0/818590703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c0319d0 con 0x7f25940cc330 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 -- 172.21.15.100:0/818590703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25940cc330 msgr2=0x7f259406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 --2- 172.21.15.100:0/818590703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25940cc330 0x7f259406d290 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f259406df70 tx=0x7f257c02a6a0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 -- 172.21.15.100:0/818590703 shutdown_connections 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 --2- 172.21.15.100:0/818590703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25940cc330 0x7f259406d290 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 --2- 172.21.15.100:0/818590703 >> v2:172.21.15.133:3300/0 conn(0x7f2594162800 0x7f25940cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 -- 172.21.15.100:0/818590703 >> 172.21.15.100:0/818590703 conn(0x7f25940ce010 msgr2=0x7f25940ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 -- 172.21.15.100:0/818590703 shutdown_connections 2024-05-09T05:05:02.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.633+0000 7f2593e00640 1 -- 172.21.15.100:0/818590703 wait complete. 2024-05-09T05:05:02.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.635+0000 7f2593e00640 1 Processor -- start 2024-05-09T05:05:02.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.635+0000 7f2593e00640 1 -- start start 2024-05-09T05:05:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2593e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 0x7f25940c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2593e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25940cc330 0x7f25940c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2593e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2594162800 0x7f25941489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2593e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25940cfaa0 con 0x7f259406d7d0 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2593e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f25940cf7c0 con 0x7f25940cc330 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2593e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f259406e960 con 0x7f2594162800 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2592a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 0x7f25940c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2592a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 0x7f25940c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35142/0 (socket says 172.21.15.100:35142) 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.636+0000 7f2592a00640 1 -- 172.21.15.100:0/2904561450 learned_addr learned my addr 172.21.15.100:0/2904561450 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592a00640 1 -- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2594162800 msgr2=0x7f25941489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592a00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2594162800 0x7f25941489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592a00640 1 -- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25940cc330 msgr2=0x7f25940c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592000640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25940cc330 0x7f25940c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592a00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25940cc330 0x7f25940c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:02.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592a00640 1 -- 172.21.15.100:0/2904561450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25940c5600 con 0x7f259406d7d0 2024-05-09T05:05:02.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2592a00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 0x7f25940c7b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f258400c7f0 tx=0x7f258400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:02.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584015070 con 0x7f259406d7d0 2024-05-09T05:05:02.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2584007820 con 0x7f259406d7d0 2024-05-09T05:05:02.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25940c5880 con 0x7f259406d7d0 2024-05-09T05:05:02.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.637+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584007bd0 con 0x7f259406d7d0 2024-05-09T05:05:02.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.638+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25940c5e40 con 0x7f259406d7d0 2024-05-09T05:05:02.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.639+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259406a550 con 0x7f259406d7d0 2024-05-09T05:05:02.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.640+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2584018070 con 0x7f259406d7d0 2024-05-09T05:05:02.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.641+0000 7f258aa00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f25700762d0 0x7f2570078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:02.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.641+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f25840977f0 con 0x7f259406d7d0 2024-05-09T05:05:02.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.641+0000 7f2592000640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f25700762d0 0x7f2570078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:02.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.642+0000 7f2592000640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f25700762d0 0x7f2570078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f257c033000 tx=0x7f257c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:02.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.646+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f25940c5600 con 0x7f259406d7d0 2024-05-09T05:05:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:02.885+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f25940c8320 con 0x7f259406d7d0 2024-05-09T05:05:03.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.417+0000 7f258aa00640 1 -- 172.21.15.100:0/2904561450 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f2584061050 con 0x7f259406d7d0 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f25700762d0 msgr2=0x7f2570078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f25700762d0 0x7f2570078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f257c033000 tx=0x7f257c009000 comp rx=0 tx=0).stop 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 msgr2=0x7f25940c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 0x7f25940c7b30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f258400c7f0 tx=0x7f258400ccb0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 shutdown_connections 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f25700762d0 0x7f2570078790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2594162800 0x7f25941489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25940cc330 0x7f25940c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 --2- 172.21.15.100:0/2904561450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259406d7d0 0x7f25940c7b30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 >> 172.21.15.100:0/2904561450 conn(0x7f25940ce010 msgr2=0x7f25940681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 shutdown_connections 2024-05-09T05:05:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.421+0000 7f2593e00640 1 -- 172.21.15.100:0/2904561450 wait complete. 2024-05-09T05:05:03.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T05:05:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.645+0000 7f51d3000640 1 Processor -- start 2024-05-09T05:05:03.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.645+0000 7f51d3000640 1 -- start start 2024-05-09T05:05:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d3000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 0x7f51cc0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d3000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51cc0b0530 0x7f51cc0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d3000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc0aecd0 con 0x7f51cc0b4460 2024-05-09T05:05:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d3000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc0af870 con 0x7f51cc0b0530 2024-05-09T05:05:03.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d3000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc0b0990 con 0x7f51cc15c120 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d1000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f51cc0b4460 0x7f51cc0731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39932/0 (socket says 172.21.15.100:39932) 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.647+0000 7f51d1000640 1 -- 172.21.15.100:0/2863091370 learned_addr learned my addr 172.21.15.100:0/2863091370 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cbe00640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 0x7f51cc0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51c3400640 1 --2- 172.21.15.100:0/2863091370 >> v2:172.21.15.133:3300/0 conn(0x7f51cc0b0530 0x7f51cc0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478882963 0 0) 0x7f51cc0aecd0 con 0x7f51cc0b4460 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b0005730 con 0x7f51cc0b4460 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581451592 0 0) 0x7f51b0005730 con 0x7f51cc0b4460 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 msgr2=0x7f51cc0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 0x7f51cc0afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 >> v2:172.21.15.133:3300/0 conn(0x7f51cc0b0530 msgr2=0x7f51cc0b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 --2- 172.21.15.100:0/2863091370 >> v2:172.21.15.133:3300/0 conn(0x7f51cc0b0530 0x7f51cc0b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc0aef40 con 0x7f51cc0b4460 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f51c4001a70 con 0x7f51cc0b4460 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 >> v1:172.21.15.100:6789/0 conn(0x7f51cc0b4460 legacy=0x7f51cc0731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b0005c10 0x7f51b0006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 0x7f51b0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b0006f50 0x7f51b00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc0af870 con 0x7f51b0005c10 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc0b0990 con 0x7f51b0006f50 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.648+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f51b000dc50 con 0x7f51cc15c120 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51cbe00640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b0005c10 0x7f51b0006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51d1000640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b0006f50 0x7f51b00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51cbe00640 1 -- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 msgr2=0x7f51b0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51cbe00640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51cc15c120 0x7f51b0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51cbe00640 1 -- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b0006f50 msgr2=0x7f51b00073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51cbe00640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b0006f50 0x7f51b00073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.649+0000 7f51cbe00640 1 -- 172.21.15.100:0/2863091370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b0005730 con 0x7f51b0005c10 2024-05-09T05:05:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.650+0000 7f51cbe00640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b0005c10 0x7f51b0006030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009ac0 tx=0x7f51b0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a5d26c649f1412 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.650+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc036070 con 0x7f51b0005c10 2024-05-09T05:05:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.650+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc031400 con 0x7f51b0005c10 2024-05-09T05:05:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.650+0000 7f51cb400640 1 -- 172.21.15.100:0/2863091370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc009690 con 0x7f51b0005c10 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d3000640 1 -- 172.21.15.100:0/2863091370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b0005c10 msgr2=0x7f51b0006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d3000640 1 --2- 172.21.15.100:0/2863091370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b0005c10 0x7f51b0006030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009ac0 tx=0x7f51b0007a40 comp rx=0 tx=0).stop 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d1000640 1 -- 172.21.15.100:0/2863091370 reap_dead start 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d3000640 1 -- 172.21.15.100:0/2863091370 shutdown_connections 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d3000640 1 -- 172.21.15.100:0/2863091370 >> 172.21.15.100:0/2863091370 conn(0x7f51cc0b2c20 msgr2=0x7f51cc0b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d3000640 1 -- 172.21.15.100:0/2863091370 shutdown_connections 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.651+0000 7f51d3000640 1 -- 172.21.15.100:0/2863091370 wait complete. 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.653+0000 7f51d3000640 1 Processor -- start 2024-05-09T05:05:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.653+0000 7f51d3000640 1 -- start start 2024-05-09T05:05:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d3000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b0005c10 0x7f51cc1f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d3000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51cc152d60 0x7f51cc0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d3000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 0x7f51cc09ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d3000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc15d510 con 0x7f51cc0b1a70 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d3000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc0af500 con 0x7f51cc152d60 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d3000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc15d690 con 0x7f51b0005c10 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 0x7f51cc09ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 0x7f51cc09ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35148/0 (socket says 172.21.15.100:35148) 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 -- 172.21.15.100:0/1698682214 learned_addr learned my addr 172.21.15.100:0/1698682214 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51c3400640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51cc152d60 0x7f51cc0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51cbe00640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b0005c10 0x7f51cc1f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 -- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b0005c10 msgr2=0x7f51cc1f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b0005c10 0x7f51cc1f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 -- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51cc152d60 msgr2=0x7f51cc0b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51cc152d60 0x7f51cc0b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.654+0000 7f51d1000640 1 -- 172.21.15.100:0/1698682214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc09d000 con 0x7f51cc0b1a70 2024-05-09T05:05:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.655+0000 7f51d1000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 0x7f51cc09ba80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51cc06e0c0 tx=0x7f51c400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.655+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c400bb20 con 0x7f51cc0b1a70 2024-05-09T05:05:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.655+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c400bcc0 con 0x7f51cc0b1a70 2024-05-09T05:05:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.655+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4007270 con 0x7f51cc0b1a70 2024-05-09T05:05:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.655+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc1531e0 con 0x7f51cc0b1a70 2024-05-09T05:05:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.655+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc09d2a0 con 0x7f51cc0b1a70 2024-05-09T05:05:03.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.656+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51cc069500 con 0x7f51cc0b1a70 2024-05-09T05:05:03.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.658+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f51c401b060 con 0x7f51cc0b1a70 2024-05-09T05:05:03.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.658+0000 7f51c8c00640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f51a8076300 0x7f51a80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:03.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.659+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f51c4097670 con 0x7f51cc0b1a70 2024-05-09T05:05:03.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.659+0000 7f51cbe00640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f51a8076300 0x7f51a80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:03.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.660+0000 7f51cbe00640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f51a8076300 0x7f51a80787c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51bc033000 tx=0x7f51bc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.663+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f51c4060ed0 con 0x7f51cc0b1a70 2024-05-09T05:05:03.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:03.870+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f51cc073040 con 0x7f51cc0b1a70 2024-05-09T05:05:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.421+0000 7f51c8c00640 1 -- 172.21.15.100:0/1698682214 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f51c40607d0 con 0x7f51cc0b1a70 2024-05-09T05:05:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-05-09T05:05:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.426+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f51a8076300 msgr2=0x7f51a80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.426+0000 7f51d3000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f51a8076300 0x7f51a80787c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51bc033000 tx=0x7f51bc008030 comp rx=0 tx=0).stop 2024-05-09T05:05:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.426+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 msgr2=0x7f51cc09ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.426+0000 7f51d3000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 0x7f51cc09ba80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51cc06e0c0 tx=0x7f51c400b4a0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.428+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 shutdown_connections 2024-05-09T05:05:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.428+0000 7f51d3000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f51a8076300 0x7f51a80787c0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51bc033000 tx=0x7f51bc008030 comp rx=0 tx=0).stop 2024-05-09T05:05:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.428+0000 7f51d3000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51cc0b1a70 0x7f51cc09ba80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.428+0000 7f51d3000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51cc152d60 0x7f51cc0b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.428+0000 7f51d3000640 1 --2- 172.21.15.100:0/1698682214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b0005c10 0x7f51cc1f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.428+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 >> 172.21.15.100:0/1698682214 conn(0x7f51cc0b2c20 msgr2=0x7f51cc0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.430+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 shutdown_connections 2024-05-09T05:05:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.430+0000 7f51d3000640 1 -- 172.21.15.100:0/1698682214 wait complete. 2024-05-09T05:05:04.461 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T05:05:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.638+0000 7fecf7600640 1 Processor -- start 2024-05-09T05:05:04.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.639+0000 7fecf7600640 1 -- start start 2024-05-09T05:05:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.640+0000 7fecf7600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fecf00b5e10 0x7fecf01639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.640+0000 7fecf7600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 0x7fecf0160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.640+0000 7fecf7600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf015f8c0 con 0x7fecf006fd50 2024-05-09T05:05:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.640+0000 7fecf7600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fecf01608c0 con 0x7fecf00b5e10 2024-05-09T05:05:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.640+0000 7fecf7600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fecf015fef0 con 0x7fecf00724b0 2024-05-09T05:05:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecf4c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fecf006fd50 0x7fecf00b5700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39938/0 (socket says 172.21.15.100:39938) 2024-05-09T05:05:04.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecf4c00640 1 -- 172.21.15.100:0/358510177 learned_addr learned my addr 172.21.15.100:0/358510177 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:04.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecf5600640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 0x7fecf0160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fece7e00640 1 --2- 172.21.15.100:0/358510177 >> v2:172.21.15.133:3300/0 conn(0x7fecf00b5e10 0x7fecf01639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511780126 0 0) 0x7fecf015f8c0 con 0x7fecf006fd50 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd4003520 con 0x7fecf006fd50 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1541498634 0 0) 0x7fecd4003520 con 0x7fecf006fd50 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 msgr2=0x7fecf0160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 0x7fecf0160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 >> v2:172.21.15.133:3300/0 conn(0x7fecf00b5e10 msgr2=0x7fecf01639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 --2- 172.21.15.100:0/358510177 >> v2:172.21.15.133:3300/0 conn(0x7fecf00b5e10 0x7fecf01639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf0072c30 con 0x7fecf006fd50 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fece0001710 con 0x7fecf006fd50 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.641+0000 7fece7e00640 1 --2- 172.21.15.100:0/358510177 >> v2:172.21.15.133:3300/0 conn(0x7fecf00b5e10 0x7fecf01639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 >> v1:172.21.15.100:6789/0 conn(0x7fecf006fd50 legacy=0x7fecf00b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:04.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd4003a50 0x7fecd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4004800 0x7fecd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 0x7fecd40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecf01608c0 con 0x7fecd4003a50 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fecf015fef0 con 0x7fecd4004800 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fecd400bb80 con 0x7fecf00724b0 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf4c00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd4003a50 0x7fecd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fece7e00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4004800 0x7fecd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf5600640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 0x7fecd40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf4c00640 1 -- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 msgr2=0x7fecd40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf4c00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecf00724b0 0x7fecd40051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf4c00640 1 -- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4004800 msgr2=0x7fecd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf4c00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4004800 0x7fecd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.642+0000 7fecf4c00640 1 -- 172.21.15.100:0/358510177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd4003520 con 0x7fecd4003a50 2024-05-09T05:05:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.643+0000 7fecf4c00640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd4003a50 0x7fecd4003e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fece0007fd0 tx=0x7fecd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47686b8693363839 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0007ce0 con 0x7fecd4003a50 2024-05-09T05:05:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece0005ad0 con 0x7fecd4003a50 2024-05-09T05:05:04.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecefe00640 1 -- 172.21.15.100:0/358510177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0007070 con 0x7fecd4003a50 2024-05-09T05:05:04.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecf7600640 1 -- 172.21.15.100:0/358510177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd4003a50 msgr2=0x7fecd4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:04.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecf7600640 1 --2- 172.21.15.100:0/358510177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd4003a50 0x7fecd4003e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fece0007fd0 tx=0x7fecd4005830 comp rx=0 tx=0).stop 2024-05-09T05:05:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecf5600640 1 -- 172.21.15.100:0/358510177 reap_dead start 2024-05-09T05:05:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecf7600640 1 -- 172.21.15.100:0/358510177 shutdown_connections 2024-05-09T05:05:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.644+0000 7fecf7600640 1 -- 172.21.15.100:0/358510177 >> 172.21.15.100:0/358510177 conn(0x7fecf00b2c20 msgr2=0x7fecf00b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.645+0000 7fecf7600640 1 -- 172.21.15.100:0/358510177 shutdown_connections 2024-05-09T05:05:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.645+0000 7fecf7600640 1 -- 172.21.15.100:0/358510177 wait complete. 2024-05-09T05:05:04.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.646+0000 7fecf7600640 1 Processor -- start 2024-05-09T05:05:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.646+0000 7fecf7600640 1 -- start start 2024-05-09T05:05:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.647+0000 7fecf7600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecd4003a50 0x7fecf009e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.647+0000 7fecf7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 0x7fecf01483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.647+0000 7fecf7600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecf00b0ca0 0x7fecf009c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.647+0000 7fecf7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0072900 con 0x7fecf014ae80 2024-05-09T05:05:04.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.647+0000 7fecf7600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fecf015fb80 con 0x7fecf00b0ca0 2024-05-09T05:05:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.647+0000 7fecf7600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fecf0160380 con 0x7fecd4003a50 2024-05-09T05:05:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 0x7fecf01483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 0x7fecf01483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35168/0 (socket says 172.21.15.100:35168) 2024-05-09T05:05:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 -- 172.21.15.100:0/480625924 learned_addr learned my addr 172.21.15.100:0/480625924 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fecf5600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecf00b0ca0 0x7fecf009c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fecf4c00640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecd4003a50 0x7fecf009e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 -- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecd4003a50 msgr2=0x7fecf009e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecd4003a50 0x7fecf009e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 -- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecf00b0ca0 msgr2=0x7fecf009c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecf00b0ca0 0x7fecf009c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 -- 172.21.15.100:0/480625924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf009ef30 con 0x7fecf014ae80 2024-05-09T05:05:04.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.648+0000 7fece7e00640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 0x7fecf01483e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010860 tx=0x7fecd8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.649+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd800f040 con 0x7fecf014ae80 2024-05-09T05:05:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.649+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd801b070 con 0x7fecf014ae80 2024-05-09T05:05:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.649+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd800e750 con 0x7fecf014ae80 2024-05-09T05:05:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.649+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf009bc60 con 0x7fecf014ae80 2024-05-09T05:05:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.649+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf0148920 con 0x7fecf014ae80 2024-05-09T05:05:04.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.650+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf0069500 con 0x7fecf014ae80 2024-05-09T05:05:04.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.651+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fecd800e8f0 con 0x7fecf014ae80 2024-05-09T05:05:04.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.652+0000 7feced600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feccc076300 0x7feccc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:04.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.652+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5502+0+0 (secure 0 0 0) 0x7fecd8097740 con 0x7fecf014ae80 2024-05-09T05:05:04.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.653+0000 7fecf4c00640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feccc076300 0x7feccc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:04.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.653+0000 7fecf4c00640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feccc076300 0x7feccc0787c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fece0032000 tx=0x7fece0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:04.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.657+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fecd8061160 con 0x7fecf014ae80 2024-05-09T05:05:04.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:04.862+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fecf00b3810 con 0x7fecf014ae80 2024-05-09T05:05:05.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.433+0000 7feced600640 1 -- 172.21.15.100:0/480625924 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7fecd8060a60 con 0x7fecf014ae80 2024-05-09T05:05:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-05-09T05:05:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feccc076300 msgr2=0x7feccc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feccc076300 0x7feccc0787c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fece0032000 tx=0x7fece0009030 comp rx=0 tx=0).stop 2024-05-09T05:05:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 msgr2=0x7fecf01483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 0x7fecf01483e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010860 tx=0x7fecd8010d20 comp rx=0 tx=0).stop 2024-05-09T05:05:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 shutdown_connections 2024-05-09T05:05:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feccc076300 0x7feccc0787c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecf00b0ca0 0x7fecf009c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecf014ae80 0x7fecf01483e0 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010860 tx=0x7fecd8010d20 comp rx=0 tx=0).stop 2024-05-09T05:05:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 --2- 172.21.15.100:0/480625924 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecd4003a50 0x7fecf009e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.437+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 >> 172.21.15.100:0/480625924 conn(0x7fecf00b2c20 msgr2=0x7fecf015d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:05.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.442+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 shutdown_connections 2024-05-09T05:05:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:05.444+0000 7fecf7600640 1 -- 172.21.15.100:0/480625924 wait complete. 2024-05-09T05:05:05.473 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T05:05:05.473 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-09T05:05:05.473 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T05:05:05.473 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:05.473 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T05:05:05.473 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-09T05:05:05.474 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T05:05:05.474 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:05.474 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T05:05:05.474 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-09T05:05:05.474 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T05:05:05.474 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:05.474 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T05:05:05.474 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-09T05:05:05.475 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T05:05:05.475 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:05.492 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T05:05:05.492 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T05:05:05.494 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T05:05:05.494 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T05:05:05.501 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T05:05:05.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T05:05:05.539 INFO:tasks.ceph.mds.c:Started 2024-05-09T05:05:05.540 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:05.544 INFO:tasks.ceph.mds.a:Started 2024-05-09T05:05:05.544 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:05.547 INFO:tasks.ceph.mds.d:Started 2024-05-09T05:05:05.547 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:05.687 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-05-09T05:05:05.690 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-05-09T05:05:05.712 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2024-05-09T05:05:10.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-09T05:05:11.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:05:11.079 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:05:11.501 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T05:05:11.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T05:05:11.509 INFO:tasks.ceph.mds.b:Started 2024-05-09T05:05:11.509 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:11.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-09T05:05:11.682 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2024-05-09T05:05:11.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.719+0000 7f1ac7a00640 1 Processor -- start 2024-05-09T05:05:11.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.719+0000 7f1ac7a00640 1 -- start start 2024-05-09T05:05:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.720+0000 7f1ac7a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ac00cfa00 0x7f1ac00cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.720+0000 7f1ac7a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac006e520 con 0x7f1ac015d5a0 2024-05-09T05:05:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1ac7a00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac00cf440 con 0x7f1ac00d03f0 2024-05-09T05:05:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1ac7a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac015d980 con 0x7f1ac00cfa00 2024-05-09T05:05:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1ac5000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1ac015d5a0 0x7f1ac0073f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39956/0 (socket says 172.21.15.100:39956) 2024-05-09T05:05:11.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1ac5000640 1 -- 172.21.15.100:0/2975717382 learned_addr learned my addr 172.21.15.100:0/2975717382 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959713401 0 0) 0x7f1ac006e520 con 0x7f1ac015d5a0 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa8003520 con 0x7f1ac015d5a0 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.721+0000 7f1abfe00640 1 --2- 172.21.15.100:0/2975717382 >> v2:172.21.15.133:3300/0 conn(0x7f1ac00cfa00 0x7f1ac00cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1294523384 0 0) 0x7f1aa8003520 con 0x7f1ac015d5a0 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 >> v2:172.21.15.133:3300/0 conn(0x7f1ac00cfa00 msgr2=0x7f1ac00cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 --2- 172.21.15.100:0/2975717382 >> v2:172.21.15.133:3300/0 conn(0x7f1ac00cfa00 0x7f1ac00cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 >> v1:172.21.15.133:6789/0 conn(0x7f1ac00d03f0 legacy=0x7f1ac006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac00cf720 con 0x7f1ac015d5a0 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f1ab40016f0 con 0x7f1ac015d5a0 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 >> v1:172.21.15.100:6789/0 conn(0x7f1ac015d5a0 legacy=0x7f1ac0073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:11.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa8003a50 0x7f1aa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aa8004800 0x7f1aa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa80053c0 0x7f1aa800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac015d980 con 0x7f1aa80053c0 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800c250 con 0x7f1aa8004800 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa800c450 con 0x7f1aa8003a50 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa80053c0 0x7f1aa800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1abfe00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aa8004800 0x7f1aa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5000640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa8003a50 0x7f1aa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa8003a50 msgr2=0x7f1aa8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa8003a50 0x7f1aa8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aa8004800 msgr2=0x7f1aa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1aa8004800 0x7f1aa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:11.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.722+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2975717382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8003520 con 0x7f1aa80053c0 2024-05-09T05:05:11.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.723+0000 7f1ac5000640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa8003a50 0x7f1aa8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:11.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.723+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2975717382 reap_dead start 2024-05-09T05:05:11.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa80053c0 0x7f1aa800b9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8001e60 tx=0x7f1aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7589351f300e8ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8001ab0 con 0x7f1aa80053c0 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab802ae20 con 0x7f1aa80053c0 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1abf400640 1 -- 172.21.15.100:0/2975717382 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8003bb0 con 0x7f1aa80053c0 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2975717382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa80053c0 msgr2=0x7f1aa800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa80053c0 0x7f1aa800b9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8001e60 tx=0x7f1aa8005830 comp rx=0 tx=0).stop 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2975717382 shutdown_connections 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2975717382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa80053c0 0x7f1aa800b9c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.724+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2975717382 >> 172.21.15.100:0/2975717382 conn(0x7f1ac00b2c90 msgr2=0x7f1ac00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.725+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2975717382 shutdown_connections 2024-05-09T05:05:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.725+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2975717382 wait complete. 2024-05-09T05:05:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.726+0000 7f1ac7a00640 1 Processor -- start 2024-05-09T05:05:11.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.726+0000 7f1ac7a00640 1 -- start start 2024-05-09T05:05:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.727+0000 7f1ac7a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa80053c0 0x7f1ac015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.727+0000 7f1ac7a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac00aefc0 0x7f1ac00af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.727+0000 7f1ac7a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 0x7f1ac01f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.727+0000 7f1ac7a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac009ef60 con 0x7f1ac01f3250 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.727+0000 7f1ac7a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac009ede0 con 0x7f1ac00aefc0 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.727+0000 7f1ac7a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac00cfeb0 con 0x7f1aa80053c0 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 0x7f1ac01f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 0x7f1ac01f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35218/0 (socket says 172.21.15.100:35218) 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2357476667 learned_addr learned my addr 172.21.15.100:0/2357476667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5000640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa80053c0 0x7f1ac015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa80053c0 msgr2=0x7f1ac015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa80053c0 0x7f1ac015e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac00aefc0 msgr2=0x7f1ac00af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac00aefc0 0x7f1ac00af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 -- 172.21.15.100:0/2357476667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac01453d0 con 0x7f1ac01f3250 2024-05-09T05:05:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5000640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa80053c0 0x7f1ac015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.728+0000 7f1ac5a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 0x7f1ac01f3700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8001f80 tx=0x7f1ab80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.729+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8007df0 con 0x7f1ac01f3250 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.729+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab802ac20 con 0x7f1ac01f3250 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.729+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8001ab0 con 0x7f1ac01f3250 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.729+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac0148650 con 0x7f1ac01f3250 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.729+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac0147b90 con 0x7f1ac01f3250 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.730+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac006a630 con 0x7f1ac01f3250 2024-05-09T05:05:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.731+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ab8005520 con 0x7f1ac01f3250 2024-05-09T05:05:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.732+0000 7f1abcc00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1aa00762d0 0x7f1aa0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:11.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.732+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f1ab80b6700 con 0x7f1ac01f3250 2024-05-09T05:05:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.732+0000 7f1ac5000640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1aa00762d0 0x7f1aa0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.733+0000 7f1ac5000640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1aa00762d0 0x7f1aa0078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4001860 tx=0x7f1ab4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.737+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ab8080350 con 0x7f1ac01f3250 2024-05-09T05:05:11.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:11.957+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1ac00b08e0 con 0x7f1ac01f3250 2024-05-09T05:05:13.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.499+0000 7f1abcc00640 1 -- 172.21.15.100:0/2357476667 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f1ab8088340 con 0x7f1ac01f3250 2024-05-09T05:05:13.500 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1aa00762d0 msgr2=0x7f1aa0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1aa00762d0 0x7f1aa0078790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4001860 tx=0x7f1ab4009040 comp rx=0 tx=0).stop 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 msgr2=0x7f1ac01f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 0x7f1ac01f3700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8001f80 tx=0x7f1ab80014a0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 shutdown_connections 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1aa00762d0 0x7f1aa0078790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ac01f3250 0x7f1ac01f3700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac00aefc0 0x7f1ac00af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 --2- 172.21.15.100:0/2357476667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1aa80053c0 0x7f1ac015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 >> 172.21.15.100:0/2357476667 conn(0x7f1ac00b2c90 msgr2=0x7f1ac00b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:13.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 shutdown_connections 2024-05-09T05:05:13.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.504+0000 7f1ac7a00640 1 -- 172.21.15.100:0/2357476667 wait complete. 2024-05-09T05:05:13.526 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-09T05:05:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.729+0000 7f3ed2400640 1 Processor -- start 2024-05-09T05:05:13.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.729+0000 7f3ed2400640 1 -- start start 2024-05-09T05:05:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ed2400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ecc0d0a70 0x7f3ecc15e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ed2400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ed2400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ecc15e780 con 0x7f3ecc0ade90 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ed2400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3ecc0ae3a0 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ed2400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc0b4590 con 0x7f3ecc0afb70 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ecb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ecc0d0a70 0x7f3ecc15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ecb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ecc0d0a70 0x7f3ecc15e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38388/0 (socket says 172.21.15.100:38388) 2024-05-09T05:05:13.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.731+0000 7f3ecb400640 1 -- 172.21.15.100:0/3555809710 learned_addr learned my addr 172.21.15.100:0/3555809710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:13.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.732+0000 7f3ecbe00640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:13.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.732+0000 7f3ecb400640 1 -- 172.21.15.100:0/3555809710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 msgr2=0x7f3ecc0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:13.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.732+0000 7f3ecb400640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.732+0000 7f3ecb400640 1 -- 172.21.15.100:0/3555809710 >> v1:172.21.15.133:6789/0 conn(0x7f3ecc0ade90 legacy=0x7f3ecc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:13.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.732+0000 7f3ecb400640 1 -- 172.21.15.100:0/3555809710 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc0b4870 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.732+0000 7f3ecbe00640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.733+0000 7f3ecb400640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15e240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009870 tx=0x7f3ebc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b86750a22ec906 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.733+0000 7f3eca000640 1 -- 172.21.15.100:0/3555809710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc037070 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.733+0000 7f3eca000640 1 -- 172.21.15.100:0/3555809710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ebc032440 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.733+0000 7f3eca000640 1 -- 172.21.15.100:0/3555809710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc032810 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 -- 172.21.15.100:0/3555809710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 msgr2=0x7f3ecc15e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15e240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009870 tx=0x7f3ebc02a1c0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 -- 172.21.15.100:0/3555809710 shutdown_connections 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 --2- 172.21.15.100:0/3555809710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15e240 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 -- 172.21.15.100:0/3555809710 >> 172.21.15.100:0/3555809710 conn(0x7f3ecc0b31e0 msgr2=0x7f3ecc0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 -- 172.21.15.100:0/3555809710 shutdown_connections 2024-05-09T05:05:13.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.734+0000 7f3ed2400640 1 -- 172.21.15.100:0/3555809710 wait complete. 2024-05-09T05:05:13.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.736+0000 7f3ed2400640 1 Processor -- start 2024-05-09T05:05:13.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.736+0000 7f3ed2400640 1 -- start start 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ed2400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc0ade90 0x7f3ecc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ed2400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ed2400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ed2400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0b0520 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ed2400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0ae680 con 0x7f3ecc0ade90 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ed2400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc072570 con 0x7f3ecc0afb70 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ecbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ecbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38402/0 (socket says 172.21.15.100:38402) 2024-05-09T05:05:13.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ecbe00640 1 -- 172.21.15.100:0/2169609513 learned_addr learned my addr 172.21.15.100:0/2169609513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:13.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.737+0000 7f3ecaa00640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:13.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ecbe00640 1 -- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 msgr2=0x7f3ecc15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:13.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ecbe00640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ecbe00640 1 -- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc0ade90 msgr2=0x7f3ecc1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:13.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ecbe00640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc0ade90 0x7f3ecc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:13.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ecbe00640 1 -- 172.21.15.100:0/2169609513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc157640 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ecbe00640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15c800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400cef0 tx=0x7f3ec400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:13.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec401a070 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec400d860 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400dc50 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc157920 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.738+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc157ee0 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.740+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc06a5c0 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.741+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3ec401d070 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.742+0000 7f3ec3400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3eac0762d0 0x7f3eac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.742+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3ec4097c10 con 0x7f3ecc0d0a70 2024-05-09T05:05:13.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.742+0000 7f3ecb400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3eac0762d0 0x7f3eac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:13.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.743+0000 7f3ecb400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3eac0762d0 0x7f3eac078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc034000 tx=0x7f3ebc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:13.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:13.747+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ec40618e0 con 0x7f3ecc0d0a70 2024-05-09T05:05:14.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.035+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3ecc0b0c50 con 0x7f3ecc0d0a70 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.036+0000 7f3ec3400640 1 -- 172.21.15.100:0/2169609513 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f3ec40611e0 con 0x7f3ecc0d0a70 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-05-09T05:05:14.037 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmMGu+HxAAedx72Hw1h9YzVwqVN60b1w==", 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmuj9cORAAmW56LGvbz1Lu7FgQssQ4Wg==", 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmKnItKxAALO+XiqBeH/9/6zteDWPGvA==", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.039 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmWFd0DBAA0BXHQlyp/O6oFwlY3+Snwg==", 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAXWTxm0tb7CBAAaCbjNh5SvUxktzWNn9dbug==", 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-05-09T05:05:14.041 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAaWTxmkkDbEhAAJD6Rjo599OgRt2FGwLdI5A==", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAdWTxmbNqXLBAAvsCZhY6/iZuQndkG/lAAvQ==", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.042 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAhWTxmEAZWChAAlkyLgMXWyX4K7ql8FP9dVw==", 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-05-09T05:05:14.043 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAnWTxmU1kFFRAAwIv6t79b7s3WdbYXgMRjjA==", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAqWTxm3ziSIBAAjewlIROEUUbScj5tEban/A==", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.044 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAtWTxmcVhQOxAAfIu8Qjzh1QSQwuRdZMQZKQ==", 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAxWTxmAGdBGRAAwKNCvC+t3oaZVQyu9qvwzQ==", 2024-05-09T05:05:14.045 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxm/8wxGBAA16AyM9b+UYE5joYlLTmgZA==", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:14.046 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmw+GCKhAAPue97EzI+2Ht+SQeUd/IiA==", 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2024-05-09T05:05:14.047 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmjSJlIBAA7FhCpTR8GjN+HUc6mGhUGA==", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmfeNaMxAAp3g4lQmtsN3qZhpR9lFAIw==", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:14.048 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQARWTxmCL09FxAAgTcJtZKZBPh/O3/KIotCZA==", 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mds", 2024-05-09T05:05:14.049 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQA+WTxmIOZIKxAAG9Zf8MByOmX8FoVdAdjsCA==", 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mds" 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mgr", 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQA+WTxm+QFJKxAAWBTPIags9M6YI/Zu/OFsbA==", 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-osd", 2024-05-09T05:05:14.050 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQA+WTxmixpJKxAAIJSouY9UdOj+LwtG3k5LBw==", 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-osd" 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd", 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQA+WTxmzTJJKxAAAJ3JjLgp9ga/y69OIdWf1g==", 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-09T05:05:14.051 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQA+WTxmZktJKxAAup4klr/jxYbvxnSQ1p5p1w==", 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rgw", 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQA+WTxmVWRJKxAA2v49wmoTfnVn2AalPQkb5A==", 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-05-09T05:05:14.052 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmNJpBFhAAeSuOIiSNCPrByF3tsiJC5A==", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmfaioCRAAdB5Xwrdnd0j8A49mrNnLCQ==", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:14.053 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.054 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:14.054 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:05:14.054 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3eac0762d0 msgr2=0x7f3eac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3eac0762d0 0x7f3eac078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc034000 tx=0x7f3ebc02c000 comp rx=0 tx=0).stop 2024-05-09T05:05:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 msgr2=0x7f3ecc15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15c800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400cef0 tx=0x7f3ec400a710 comp rx=0 tx=0).stop 2024-05-09T05:05:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 shutdown_connections 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3eac0762d0 0x7f3eac078790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ecc0d0a70 0x7f3ecc15c800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ecc0afb70 0x7f3ecc15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 --2- 172.21.15.100:0/2169609513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ecc0ade90 0x7f3ecc1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.039+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 >> 172.21.15.100:0/2169609513 conn(0x7f3ecc0b31e0 msgr2=0x7f3ecc0d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.040+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 shutdown_connections 2024-05-09T05:05:14.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.040+0000 7f3ed2400640 1 -- 172.21.15.100:0/2169609513 wait complete. 2024-05-09T05:05:14.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-09T05:05:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.264+0000 7f9536e00640 1 Processor -- start 2024-05-09T05:05:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.264+0000 7f9536e00640 1 -- start start 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f9536e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f953015d5a0 0x7f9530073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f9536e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9530074490 0x7f95300cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f9536e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530161020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f9536e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f953015d980 con 0x7f953015d5a0 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f9536e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f953006e520 con 0x7f9530074490 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f9536e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f95300cf440 con 0x7f95300cff40 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f953015d5a0 0x7f9530073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f953015d5a0 0x7f9530073f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38412/0 (socket says 172.21.15.100:38412) 2024-05-09T05:05:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 -- 172.21.15.100:0/2584365711 learned_addr learned my addr 172.21.15.100:0/2584365711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 -- 172.21.15.100:0/2584365711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 msgr2=0x7f9530161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 --2- 172.21.15.100:0/2584365711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 -- 172.21.15.100:0/2584365711 >> v2:172.21.15.133:3300/0 conn(0x7f9530074490 msgr2=0x7f95300cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 --2- 172.21.15.100:0/2584365711 >> v2:172.21.15.133:3300/0 conn(0x7f9530074490 0x7f95300cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.266+0000 7f952fe00640 1 -- 172.21.15.100:0/2584365711 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95300cf720 con 0x7f953015d5a0 2024-05-09T05:05:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.267+0000 7f952fe00640 1 --2- 172.21.15.100:0/2584365711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f953015d5a0 0x7f9530073f50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f953006dc30 tx=0x7f952002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e14b66ecb57e998 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.268+0000 7f952f400640 1 -- 172.21.15.100:0/2584365711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520037070 con 0x7f953015d5a0 2024-05-09T05:05:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.268+0000 7f952f400640 1 -- 172.21.15.100:0/2584365711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520032440 con 0x7f953015d5a0 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.268+0000 7f952f400640 1 -- 172.21.15.100:0/2584365711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520032810 con 0x7f953015d5a0 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.268+0000 7f9536e00640 1 -- 172.21.15.100:0/2584365711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f953015d5a0 msgr2=0x7f9530073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.268+0000 7f9536e00640 1 --2- 172.21.15.100:0/2584365711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f953015d5a0 0x7f9530073f50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f953006dc30 tx=0x7f952002a140 comp rx=0 tx=0).stop 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 -- 172.21.15.100:0/2584365711 shutdown_connections 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 --2- 172.21.15.100:0/2584365711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 --2- 172.21.15.100:0/2584365711 >> v2:172.21.15.133:3300/0 conn(0x7f9530074490 0x7f95300cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 --2- 172.21.15.100:0/2584365711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f953015d5a0 0x7f9530073f50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 -- 172.21.15.100:0/2584365711 >> 172.21.15.100:0/2584365711 conn(0x7f95300b2c90 msgr2=0x7f95300b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 -- 172.21.15.100:0/2584365711 shutdown_connections 2024-05-09T05:05:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.269+0000 7f9536e00640 1 -- 172.21.15.100:0/2584365711 wait complete. 2024-05-09T05:05:14.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.270+0000 7f9536e00640 1 Processor -- start 2024-05-09T05:05:14.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.271+0000 7f9536e00640 1 -- start start 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.271+0000 7f9536e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 0x7f953015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f9536e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f9536e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f953015d5a0 0x7f9530160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f9536e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f953009ef60 con 0x7f9530074490 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f9536e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f953009ede0 con 0x7f953015d5a0 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f9536e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f95300d0370 con 0x7f95300cff40 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 0x7f953015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 0x7f953015bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38422/0 (socket says 172.21.15.100:38422) 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 -- 172.21.15.100:0/3093909490 learned_addr learned my addr 172.21.15.100:0/3093909490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:14.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f9527400640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 -- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 msgr2=0x7f9530147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 -- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f953015d5a0 msgr2=0x7f9530160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f953015d5a0 0x7f9530160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.272+0000 7f952fe00640 1 -- 172.21.15.100:0/3093909490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953009bf60 con 0x7f9530074490 2024-05-09T05:05:14.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.273+0000 7f952fe00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 0x7f953015bdd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f952002a180 tx=0x7f95200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.273+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520041070 con 0x7f9530074490 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.273+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952003c870 con 0x7f9530074490 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.273+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520037040 con 0x7f9530074490 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.273+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953009c240 con 0x7f9530074490 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.273+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953009c800 con 0x7f9530074490 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.274+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953006a630 con 0x7f9530074490 2024-05-09T05:05:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.275+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9520044070 con 0x7f9530074490 2024-05-09T05:05:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.277+0000 7f952cc00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.277+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f95200b7f60 con 0x7f9530074490 2024-05-09T05:05:14.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.277+0000 7f9527400640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.278+0000 7f9527400640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95300ce5e0 tx=0x7f9518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:14.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.281+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9520081b70 con 0x7f9530074490 2024-05-09T05:05:14.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.567+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f95300b08e0 con 0x7f9530074490 2024-05-09T05:05:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.572+0000 7f952cc00640 1 -- 172.21.15.100:0/3093909490 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f9520081470 con 0x7f9530074490 2024-05-09T05:05:14.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.575+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 msgr2=0x7f950c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.575+0000 7f9536e00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95300ce5e0 tx=0x7f9518008040 comp rx=0 tx=0).stop 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.575+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 msgr2=0x7f953015bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.575+0000 7f9536e00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 0x7f953015bdd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f952002a180 tx=0x7f95200046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 shutdown_connections 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f950c0762d0 0x7f950c078790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f953015d5a0 0x7f9530160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95300cff40 0x7f9530147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 --2- 172.21.15.100:0/3093909490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530074490 0x7f953015bdd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 >> 172.21.15.100:0/3093909490 conn(0x7f95300b2c90 msgr2=0x7f953006ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 shutdown_connections 2024-05-09T05:05:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.576+0000 7f9536e00640 1 -- 172.21.15.100:0/3093909490 wait complete. 2024-05-09T05:05:14.596 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-09T05:05:14.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.798+0000 7f463f200640 1 Processor -- start 2024-05-09T05:05:14.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.799+0000 7f463f200640 1 -- start start 2024-05-09T05:05:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.800+0000 7f463f200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f464014d180 0x7f46400cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.800+0000 7f463f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46400cf9b0 con 0x7f46400728f0 2024-05-09T05:05:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.800+0000 7f463f200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46400cfc80 con 0x7f4640070210 2024-05-09T05:05:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.800+0000 7f463f200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f46400b3cb0 con 0x7f464014d180 2024-05-09T05:05:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.801+0000 7f463e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f46400728f0 0x7f46400b4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54518/0 (socket says 172.21.15.100:54518) 2024-05-09T05:05:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.801+0000 7f463e800640 1 -- 172.21.15.100:0/942228210 learned_addr learned my addr 172.21.15.100:0/942228210 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.801+0000 7f463de00640 1 --2- 172.21.15.100:0/942228210 >> v2:172.21.15.133:3300/0 conn(0x7f464014d180 0x7f46400cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.801+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043599317 0 0) 0x7f46400cf9b0 con 0x7f46400728f0 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.801+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4624003520 con 0x7f46400728f0 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2047608197 0 0) 0x7f4624003520 con 0x7f46400728f0 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 >> v2:172.21.15.133:3300/0 conn(0x7f464014d180 msgr2=0x7f46400cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 --2- 172.21.15.100:0/942228210 >> v2:172.21.15.133:3300/0 conn(0x7f464014d180 0x7f46400cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 >> v1:172.21.15.133:6789/0 conn(0x7f4640070210 legacy=0x7f46400721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46400cff60 con 0x7f46400728f0 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f4638001a70 con 0x7f46400728f0 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 >> v1:172.21.15.100:6789/0 conn(0x7f46400728f0 legacy=0x7f46400b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4624003aa0 0x7f4624003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4624004800 0x7f4624004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46240052e0 0x7f462400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46400b3cb0 con 0x7f4624003aa0 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f462400c1e0 con 0x7f4624004800 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f462400c3e0 con 0x7f46240052e0 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463de00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4624003aa0 0x7f4624003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463e800640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46240052e0 0x7f462400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463d400640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4624004800 0x7f4624004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.802+0000 7f463de00640 1 -- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46240052e0 msgr2=0x7f462400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463de00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46240052e0 0x7f462400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463de00640 1 -- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4624004800 msgr2=0x7f4624004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463de00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4624004800 0x7f4624004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463de00640 1 -- 172.21.15.100:0/942228210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4624003520 con 0x7f4624003aa0 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463d400640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4624004800 0x7f4624004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463e800640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46240052e0 0x7f462400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:14.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.803+0000 7f463e800640 1 -- 172.21.15.100:0/942228210 reap_dead start 2024-05-09T05:05:14.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.804+0000 7f463de00640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4624003aa0 0x7f4624003ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4630009ac0 tx=0x7f4624005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4075010b015c36e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:14.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.804+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630036070 con 0x7f4624003aa0 2024-05-09T05:05:14.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.804+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4630031400 con 0x7f4624003aa0 2024-05-09T05:05:14.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.804+0000 7f463ca00640 1 -- 172.21.15.100:0/942228210 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630009690 con 0x7f4624003aa0 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.804+0000 7f463f200640 1 -- 172.21.15.100:0/942228210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4624003aa0 msgr2=0x7f4624003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.804+0000 7f463f200640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4624003aa0 0x7f4624003ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4630009ac0 tx=0x7f4624005830 comp rx=0 tx=0).stop 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.805+0000 7f463f200640 1 -- 172.21.15.100:0/942228210 shutdown_connections 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.805+0000 7f463f200640 1 --2- 172.21.15.100:0/942228210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4624003aa0 0x7f4624003ec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.805+0000 7f463f200640 1 -- 172.21.15.100:0/942228210 >> 172.21.15.100:0/942228210 conn(0x7f46400b29b0 msgr2=0x7f46400b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.805+0000 7f463f200640 1 -- 172.21.15.100:0/942228210 shutdown_connections 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.805+0000 7f463f200640 1 -- 172.21.15.100:0/942228210 wait complete. 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.806+0000 7f463f200640 1 Processor -- start 2024-05-09T05:05:14.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 -- start start 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4624003aa0 0x7f4640159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4640141dc0 0x7f4640142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 0x7f4640146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46400cf470 con 0x7f4640146880 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f46400b41e0 con 0x7f4640141dc0 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.807+0000 7f463f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f46400cf5f0 con 0x7f4624003aa0 2024-05-09T05:05:14.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 0x7f4640146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 0x7f4640146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38430/0 (socket says 172.21.15.100:38430) 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 -- 172.21.15.100:0/1331063886 learned_addr learned my addr 172.21.15.100:0/1331063886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463de00640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4624003aa0 0x7f4640159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463d400640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4640141dc0 0x7f4640142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 -- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4624003aa0 msgr2=0x7f4640159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4624003aa0 0x7f4640159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 -- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4640141dc0 msgr2=0x7f4640142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4640141dc0 0x7f4640142240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.808+0000 7f463e800640 1 -- 172.21.15.100:0/1331063886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4640142940 con 0x7f4640146880 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.809+0000 7f463e800640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 0x7f4640146d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46400b3980 tx=0x7f463800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.809+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638004d60 con 0x7f4640146880 2024-05-09T05:05:14.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.809+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463800bb20 con 0x7f4640146880 2024-05-09T05:05:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.809+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638007070 con 0x7f4640146880 2024-05-09T05:05:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.809+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4640142c20 con 0x7f4640146880 2024-05-09T05:05:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.809+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46401431e0 con 0x7f4640146880 2024-05-09T05:05:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.810+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464006a550 con 0x7f4640146880 2024-05-09T05:05:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.811+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f463801b020 con 0x7f4640146880 2024-05-09T05:05:14.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.812+0000 7f4636000640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f461c0762d0 0x7f461c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.812+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f46380974f0 con 0x7f4640146880 2024-05-09T05:05:14.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.812+0000 7f463de00640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f461c0762d0 0x7f461c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:14.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.813+0000 7f463de00640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f461c0762d0 0x7f461c078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4630033000 tx=0x7f4630008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:14.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:14.817+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4638061100 con 0x7f4640146880 2024-05-09T05:05:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.099+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f46400b5180 con 0x7f4640146880 2024-05-09T05:05:15.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.103+0000 7f4636000640 1 -- 172.21.15.100:0/1331063886 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f4638060a00 con 0x7f4640146880 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f461c0762d0 msgr2=0x7f461c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f461c0762d0 0x7f461c078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4630033000 tx=0x7f4630008030 comp rx=0 tx=0).stop 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 msgr2=0x7f4640146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 0x7f4640146d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46400b3980 tx=0x7f463800b4a0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 shutdown_connections 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f461c0762d0 0x7f461c078790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4640146880 0x7f4640146d30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4640141dc0 0x7f4640142240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 --2- 172.21.15.100:0/1331063886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4624003aa0 0x7f4640159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 >> 172.21.15.100:0/1331063886 conn(0x7f46400b29b0 msgr2=0x7f46400b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:15.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 shutdown_connections 2024-05-09T05:05:15.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.105+0000 7f463f200640 1 -- 172.21.15.100:0/1331063886 wait complete. 2024-05-09T05:05:15.124 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-09T05:05:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.322+0000 7f2ac5000640 1 Processor -- start 2024-05-09T05:05:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.322+0000 7f2ac5000640 1 -- start start 2024-05-09T05:05:15.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.323+0000 7f2ac5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ac006d3e0 0x7f2ac0160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.323+0000 7f2ac5000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ac0163c60 0x7f2ac006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2ac5000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac015fbe0 con 0x7f2ac0070390 2024-05-09T05:05:15.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2ac5000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac006dd00 con 0x7f2ac006d3e0 2024-05-09T05:05:15.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2ac5000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac0070c90 con 0x7f2ac0163c60 2024-05-09T05:05:15.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2abe800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2ac0070390 0x7f2ac006ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54530/0 (socket says 172.21.15.100:54530) 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2abe800640 1 -- 172.21.15.100:0/3192385589 learned_addr learned my addr 172.21.15.100:0/3192385589 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2abde00640 1 --2- 172.21.15.100:0/3192385589 >> v2:172.21.15.100:3300/0 conn(0x7f2ac006d3e0 0x7f2ac0160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2ab7e00640 1 --2- 172.21.15.100:0/3192385589 >> v2:172.21.15.133:3300/0 conn(0x7f2ac0163c60 0x7f2ac006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.324+0000 7f2abde00640 1 -- 172.21.15.100:0/3192385589 >> v2:172.21.15.133:3300/0 conn(0x7f2ac0163c60 msgr2=0x7f2ac006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.325+0000 7f2abde00640 1 --2- 172.21.15.100:0/3192385589 >> v2:172.21.15.133:3300/0 conn(0x7f2ac0163c60 0x7f2ac006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.325+0000 7f2abde00640 1 -- 172.21.15.100:0/3192385589 >> v1:172.21.15.100:6789/0 conn(0x7f2ac0070390 legacy=0x7f2ac006ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.325+0000 7f2abde00640 1 -- 172.21.15.100:0/3192385589 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac015fe80 con 0x7f2ac006d3e0 2024-05-09T05:05:15.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.325+0000 7f2abd400640 1 -- 172.21.15.100:0/3192385589 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353815245 0 0) 0x7f2ac015fbe0 con 0x7f2ac0070390 2024-05-09T05:05:15.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.326+0000 7f2abde00640 1 --2- 172.21.15.100:0/3192385589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac006d3e0 0x7f2ac0160680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0073dc0 tx=0x7f2ab002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f98de447bef0804 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.326+0000 7f2abd400640 1 -- 172.21.15.100:0/3192385589 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0037070 con 0x7f2ac006d3e0 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.326+0000 7f2abd400640 1 -- 172.21.15.100:0/3192385589 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab0032440 con 0x7f2ac006d3e0 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.326+0000 7f2abd400640 1 -- 172.21.15.100:0/3192385589 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab002ae60 con 0x7f2ac006d3e0 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.326+0000 7f2ac5000640 1 -- 172.21.15.100:0/3192385589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac006d3e0 msgr2=0x7f2ac0160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.326+0000 7f2ac5000640 1 --2- 172.21.15.100:0/3192385589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac006d3e0 0x7f2ac0160680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0073dc0 tx=0x7f2ab002a110 comp rx=0 tx=0).stop 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.327+0000 7f2ac5000640 1 -- 172.21.15.100:0/3192385589 shutdown_connections 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.327+0000 7f2ac5000640 1 --2- 172.21.15.100:0/3192385589 >> v2:172.21.15.133:3300/0 conn(0x7f2ac0163c60 0x7f2ac006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.327+0000 7f2ac5000640 1 --2- 172.21.15.100:0/3192385589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac006d3e0 0x7f2ac0160680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.327+0000 7f2ac5000640 1 -- 172.21.15.100:0/3192385589 >> 172.21.15.100:0/3192385589 conn(0x7f2ac0072c60 msgr2=0x7f2ac0073070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.327+0000 7f2ac5000640 1 -- 172.21.15.100:0/3192385589 shutdown_connections 2024-05-09T05:05:15.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.327+0000 7f2ac5000640 1 -- 172.21.15.100:0/3192385589 wait complete. 2024-05-09T05:05:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.328+0000 7f2ac5000640 1 Processor -- start 2024-05-09T05:05:15.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.329+0000 7f2ac5000640 1 -- start start 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.329+0000 7f2ac5000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac006d3e0 0x7f2ac00b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.329+0000 7f2ac5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 0x7f2ac0147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.329+0000 7f2ac5000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ac0163c60 0x7f2ac0160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ac5000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac00707e0 con 0x7f2ac0070390 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ac5000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac0070f70 con 0x7f2ac006d3e0 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ac5000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac0070960 con 0x7f2ac0163c60 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 0x7f2ac0147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 0x7f2ac0147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38440/0 (socket says 172.21.15.100:38440) 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 -- 172.21.15.100:0/2604996642 learned_addr learned my addr 172.21.15.100:0/2604996642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:15.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2abde00640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac006d3e0 0x7f2ac00b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 -- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ac0163c60 msgr2=0x7f2ac0160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ac0163c60 0x7f2ac0160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 -- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac006d3e0 msgr2=0x7f2ac00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac006d3e0 0x7f2ac00b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 -- 172.21.15.100:0/2604996642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac0152790 con 0x7f2ac0070390 2024-05-09T05:05:15.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.330+0000 7f2ab7e00640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 0x7f2ac0147050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800d5f0 tx=0x7f2aa800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.331+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80125f0 con 0x7f2ac0070390 2024-05-09T05:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.331+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa8019070 con 0x7f2ac0070390 2024-05-09T05:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.331+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac0147590 con 0x7f2ac0070390 2024-05-09T05:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.331+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80129d0 con 0x7f2ac0070390 2024-05-09T05:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.331+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac00b50c0 con 0x7f2ac0070390 2024-05-09T05:05:15.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.332+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac006a630 con 0x7f2ac0070390 2024-05-09T05:05:15.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.333+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2aa8012b70 con 0x7f2ac0070390 2024-05-09T05:05:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.334+0000 7f2ab6000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2a9c076300 0x7f2a9c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.334+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f2aa8097760 con 0x7f2ac0070390 2024-05-09T05:05:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.334+0000 7f2abde00640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2a9c076300 0x7f2a9c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.335+0000 7f2abde00640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2a9c076300 0x7f2a9c0787c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0034000 tx=0x7f2ab002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:15.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.338+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2aa8061370 con 0x7f2ac0070390 2024-05-09T05:05:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.619+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f2ac0070170 con 0x7f2ac0070390 2024-05-09T05:05:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.624+0000 7f2ab6000640 1 -- 172.21.15.100:0/2604996642 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f2aa80670a0 con 0x7f2ac0070390 2024-05-09T05:05:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2a9c076300 msgr2=0x7f2a9c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2a9c076300 0x7f2a9c0787c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0034000 tx=0x7f2ab002e000 comp rx=0 tx=0).stop 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 msgr2=0x7f2ac0147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 0x7f2ac0147050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800d5f0 tx=0x7f2aa800dab0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 shutdown_connections 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2a9c076300 0x7f2a9c0787c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ac0163c60 0x7f2ac0160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0070390 0x7f2ac0147050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 --2- 172.21.15.100:0/2604996642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac006d3e0 0x7f2ac00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 >> 172.21.15.100:0/2604996642 conn(0x7f2ac0072c60 msgr2=0x7f2ac00b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 shutdown_connections 2024-05-09T05:05:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.627+0000 7f2ac5000640 1 -- 172.21.15.100:0/2604996642 wait complete. 2024-05-09T05:05:15.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-09T05:05:15.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.839+0000 7f3d3a200640 1 Processor -- start 2024-05-09T05:05:15.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.840+0000 7f3d3a200640 1 -- start start 2024-05-09T05:05:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.841+0000 7f3d3a200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d3415f860 0x7f3d340d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.841+0000 7f3d3a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 0x7f3d340cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.841+0000 7f3d3a200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3415fdc0 con 0x7f3d340d3700 2024-05-09T05:05:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.841+0000 7f3d3a200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f3d341600a0 con 0x7f3d3415f860 2024-05-09T05:05:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.841+0000 7f3d3a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3d34160380 con 0x7f3d340d5c40 2024-05-09T05:05:15.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 0x7f3d340cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 0x7f3d340cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52894/0 (socket says 172.21.15.100:52894) 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 -- 172.21.15.100:0/2124796245 learned_addr learned my addr 172.21.15.100:0/2124796245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d33e00640 1 --2- 172.21.15.100:0/2124796245 >> v2:172.21.15.133:3300/0 conn(0x7f3d3415f860 0x7f3d340d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 -- 172.21.15.100:0/2124796245 >> v2:172.21.15.133:3300/0 conn(0x7f3d3415f860 msgr2=0x7f3d340d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 --2- 172.21.15.100:0/2124796245 >> v2:172.21.15.133:3300/0 conn(0x7f3d3415f860 0x7f3d340d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 -- 172.21.15.100:0/2124796245 >> v1:172.21.15.133:6789/0 conn(0x7f3d340d3700 legacy=0x7f3d340d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.842+0000 7f3d39800640 1 -- 172.21.15.100:0/2124796245 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d34160660 con 0x7f3d340d5c40 2024-05-09T05:05:15.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.844+0000 7f3d39800640 1 --2- 172.21.15.100:0/2124796245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 0x7f3d340cfda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009870 tx=0x7f3d2c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=503ec6b0d1d35b13 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.844+0000 7f3d33400640 1 -- 172.21.15.100:0/2124796245 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c037070 con 0x7f3d340d5c40 2024-05-09T05:05:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.844+0000 7f3d33400640 1 -- 172.21.15.100:0/2124796245 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c02ae50 con 0x7f3d340d5c40 2024-05-09T05:05:15.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.844+0000 7f3d33400640 1 -- 172.21.15.100:0/2124796245 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c032860 con 0x7f3d340d5c40 2024-05-09T05:05:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 -- 172.21.15.100:0/2124796245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 msgr2=0x7f3d340cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2124796245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 0x7f3d340cfda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009870 tx=0x7f3d2c02a300 comp rx=0 tx=0).stop 2024-05-09T05:05:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 -- 172.21.15.100:0/2124796245 shutdown_connections 2024-05-09T05:05:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2124796245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d5c40 0x7f3d340cfda0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2124796245 >> v2:172.21.15.133:3300/0 conn(0x7f3d3415f860 0x7f3d340d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 -- 172.21.15.100:0/2124796245 >> 172.21.15.100:0/2124796245 conn(0x7f3d340d5120 msgr2=0x7f3d340d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:15.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 -- 172.21.15.100:0/2124796245 shutdown_connections 2024-05-09T05:05:15.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.845+0000 7f3d3a200640 1 -- 172.21.15.100:0/2124796245 wait complete. 2024-05-09T05:05:15.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.847+0000 7f3d3a200640 1 Processor -- start 2024-05-09T05:05:15.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.848+0000 7f3d3a200640 1 -- start start 2024-05-09T05:05:15.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d3a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d3700 0x7f3d34155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d3a200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d340d5c40 0x7f3d341f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d3a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 0x7f3d341f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d3a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340d0460 con 0x7f3d3415f860 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d3a200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340d02e0 con 0x7f3d340d5c40 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d3a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3d340d05e0 con 0x7f3d340d3700 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d39800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 0x7f3d341f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d39800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 0x7f3d341f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38442/0 (socket says 172.21.15.100:38442) 2024-05-09T05:05:15.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d39800640 1 -- 172.21.15.100:0/2078639472 learned_addr learned my addr 172.21.15.100:0/2078639472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:15.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d33e00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d340d5c40 0x7f3d341f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.849+0000 7f3d38e00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d3700 0x7f3d34155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d39800640 1 -- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d3700 msgr2=0x7f3d34155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d39800640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d3700 0x7f3d34155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d39800640 1 -- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d340d5c40 msgr2=0x7f3d341f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d39800640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d340d5c40 0x7f3d341f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d39800640 1 -- 172.21.15.100:0/2078639472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3409f2d0 con 0x7f3d3415f860 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d38e00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d3700 0x7f3d34155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d33e00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d340d5c40 0x7f3d341f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d39800640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 0x7f3d341f8cb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009870 tx=0x7f3d2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c041070 con 0x7f3d3415f860 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c03c680 con 0x7f3d3415f860 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c037040 con 0x7f3d3415f860 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d340b98d0 con 0x7f3d3415f860 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.850+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d340b9e90 con 0x7f3d3415f860 2024-05-09T05:05:15.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.851+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3406a550 con 0x7f3d3415f860 2024-05-09T05:05:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.852+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d2c044070 con 0x7f3d3415f860 2024-05-09T05:05:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.853+0000 7f3d30c00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3d100762d0 0x7f3d10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.854+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3d2c0b7920 con 0x7f3d3415f860 2024-05-09T05:05:15.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.854+0000 7f3d38e00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3d100762d0 0x7f3d10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:15.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.854+0000 7f3d38e00640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3d100762d0 0x7f3d10078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001db0 tx=0x7f3d24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:15.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:15.858+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d2c081660 con 0x7f3d3415f860 2024-05-09T05:05:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.118+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f3d340d34e0 con 0x7f3d3415f860 2024-05-09T05:05:16.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.122+0000 7f3d30c00640 1 -- 172.21.15.100:0/2078639472 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3d2c080f60 con 0x7f3d3415f860 2024-05-09T05:05:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.124+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3d100762d0 msgr2=0x7f3d10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.124+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3d100762d0 0x7f3d10078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d24001db0 tx=0x7f3d24009040 comp rx=0 tx=0).stop 2024-05-09T05:05:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.124+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 msgr2=0x7f3d341f8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.124+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 0x7f3d341f8cb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009870 tx=0x7f3d2c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 shutdown_connections 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3d100762d0 0x7f3d10078790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d3415f860 0x7f3d341f8cb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d340d5c40 0x7f3d341f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 --2- 172.21.15.100:0/2078639472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d340d3700 0x7f3d34155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 >> 172.21.15.100:0/2078639472 conn(0x7f3d340d5120 msgr2=0x7f3d340b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 shutdown_connections 2024-05-09T05:05:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.125+0000 7f3d3a200640 1 -- 172.21.15.100:0/2078639472 wait complete. 2024-05-09T05:05:16.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-09T05:05:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.343+0000 7f9441e00640 1 Processor -- start 2024-05-09T05:05:16.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.344+0000 7f9441e00640 1 -- start start 2024-05-09T05:05:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.345+0000 7f9441e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f943c06cae0 0x7f943c163aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.345+0000 7f9441e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f943c0b1070 0x7f943c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.345+0000 7f9441e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f943c163030 con 0x7f943c15f360 2024-05-09T05:05:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.345+0000 7f9441e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f943c070db0 con 0x7f943c06cae0 2024-05-09T05:05:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.345+0000 7f9441e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f943c1632a0 con 0x7f943c0b1070 2024-05-09T05:05:16.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.345+0000 7f943aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f943c15f360 0x7f943c06c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54536/0 (socket says 172.21.15.100:54536) 2024-05-09T05:05:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943aa00640 1 -- 172.21.15.100:0/2525358690 learned_addr learned my addr 172.21.15.100:0/2525358690 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:16.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943a000640 1 --2- 172.21.15.100:0/2525358690 >> v2:172.21.15.100:3300/0 conn(0x7f943c06cae0 0x7f943c163aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943b400640 1 --2- 172.21.15.100:0/2525358690 >> v2:172.21.15.133:3300/0 conn(0x7f943c0b1070 0x7f943c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f9439600640 1 -- 172.21.15.100:0/2525358690 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942238044 0 0) 0x7f943c163030 con 0x7f943c15f360 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f9439600640 1 -- 172.21.15.100:0/2525358690 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9420003520 con 0x7f943c15f360 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943a000640 1 -- 172.21.15.100:0/2525358690 >> v2:172.21.15.133:3300/0 conn(0x7f943c0b1070 msgr2=0x7f943c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943a000640 1 --2- 172.21.15.100:0/2525358690 >> v2:172.21.15.133:3300/0 conn(0x7f943c0b1070 0x7f943c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943a000640 1 -- 172.21.15.100:0/2525358690 >> v1:172.21.15.100:6789/0 conn(0x7f943c15f360 legacy=0x7f943c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.346+0000 7f943a000640 1 -- 172.21.15.100:0/2525358690 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c163580 con 0x7f943c06cae0 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.347+0000 7f943a000640 1 --2- 172.21.15.100:0/2525358690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c06cae0 0x7f943c163aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f943c0d1b40 tx=0x7f942c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df828363e4f99ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:16.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9439600640 1 -- 172.21.15.100:0/2525358690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c007740 con 0x7f943c06cae0 2024-05-09T05:05:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9439600640 1 -- 172.21.15.100:0/2525358690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c0078e0 con 0x7f943c06cae0 2024-05-09T05:05:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9439600640 1 -- 172.21.15.100:0/2525358690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c007cb0 con 0x7f943c06cae0 2024-05-09T05:05:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 -- 172.21.15.100:0/2525358690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c06cae0 msgr2=0x7f943c163aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 --2- 172.21.15.100:0/2525358690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c06cae0 0x7f943c163aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f943c0d1b40 tx=0x7f942c02a680 comp rx=0 tx=0).stop 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 -- 172.21.15.100:0/2525358690 shutdown_connections 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 --2- 172.21.15.100:0/2525358690 >> v2:172.21.15.133:3300/0 conn(0x7f943c0b1070 0x7f943c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 --2- 172.21.15.100:0/2525358690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c06cae0 0x7f943c163aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 -- 172.21.15.100:0/2525358690 >> 172.21.15.100:0/2525358690 conn(0x7f943c0b3d80 msgr2=0x7f943c0b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 -- 172.21.15.100:0/2525358690 shutdown_connections 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.348+0000 7f9441e00640 1 -- 172.21.15.100:0/2525358690 wait complete. 2024-05-09T05:05:16.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.350+0000 7f9441e00640 1 Processor -- start 2024-05-09T05:05:16.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.350+0000 7f9441e00640 1 -- start start 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f9441e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f943c06cae0 0x7f943c14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f9441e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 0x7f943c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f9441e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c15f360 0x7f943c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f9441e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f943c0b1970 con 0x7f943c0b1070 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f9441e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f943c071090 con 0x7f943c15f360 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f9441e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f943c15f740 con 0x7f943c06cae0 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.351+0000 7f943a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 0x7f943c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 0x7f943c157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38458/0 (socket says 172.21.15.100:38458) 2024-05-09T05:05:16.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 -- 172.21.15.100:0/748743957 learned_addr learned my addr 172.21.15.100:0/748743957 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943b400640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c15f360 0x7f943c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943aa00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f943c06cae0 0x7f943c14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 -- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f943c06cae0 msgr2=0x7f943c14ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f943c06cae0 0x7f943c14ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 -- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c15f360 msgr2=0x7f943c157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c15f360 0x7f943c157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 -- 172.21.15.100:0/748743957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f943c15cba0 con 0x7f943c0b1070 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943aa00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f943c06cae0 0x7f943c14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943b400640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c15f360 0x7f943c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:16.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f943a000640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 0x7f943c157320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f942c009e80 tx=0x7f942c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.352+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c040070 con 0x7f943c0b1070 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.353+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c031c40 con 0x7f943c0b1070 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.353+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c009450 con 0x7f943c0b1070 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.353+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f943c15ce80 con 0x7f943c0b1070 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.353+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f943c15d440 con 0x7f943c0b1070 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.354+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943c06a630 con 0x7f943c0b1070 2024-05-09T05:05:16.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.355+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f942c039040 con 0x7f943c0b1070 2024-05-09T05:05:16.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.356+0000 7f9433400640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9418076300 0x7f94180787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.356+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f942c0b8710 con 0x7f943c0b1070 2024-05-09T05:05:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.356+0000 7f943aa00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9418076300 0x7f94180787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.357+0000 7f943aa00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9418076300 0x7f94180787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9424001220 tx=0x7f9424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:16.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.361+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f942c0823b0 con 0x7f943c0b1070 2024-05-09T05:05:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.646+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f943c0b0c50 con 0x7f943c0b1070 2024-05-09T05:05:16.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.650+0000 7f9433400640 1 -- 172.21.15.100:0/748743957 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f942c081cb0 con 0x7f943c0b1070 2024-05-09T05:05:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9418076300 msgr2=0x7f94180787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9418076300 0x7f94180787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9424001220 tx=0x7f9424009040 comp rx=0 tx=0).stop 2024-05-09T05:05:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 msgr2=0x7f943c157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 0x7f943c157320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f942c009e80 tx=0x7f942c004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 shutdown_connections 2024-05-09T05:05:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9418076300 0x7f94180787c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f943c15f360 0x7f943c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f943c0b1070 0x7f943c157320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 --2- 172.21.15.100:0/748743957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f943c06cae0 0x7f943c14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.653+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 >> 172.21.15.100:0/748743957 conn(0x7f943c0b3d80 msgr2=0x7f943c0affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.654+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 shutdown_connections 2024-05-09T05:05:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.654+0000 7f9441e00640 1 -- 172.21.15.100:0/748743957 wait complete. 2024-05-09T05:05:16.673 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-09T05:05:16.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.870+0000 7f2bda000640 1 Processor -- start 2024-05-09T05:05:16.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.870+0000 7f2bda000640 1 -- start start 2024-05-09T05:05:16.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.871+0000 7f2bda000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd41599d0 0x7f2bd415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bda000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bd406fca0 0x7f2bd415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bda000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bd4160240 con 0x7f2bd415d670 2024-05-09T05:05:16.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bda000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2bd415ffe0 con 0x7f2bd406fca0 2024-05-09T05:05:16.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bda000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd4160520 con 0x7f2bd41599d0 2024-05-09T05:05:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bd8c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd41599d0 0x7f2bd415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bcbe00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2bd415d670 0x7f2bd406f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:48102/0 (socket says 172.21.15.100:48102) 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bcbe00640 1 -- 172.21.15.100:0/3745916461 learned_addr learned my addr 172.21.15.100:0/3745916461 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.872+0000 7f2bd9600640 1 --2- 172.21.15.100:0/3745916461 >> v2:172.21.15.133:3300/0 conn(0x7f2bd406fca0 0x7f2bd415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.873+0000 7f2bd8c00640 1 -- 172.21.15.100:0/3745916461 >> v2:172.21.15.133:3300/0 conn(0x7f2bd406fca0 msgr2=0x7f2bd415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.873+0000 7f2bd8c00640 1 --2- 172.21.15.100:0/3745916461 >> v2:172.21.15.133:3300/0 conn(0x7f2bd406fca0 0x7f2bd415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.873+0000 7f2bd8c00640 1 -- 172.21.15.100:0/3745916461 >> v1:172.21.15.133:6789/0 conn(0x7f2bd415d670 legacy=0x7f2bd406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.873+0000 7f2bd8c00640 1 -- 172.21.15.100:0/3745916461 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd4160800 con 0x7f2bd41599d0 2024-05-09T05:05:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.874+0000 7f2bd8c00640 1 --2- 172.21.15.100:0/3745916461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd41599d0 0x7f2bd415d030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0097a0 tx=0x7f2bbc02c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df1b968d9c1ba50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.875+0000 7f2bd3e00640 1 -- 172.21.15.100:0/3745916461 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc039070 con 0x7f2bd41599d0 2024-05-09T05:05:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.875+0000 7f2bd3e00640 1 -- 172.21.15.100:0/3745916461 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc034640 con 0x7f2bd41599d0 2024-05-09T05:05:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.875+0000 7f2bd3e00640 1 -- 172.21.15.100:0/3745916461 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc02ce60 con 0x7f2bd41599d0 2024-05-09T05:05:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 -- 172.21.15.100:0/3745916461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd41599d0 msgr2=0x7f2bd415d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 --2- 172.21.15.100:0/3745916461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd41599d0 0x7f2bd415d030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc0097a0 tx=0x7f2bbc02c310 comp rx=0 tx=0).stop 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 -- 172.21.15.100:0/3745916461 shutdown_connections 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 --2- 172.21.15.100:0/3745916461 >> v2:172.21.15.133:3300/0 conn(0x7f2bd406fca0 0x7f2bd415faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 --2- 172.21.15.100:0/3745916461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd41599d0 0x7f2bd415d030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 -- 172.21.15.100:0/3745916461 >> 172.21.15.100:0/3745916461 conn(0x7f2bd40b29b0 msgr2=0x7f2bd40b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 -- 172.21.15.100:0/3745916461 shutdown_connections 2024-05-09T05:05:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.876+0000 7f2bda000640 1 -- 172.21.15.100:0/3745916461 wait complete. 2024-05-09T05:05:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.878+0000 7f2bda000640 1 Processor -- start 2024-05-09T05:05:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.878+0000 7f2bda000640 1 -- start start 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bda000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd406fca0 0x7f2bd41f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bda000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 0x7f2bd415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bda000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd415d670 0x7f2bd415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bda000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4159f30 con 0x7f2bd41599d0 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bda000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4159db0 con 0x7f2bd415d670 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bda000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd40cfbd0 con 0x7f2bd406fca0 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 0x7f2bd415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 0x7f2bd415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38466/0 (socket says 172.21.15.100:38466) 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 -- 172.21.15.100:0/1972190958 learned_addr learned my addr 172.21.15.100:0/1972190958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bd9600640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd415d670 0x7f2bd415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bd8c00640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd406fca0 0x7f2bd41f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 -- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd406fca0 msgr2=0x7f2bd41f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd406fca0 0x7f2bd41f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 -- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd415d670 msgr2=0x7f2bd415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd415d670 0x7f2bd415a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:16.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.879+0000 7f2bcbe00640 1 -- 172.21.15.100:0/1972190958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd4154260 con 0x7f2bd41599d0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.880+0000 7f2bcbe00640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 0x7f2bd415a0b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4001eb0 tx=0x7f2bb400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.880+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017070 con 0x7f2bd41599d0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.880+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb4005d00 con 0x7f2bd41599d0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.880+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd4153f80 con 0x7f2bd41599d0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.880+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4007310 con 0x7f2bd41599d0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.880+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd415b440 con 0x7f2bd41599d0 2024-05-09T05:05:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.881+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd406a550 con 0x7f2bd41599d0 2024-05-09T05:05:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.882+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2bb401a070 con 0x7f2bd41599d0 2024-05-09T05:05:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.883+0000 7f2bd1600640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.883+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f2bb40965b0 con 0x7f2bd41599d0 2024-05-09T05:05:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.884+0000 7f2bd8c00640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.884+0000 7f2bd8c00640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bac0762d0 0x7f2bac078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc036000 tx=0x7f2bbc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:16.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:16.888+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2bb40602f0 con 0x7f2bd41599d0 2024-05-09T05:05:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.169+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2bd4070380 con 0x7f2bd41599d0 2024-05-09T05:05:17.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.173+0000 7f2bd1600640 1 -- 172.21.15.100:0/1972190958 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f2bb405fbf0 con 0x7f2bd41599d0 2024-05-09T05:05:17.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bac0762d0 msgr2=0x7f2bac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bac0762d0 0x7f2bac078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc036000 tx=0x7f2bbc030000 comp rx=0 tx=0).stop 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 msgr2=0x7f2bd415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 0x7f2bd415a0b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4001eb0 tx=0x7f2bb400c890 comp rx=0 tx=0).stop 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 shutdown_connections 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bac0762d0 0x7f2bac078790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd415d670 0x7f2bd415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bd41599d0 0x7f2bd415a0b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 --2- 172.21.15.100:0/1972190958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bd406fca0 0x7f2bd41f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 >> 172.21.15.100:0/1972190958 conn(0x7f2bd40b29b0 msgr2=0x7f2bd415c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 shutdown_connections 2024-05-09T05:05:17.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.176+0000 7f2bda000640 1 -- 172.21.15.100:0/1972190958 wait complete. 2024-05-09T05:05:17.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T05:05:17.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.391+0000 7f3ce8c00640 1 Processor -- start 2024-05-09T05:05:17.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.391+0000 7f3ce8c00640 1 -- start start 2024-05-09T05:05:17.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.392+0000 7f3ce8c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 0x7f3ce40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.392+0000 7f3ce8c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce40cf150 con 0x7f3ce415f9c0 2024-05-09T05:05:17.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce8c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce40cf430 con 0x7f3ce40b50b0 2024-05-09T05:05:17.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce8c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce40cfd60 con 0x7f3ce40742b0 2024-05-09T05:05:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3ce415f9c0 0x7f3ce4151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54540/0 (socket says 172.21.15.100:54540) 2024-05-09T05:05:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce3e00640 1 -- 172.21.15.100:0/2758201273 learned_addr learned my addr 172.21.15.100:0/2758201273 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 0x7f3ce40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770393533 0 0) 0x7f3ce40cf150 con 0x7f3ce415f9c0 2024-05-09T05:05:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.393+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cc8003520 con 0x7f3ce415f9c0 2024-05-09T05:05:17.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3265003496 0 0) 0x7f3cc8003520 con 0x7f3ce415f9c0 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 msgr2=0x7f3ce40cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 0x7f3ce40cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 >> v1:172.21.15.133:6789/0 conn(0x7f3ce40b50b0 legacy=0x7f3ce415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40cf710 con 0x7f3ce415f9c0 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f3cdc001a70 con 0x7f3ce415f9c0 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 >> v1:172.21.15.100:6789/0 conn(0x7f3ce415f9c0 legacy=0x7f3ce4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8003a30 0x7f3cc8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 0x7f3cc8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8004d40 0x7f3cc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce40cfd60 con 0x7f3cc8003a30 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc800bb80 con 0x7f3cc8004d40 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc800df90 con 0x7f3ce40742b0 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8003a30 0x7f3cc8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3e00640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8004d40 0x7f3cc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3400640 1 -- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 msgr2=0x7f3cc8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce40742b0 0x7f3cc8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3400640 1 -- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8004d40 msgr2=0x7f3cc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8004d40 0x7f3cc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.394+0000 7f3ce3400640 1 -- 172.21.15.100:0/2758201273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc8003520 con 0x7f3cc8003a30 2024-05-09T05:05:17.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.395+0000 7f3ce3e00640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8004d40 0x7f3cc80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.395+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8003a30 0x7f3cc8003e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009ac0 tx=0x7f3cc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a23fa7c77e542 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4036070 con 0x7f3cc8003a30 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd4031400 con 0x7f3cc8003a30 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce2000640 1 -- 172.21.15.100:0/2758201273 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4009690 con 0x7f3cc8003a30 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2758201273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8003a30 msgr2=0x7f3cc8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2758201273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc8003a30 0x7f3cc8003e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009ac0 tx=0x7f3cc8005830 comp rx=0 tx=0).stop 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce3e00640 1 -- 172.21.15.100:0/2758201273 reap_dead start 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2758201273 shutdown_connections 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2758201273 >> 172.21.15.100:0/2758201273 conn(0x7f3ce406c7f0 msgr2=0x7f3ce406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2758201273 shutdown_connections 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.396+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2758201273 wait complete. 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.398+0000 7f3ce8c00640 1 Processor -- start 2024-05-09T05:05:17.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.398+0000 7f3ce8c00640 1 -- start start 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.399+0000 7f3ce8c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a30 0x7f3ce4156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.399+0000 7f3ce8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 0x7f3ce415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.399+0000 7f3ce8c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce415bb80 0x7f3ce415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.399+0000 7f3ce8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4074690 con 0x7f3ce415b1e0 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.399+0000 7f3ce8c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce40d0a20 con 0x7f3cc8003a30 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.399+0000 7f3ce8c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce4074810 con 0x7f3ce415bb80 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 0x7f3ce415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 0x7f3ce415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38484/0 (socket says 172.21.15.100:38484) 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 -- 172.21.15.100:0/2689201985 learned_addr learned my addr 172.21.15.100:0/2689201985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce3e00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce415bb80 0x7f3ce415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a30 0x7f3ce4156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 -- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce415bb80 msgr2=0x7f3ce415c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce415bb80 0x7f3ce415c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 -- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a30 msgr2=0x7f3ce4156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a30 0x7f3ce4156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 -- 172.21.15.100:0/2689201985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce41572b0 con 0x7f3ce415b1e0 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a30 0x7f3ce4156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.400+0000 7f3ce2a00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 0x7f3ce415b640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c4f0 tx=0x7f3cd000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.401+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0016020 con 0x7f3ce415b1e0 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.401+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd0005310 con 0x7f3ce415b1e0 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.401+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0007260 con 0x7f3ce415b1e0 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.401+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce40afde0 con 0x7f3ce415b1e0 2024-05-09T05:05:17.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.401+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce415a9e0 con 0x7f3ce415b1e0 2024-05-09T05:05:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.402+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce40b0910 con 0x7f3ce415b1e0 2024-05-09T05:05:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.403+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3cd0007400 con 0x7f3ce415b1e0 2024-05-09T05:05:17.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.405+0000 7f3cdb400640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3cc40762d0 0x7f3cc4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.405+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3cd0096c90 con 0x7f3ce415b1e0 2024-05-09T05:05:17.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.405+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3cc40762d0 0x7f3cc4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.405+0000 7f3ce3400640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3cc40762d0 0x7f3cc4078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4033000 tx=0x7f3cd4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:17.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.409+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3cd0020020 con 0x7f3ce415b1e0 2024-05-09T05:05:17.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.614+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ce406a550 con 0x7f3ce415b1e0 2024-05-09T05:05:17.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.615+0000 7f3cdb400640 1 -- 172.21.15.100:0/2689201985 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f3cd0060930 con 0x7f3ce415b1e0 2024-05-09T05:05:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:17.615 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-05-09T05:05:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-05-09T05:05:17.615 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-05-09T05:05:17.616 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:17.616 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3cc40762d0 msgr2=0x7f3cc4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3cc40762d0 0x7f3cc4078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4033000 tx=0x7f3cd4008030 comp rx=0 tx=0).stop 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 msgr2=0x7f3ce415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 0x7f3ce415b640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c4f0 tx=0x7f3cd000c9b0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 shutdown_connections 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3cc40762d0 0x7f3cc4078790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ce415bb80 0x7f3ce415c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ce415b1e0 0x7f3ce415b640 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 --2- 172.21.15.100:0/2689201985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a30 0x7f3ce4156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 >> 172.21.15.100:0/2689201985 conn(0x7f3ce406c7f0 msgr2=0x7f3ce41599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 shutdown_connections 2024-05-09T05:05:17.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.617+0000 7f3ce8c00640 1 -- 172.21.15.100:0/2689201985 wait complete. 2024-05-09T05:05:17.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T05:05:17.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T05:05:17.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-09T05:05:17.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.838+0000 7f8eb3000640 1 Processor -- start 2024-05-09T05:05:17.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.838+0000 7f8eb3000640 1 -- start start 2024-05-09T05:05:17.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb3000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8eac145330 0x7f8eac0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb3000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eac1607d0 con 0x7f8eac0b32a0 2024-05-09T05:05:17.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb3000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eac0cf9b0 con 0x7f8eac0d09d0 2024-05-09T05:05:17.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb3000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8eac0d0000 con 0x7f8eac145330 2024-05-09T05:05:17.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb2600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8eac0b32a0 0x7f8eac0b4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54554/0 (socket says 172.21.15.100:54554) 2024-05-09T05:05:17.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb2600640 1 -- 172.21.15.100:0/2106809852 learned_addr learned my addr 172.21.15.100:0/2106809852 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:17.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.840+0000 7f8eb1c00640 1 --2- 172.21.15.100:0/2106809852 >> v2:172.21.15.100:3300/0 conn(0x7f8eac145330 0x7f8eac0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.841+0000 7f8eabe00640 1 -- 172.21.15.100:0/2106809852 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239481666 0 0) 0x7f8eac1607d0 con 0x7f8eac0b32a0 2024-05-09T05:05:17.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.841+0000 7f8eb1c00640 1 -- 172.21.15.100:0/2106809852 >> v1:172.21.15.133:6789/0 conn(0x7f8eac0d09d0 legacy=0x7f8eac0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:17.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.841+0000 7f8eb1c00640 1 -- 172.21.15.100:0/2106809852 >> v1:172.21.15.100:6789/0 conn(0x7f8eac0b32a0 legacy=0x7f8eac0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.841+0000 7f8eb1c00640 1 -- 172.21.15.100:0/2106809852 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac0cfc90 con 0x7f8eac145330 2024-05-09T05:05:17.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.842+0000 7f8eb1c00640 1 --2- 172.21.15.100:0/2106809852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac145330 0x7f8eac0d0490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de7191026a17311 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:17.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.842+0000 7f8eabe00640 1 -- 172.21.15.100:0/2106809852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0037070 con 0x7f8eac145330 2024-05-09T05:05:17.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.842+0000 7f8eabe00640 1 -- 172.21.15.100:0/2106809852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0032440 con 0x7f8eac145330 2024-05-09T05:05:17.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.842+0000 7f8eabe00640 1 -- 172.21.15.100:0/2106809852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0032810 con 0x7f8eac145330 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 -- 172.21.15.100:0/2106809852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac145330 msgr2=0x7f8eac0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 --2- 172.21.15.100:0/2106809852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac145330 0x7f8eac0d0490 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00097a0 tx=0x7f8ea002a180 comp rx=0 tx=0).stop 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 -- 172.21.15.100:0/2106809852 shutdown_connections 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 --2- 172.21.15.100:0/2106809852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac145330 0x7f8eac0d0490 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 -- 172.21.15.100:0/2106809852 >> 172.21.15.100:0/2106809852 conn(0x7f8eac06c3d0 msgr2=0x7f8eac06c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 -- 172.21.15.100:0/2106809852 shutdown_connections 2024-05-09T05:05:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.843+0000 7f8eb3000640 1 -- 172.21.15.100:0/2106809852 wait complete. 2024-05-09T05:05:17.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.845+0000 7f8eb3000640 1 Processor -- start 2024-05-09T05:05:17.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.845+0000 7f8eb3000640 1 -- start start 2024-05-09T05:05:17.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb3000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8eac0b32a0 0x7f8eac15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb3000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8eac145330 0x7f8eac13d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb3000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 0x7f8eac13b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb3000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac0b5550 con 0x7f8eac13f150 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb3000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac0b53d0 con 0x7f8eac145330 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb3000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8eac15b320 con 0x7f8eac0b32a0 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb2600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 0x7f8eac13b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb2600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 0x7f8eac13b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38500/0 (socket says 172.21.15.100:38500) 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.846+0000 7f8eb2600640 1 -- 172.21.15.100:0/3773803730 learned_addr learned my addr 172.21.15.100:0/3773803730 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb1c00640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8eac0b32a0 0x7f8eac15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb2600640 1 -- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8eac0b32a0 msgr2=0x7f8eac15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb2600640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8eac0b32a0 0x7f8eac15ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb2600640 1 -- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8eac145330 msgr2=0x7f8eac13d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb1200640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8eac145330 0x7f8eac13d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb2600640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8eac145330 0x7f8eac13d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb2600640 1 -- 172.21.15.100:0/3773803730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac13a7f0 con 0x7f8eac13f150 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb1200640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8eac145330 0x7f8eac13d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb2600640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 0x7f8eac13b890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c6e0 tx=0x7f8ea400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4018070 con 0x7f8eac13f150 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4004d60 con 0x7f8eac13f150 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400a880 con 0x7f8eac13f150 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.847+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac13aad0 con 0x7f8eac13f150 2024-05-09T05:05:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.848+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac13b090 con 0x7f8eac13f150 2024-05-09T05:05:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.849+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eac06a630 con 0x7f8eac13f150 2024-05-09T05:05:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.850+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ea400aa20 con 0x7f8eac13f150 2024-05-09T05:05:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.851+0000 7f8ea9600640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8e8c076300 0x7f8e8c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.851+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f8ea4096650 con 0x7f8eac13f150 2024-05-09T05:05:17.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.851+0000 7f8eb1c00640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8e8c076300 0x7f8e8c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:17.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.852+0000 7f8eb1c00640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8e8c076300 0x7f8e8c0787c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0034000 tx=0x7f8ea002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:17.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:17.855+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ea4060300 con 0x7f8eac13f150 2024-05-09T05:05:18.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.067+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8eac0b46c0 con 0x7f8eac13f150 2024-05-09T05:05:18.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.645+0000 7f8ea9600640 1 -- 172.21.15.100:0/3773803730 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f8ea405fc00 con 0x7f8eac13f150 2024-05-09T05:05:18.646 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8e8c076300 msgr2=0x7f8e8c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8e8c076300 0x7f8e8c0787c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0034000 tx=0x7f8ea002e000 comp rx=0 tx=0).stop 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 msgr2=0x7f8eac13b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 0x7f8eac13b890 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c6e0 tx=0x7f8ea400cba0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 shutdown_connections 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8e8c076300 0x7f8e8c0787c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8eac13f150 0x7f8eac13b890 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8eac145330 0x7f8eac13d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 --2- 172.21.15.100:0/3773803730 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8eac0b32a0 0x7f8eac15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 >> 172.21.15.100:0/3773803730 conn(0x7f8eac06c3d0 msgr2=0x7f8eac0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 shutdown_connections 2024-05-09T05:05:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.649+0000 7f8eb3000640 1 -- 172.21.15.100:0/3773803730 wait complete. 2024-05-09T05:05:18.675 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T05:05:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.865+0000 7f1ebc000640 1 Processor -- start 2024-05-09T05:05:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.865+0000 7f1ebc000640 1 -- start start 2024-05-09T05:05:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.867+0000 7f1ebc000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1eb40b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.867+0000 7f1ebc000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb4168130 con 0x7f1eb406f7b0 2024-05-09T05:05:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.867+0000 7f1ebc000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb4073090 con 0x7f1eb41639e0 2024-05-09T05:05:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.867+0000 7f1ebc000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb406ffe0 con 0x7f1eb4163600 2024-05-09T05:05:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.867+0000 7f1eba000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1eb406f7b0 0x7f1eb4167a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54564/0 (socket says 172.21.15.100:54564) 2024-05-09T05:05:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.867+0000 7f1eba000640 1 -- 172.21.15.100:0/1083043110 learned_addr learned my addr 172.21.15.100:0/1083043110 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb9600640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1eb40b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530958146 0 0) 0x7f1eb4168130 con 0x7f1eb406f7b0 2024-05-09T05:05:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e9c003520 con 0x7f1eb406f7b0 2024-05-09T05:05:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 215223923 0 0) 0x7f1e9c003520 con 0x7f1eb406f7b0 2024-05-09T05:05:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 msgr2=0x7f1eb40b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1eb40b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 >> v1:172.21.15.133:6789/0 conn(0x7f1eb41639e0 legacy=0x7f1eb4167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb4070230 con 0x7f1eb406f7b0 2024-05-09T05:05:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f1eac001a70 con 0x7f1eb406f7b0 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 >> v1:172.21.15.100:6789/0 conn(0x7f1eb406f7b0 legacy=0x7f1eb4167a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1e9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1e9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c004d40 0x7f1e9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb406ffe0 con 0x7f1e9c0039e0 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c00ba70 con 0x7f1e9c004d40 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.868+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c00bc70 con 0x7f1eb4163600 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb9600640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1e9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb8c00640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1e9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb9600640 1 -- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 msgr2=0x7f1e9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb9600640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1e9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eba000640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c004d40 0x7f1e9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb9600640 1 -- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c004d40 msgr2=0x7f1e9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb9600640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c004d40 0x7f1e9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb9600640 1 -- 172.21.15.100:0/1083043110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c003520 con 0x7f1e9c0039e0 2024-05-09T05:05:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eb8c00640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb4163600 0x7f1e9c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.869+0000 7f1eba000640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e9c004d40 0x7f1e9c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:18.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.870+0000 7f1eb9600640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1e9c003dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009a90 tx=0x7f1e9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e6ef5a413d3a40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:18.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8036070 con 0x7f1e9c0039e0 2024-05-09T05:05:18.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea8031400 con 0x7f1e9c0039e0 2024-05-09T05:05:18.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1eb3e00640 1 -- 172.21.15.100:0/1083043110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8009690 con 0x7f1e9c0039e0 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1ebc000640 1 -- 172.21.15.100:0/1083043110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 msgr2=0x7f1e9c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1ebc000640 1 --2- 172.21.15.100:0/1083043110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1e9c003dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009a90 tx=0x7f1e9c005830 comp rx=0 tx=0).stop 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1eba000640 1 -- 172.21.15.100:0/1083043110 reap_dead start 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1ebc000640 1 -- 172.21.15.100:0/1083043110 shutdown_connections 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1ebc000640 1 -- 172.21.15.100:0/1083043110 >> 172.21.15.100:0/1083043110 conn(0x7f1eb40b2b40 msgr2=0x7f1eb40b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1ebc000640 1 -- 172.21.15.100:0/1083043110 shutdown_connections 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.871+0000 7f1ebc000640 1 -- 172.21.15.100:0/1083043110 wait complete. 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.873+0000 7f1ebc000640 1 Processor -- start 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.873+0000 7f1ebc000640 1 -- start start 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1ebc000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1eb415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1ebc000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb409ba10 0x7f1eb40b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1ebc000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb409be90 0x7f1eb40b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1ebc000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb4073630 con 0x7f1e9c0039e0 2024-05-09T05:05:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1ebc000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb406e310 con 0x7f1eb409be90 2024-05-09T05:05:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1ebc000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb40740f0 con 0x7f1eb409ba10 2024-05-09T05:05:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1eb9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1eb415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1eb9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1eb415d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38518/0 (socket says 172.21.15.100:38518) 2024-05-09T05:05:18.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.874+0000 7f1eb9600640 1 -- 172.21.15.100:0/3326514196 learned_addr learned my addr 172.21.15.100:0/3326514196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb9600640 1 -- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb409ba10 msgr2=0x7f1eb40b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eba000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb409be90 0x7f1eb40b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb8c00640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb409ba10 0x7f1eb40b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb9600640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb409ba10 0x7f1eb40b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb9600640 1 -- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb409be90 msgr2=0x7f1eb40b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb9600640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb409be90 0x7f1eb40b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb9600640 1 -- 172.21.15.100:0/3326514196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb409c3f0 con 0x7f1e9c0039e0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eba000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb409be90 0x7f1eb40b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.875+0000 7f1eb9600640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1eb415d140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8034040 tx=0x7f1ea8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.876+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8040020 con 0x7f1e9c0039e0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.876+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea8003bc0 con 0x7f1e9c0039e0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.876+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb409c6d0 con 0x7f1e9c0039e0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.876+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8036040 con 0x7f1e9c0039e0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.876+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb409d1d0 con 0x7f1e9c0039e0 2024-05-09T05:05:18.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.877+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb406a6d0 con 0x7f1e9c0039e0 2024-05-09T05:05:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.878+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1ea8043020 con 0x7f1e9c0039e0 2024-05-09T05:05:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.879+0000 7f1eb1600640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e94076300 0x7f1e940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.879+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f1ea80b7610 con 0x7f1e9c0039e0 2024-05-09T05:05:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.879+0000 7f1eb8c00640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e94076300 0x7f1e940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:18.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.880+0000 7f1eb8c00640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e94076300 0x7f1e940787c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1eb41fc8c0 tx=0x7f1ea0007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:18.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:18.884+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ea804a070 con 0x7f1e9c0039e0 2024-05-09T05:05:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.090+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1eb4072590 con 0x7f1e9c0039e0 2024-05-09T05:05:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.660+0000 7f1eb1600640 1 -- 172.21.15.100:0/3326514196 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f1ea80044e0 con 0x7f1e9c0039e0 2024-05-09T05:05:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-05-09T05:05:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.664+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e94076300 msgr2=0x7f1e940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.664+0000 7f1ebc000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e94076300 0x7f1e940787c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1eb41fc8c0 tx=0x7f1ea0007a40 comp rx=0 tx=0).stop 2024-05-09T05:05:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.664+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 msgr2=0x7f1eb415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:19.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.664+0000 7f1ebc000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1eb415d140 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8034040 tx=0x7f1ea8004730 comp rx=0 tx=0).stop 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.665+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 shutdown_connections 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.665+0000 7f1ebc000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1e94076300 0x7f1e940787c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.665+0000 7f1ebc000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb409be90 0x7f1eb40b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.665+0000 7f1ebc000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb409ba10 0x7f1eb40b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.665+0000 7f1ebc000640 1 --2- 172.21.15.100:0/3326514196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e9c0039e0 0x7f1eb415d140 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.665+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 >> 172.21.15.100:0/3326514196 conn(0x7f1eb40b2b40 msgr2=0x7f1eb40b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:19.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.666+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 shutdown_connections 2024-05-09T05:05:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.666+0000 7f1ebc000640 1 -- 172.21.15.100:0/3326514196 wait complete. 2024-05-09T05:05:19.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T05:05:19.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.869+0000 7fbde7600640 1 Processor -- start 2024-05-09T05:05:19.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.870+0000 7fbde7600640 1 -- start start 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde7600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 0x7fbde00b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde7600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbde00ae350 0x7fbde00ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde7600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde00cdd30 con 0x7fbde006f590 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde7600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fbde00ce010 con 0x7fbde00ae350 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde7600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fbde00ce2f0 con 0x7fbde015c640 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde4c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbde006f590 0x7fbde006f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54568/0 (socket says 172.21.15.100:54568) 2024-05-09T05:05:19.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.871+0000 7fbde4c00640 1 -- 172.21.15.100:0/1255836477 learned_addr learned my addr 172.21.15.100:0/1255836477 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddfe00640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 0x7fbde00b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804618597 0 0) 0x7fbde00cdd30 con 0x7fbde006f590 2024-05-09T05:05:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc4003520 con 0x7fbde006f590 2024-05-09T05:05:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbde5600640 1 --2- 172.21.15.100:0/1255836477 >> v2:172.21.15.133:3300/0 conn(0x7fbde00ae350 0x7fbde00ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3575437852 0 0) 0x7fbdc4003520 con 0x7fbde006f590 2024-05-09T05:05:19.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 msgr2=0x7fbde00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 0x7fbde00b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 >> v2:172.21.15.133:3300/0 conn(0x7fbde00ae350 msgr2=0x7fbde00ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 --2- 172.21.15.100:0/1255836477 >> v2:172.21.15.133:3300/0 conn(0x7fbde00ae350 0x7fbde00ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde00ce5d0 con 0x7fbde006f590 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fbdd00016f0 con 0x7fbde006f590 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 >> v1:172.21.15.100:6789/0 conn(0x7fbde006f590 legacy=0x7fbde006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdc4003a00 0x7fbdc4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 0x7fbdc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00ce010 con 0x7fbdc4004800 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00ce2f0 con 0x7fbdc4003a00 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.872+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc400baf0 con 0x7fbde015c640 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbddfe00640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbddfe00640 1 -- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 msgr2=0x7fbdc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbde5600640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 0x7fbdc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbde4c00640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdc4003a00 0x7fbdc4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbddfe00640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde015c640 0x7fbdc40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbddfe00640 1 -- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdc4003a00 msgr2=0x7fbdc4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbddfe00640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdc4003a00 0x7fbdc4003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.873+0000 7fbddfe00640 1 -- 172.21.15.100:0/1255836477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc4003520 con 0x7fbdc4004800 2024-05-09T05:05:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.874+0000 7fbddfe00640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009ac0 tx=0x7fbdc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994914303477104c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.874+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc036070 con 0x7fbdc4004800 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.874+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc031400 con 0x7fbdc4004800 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.874+0000 7fbddf400640 1 -- 172.21.15.100:0/1255836477 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc009690 con 0x7fbdc4004800 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde7600640 1 -- 172.21.15.100:0/1255836477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 msgr2=0x7fbdc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde7600640 1 --2- 172.21.15.100:0/1255836477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009ac0 tx=0x7fbdc4005830 comp rx=0 tx=0).stop 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde5600640 1 -- 172.21.15.100:0/1255836477 reap_dead start 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde7600640 1 -- 172.21.15.100:0/1255836477 shutdown_connections 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde7600640 1 -- 172.21.15.100:0/1255836477 >> 172.21.15.100:0/1255836477 conn(0x7fbde00b2c90 msgr2=0x7fbde00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde7600640 1 -- 172.21.15.100:0/1255836477 shutdown_connections 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.875+0000 7fbde7600640 1 -- 172.21.15.100:0/1255836477 wait complete. 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.877+0000 7fbde7600640 1 Processor -- start 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.877+0000 7fbde7600640 1 -- start start 2024-05-09T05:05:19.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbde015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde7600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde0073990 0x7fbde01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde7600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0073e10 0x7fbde015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00d07e0 con 0x7fbdc4004800 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde7600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00d0660 con 0x7fbde0073e10 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde7600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fbde00b4800 con 0x7fbde0073990 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbde015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbde015ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38538/0 (socket says 172.21.15.100:38538) 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 -- 172.21.15.100:0/631850901 learned_addr learned my addr 172.21.15.100:0/631850901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbddfe00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde0073990 0x7fbde01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 -- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde0073990 msgr2=0x7fbde01562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde0073990 0x7fbde01562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 -- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0073e10 msgr2=0x7fbde015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde5600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0073e10 0x7fbde015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0073e10 0x7fbde015b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.878+0000 7fbde4c00640 1 -- 172.21.15.100:0/631850901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde0074290 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.879+0000 7fbde4c00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbde015ea60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000d8b0 tx=0x7fbdd000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.879+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd00074e0 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.879+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd00047e0 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.879+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde015df80 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.879+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0004bb0 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.879+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde015e540 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.880+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde0069ff0 con 0x7fbdc4004800 2024-05-09T05:05:19.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.881+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbdd000b650 con 0x7fbdc4004800 2024-05-09T05:05:19.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.882+0000 7fbddcc00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbdc00762d0 0x7fbdc0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:19.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.883+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7fbdd00979b0 con 0x7fbdc4004800 2024-05-09T05:05:19.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.883+0000 7fbddfe00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbdc00762d0 0x7fbdc0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:19.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.883+0000 7fbddfe00640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbdc00762d0 0x7fbdc0078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc033000 tx=0x7fbdcc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:19.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:19.886+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbde0069ff0 con 0x7fbdc4004800 2024-05-09T05:05:20.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.138+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbde0150fd0 con 0x7fbdc4004800 2024-05-09T05:05:20.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.684+0000 7fbddcc00640 1 -- 172.21.15.100:0/631850901 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v14) ==== 172+0+0 (secure 0 0 0) 0x7fbdd0061450 con 0x7fbdc4004800 2024-05-09T05:05:20.690 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 4 and data pool 5 2024-05-09T05:05:20.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.696+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbdc00762d0 msgr2=0x7fbdc0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:20.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.696+0000 7fbde7600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbdc00762d0 0x7fbdc0078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc033000 tx=0x7fbdcc008030 comp rx=0 tx=0).stop 2024-05-09T05:05:20.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.696+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 msgr2=0x7fbde015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:20.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.696+0000 7fbde7600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbde015ea60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000d8b0 tx=0x7fbdd000dd70 comp rx=0 tx=0).stop 2024-05-09T05:05:20.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 shutdown_connections 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbdc00762d0 0x7fbdc0078790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbde0073e10 0x7fbde015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbde0073990 0x7fbde01562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 --2- 172.21.15.100:0/631850901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdc4004800 0x7fbde015ea60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 >> 172.21.15.100:0/631850901 conn(0x7fbde00b2c90 msgr2=0x7fbde00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.697+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 shutdown_connections 2024-05-09T05:05:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.698+0000 7fbde7600640 1 -- 172.21.15.100:0/631850901 wait complete. 2024-05-09T05:05:20.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:20.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.904+0000 7f6123800640 1 Processor -- start 2024-05-09T05:05:20.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.905+0000 7f6123800640 1 -- start start 2024-05-09T05:05:20.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f6123800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c15f590 0x7f611c0baba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:20.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f6123800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f611c0b45b0 0x7f611c0d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:20.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f6123800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f611c0d3710 con 0x7f611c0d4cf0 2024-05-09T05:05:20.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f6123800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f611c15f970 con 0x7f611c0b45b0 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f6123800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f611c0d4320 con 0x7f611c15f590 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f611be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f611c0b45b0 0x7f611c0d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f611be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f611c0b45b0 0x7f611c0d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38548/0 (socket says 172.21.15.100:38548) 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.906+0000 7f611be00640 1 -- 172.21.15.100:0/1736492634 learned_addr learned my addr 172.21.15.100:0/1736492634 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.907+0000 7f6120e00640 1 --2- 172.21.15.100:0/1736492634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c15f590 0x7f611c0baba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.907+0000 7f611be00640 1 -- 172.21.15.100:0/1736492634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c15f590 msgr2=0x7f611c0baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.907+0000 7f611be00640 1 --2- 172.21.15.100:0/1736492634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c15f590 0x7f611c0baba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.907+0000 7f611be00640 1 -- 172.21.15.100:0/1736492634 >> v1:172.21.15.133:6789/0 conn(0x7f611c0d4cf0 legacy=0x7f611c0b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.907+0000 7f611be00640 1 -- 172.21.15.100:0/1736492634 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c0d39f0 con 0x7f611c0b45b0 2024-05-09T05:05:20.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.908+0000 7f611be00640 1 --2- 172.21.15.100:0/1736492634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0b45b0 0x7f611c0d47b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6108009870 tx=0x7f610802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922eae6624befcf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:20.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.908+0000 7f611b400640 1 -- 172.21.15.100:0/1736492634 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108037070 con 0x7f611c0b45b0 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.908+0000 7f611b400640 1 -- 172.21.15.100:0/1736492634 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6108032440 con 0x7f611c0b45b0 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.908+0000 7f611b400640 1 -- 172.21.15.100:0/1736492634 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108032810 con 0x7f611c0b45b0 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 -- 172.21.15.100:0/1736492634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0b45b0 msgr2=0x7f611c0d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 --2- 172.21.15.100:0/1736492634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0b45b0 0x7f611c0d47b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6108009870 tx=0x7f610802a130 comp rx=0 tx=0).stop 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 -- 172.21.15.100:0/1736492634 shutdown_connections 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 --2- 172.21.15.100:0/1736492634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0b45b0 0x7f611c0d47b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 --2- 172.21.15.100:0/1736492634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c15f590 0x7f611c0baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 -- 172.21.15.100:0/1736492634 >> 172.21.15.100:0/1736492634 conn(0x7f611c074130 msgr2=0x7f611c0d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 -- 172.21.15.100:0/1736492634 shutdown_connections 2024-05-09T05:05:20.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.909+0000 7f6123800640 1 -- 172.21.15.100:0/1736492634 wait complete. 2024-05-09T05:05:20.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.911+0000 7f6123800640 1 Processor -- start 2024-05-09T05:05:20.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.911+0000 7f6123800640 1 -- start start 2024-05-09T05:05:20.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6123800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c0b45b0 0x7f611c162760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:20.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6123800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 0x7f611c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:20.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6123800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c15f590 0x7f611c1f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:20.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6123800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f611c0bb0e0 con 0x7f611c0d4cf0 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6123800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f611c0d3fb0 con 0x7f611c15f590 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6123800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f611c0b8ac0 con 0x7f611c0b45b0 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f611be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 0x7f611c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f611be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 0x7f611c15b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38558/0 (socket says 172.21.15.100:38558) 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f611be00640 1 -- 172.21.15.100:0/3584665557 learned_addr learned my addr 172.21.15.100:0/3584665557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6120e00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c0b45b0 0x7f611c162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.912+0000 7f6121800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c15f590 0x7f611c1f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f611be00640 1 -- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c0b45b0 msgr2=0x7f611c162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f611be00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c0b45b0 0x7f611c162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f611be00640 1 -- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c15f590 msgr2=0x7f611c1f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f611be00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c15f590 0x7f611c1f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f611be00640 1 -- 172.21.15.100:0/3584665557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c160f80 con 0x7f611c0d4cf0 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f6121800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c15f590 0x7f611c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:20.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f6120e00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c0b45b0 0x7f611c162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f611be00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 0x7f611c15b6f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6108009870 tx=0x7f61080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108041020 con 0x7f611c0d4cf0 2024-05-09T05:05:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6108030780 con 0x7f611c0d4cf0 2024-05-09T05:05:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108037040 con 0x7f611c0d4cf0 2024-05-09T05:05:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.913+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c0cd900 con 0x7f611c0d4cf0 2024-05-09T05:05:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.914+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c161260 con 0x7f611c0d4cf0 2024-05-09T05:05:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.915+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611c06a5c0 con 0x7f611c0d4cf0 2024-05-09T05:05:20.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.916+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6108044020 con 0x7f611c0d4cf0 2024-05-09T05:05:20.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.917+0000 7f6118c00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60fc0762d0 0x7f60fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.917+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f61080b7da0 con 0x7f611c0d4cf0 2024-05-09T05:05:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.917+0000 7f6120e00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60fc0762d0 0x7f60fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:20.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.918+0000 7f6120e00640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60fc0762d0 0x7f60fc078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6110006fd0 tx=0x7f6110008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:20.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:20.926+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f610804b030 con 0x7f611c0d4cf0 2024-05-09T05:05:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.124+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f611c0d1f10 con 0x7f611c0d4cf0 2024-05-09T05:05:21.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.126+0000 7f6118c00640 1 -- 172.21.15.100:0/3584665557 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16706 (secure 0 0 0) 0x7f61080816f0 con 0x7f611c0d4cf0 2024-05-09T05:05:21.128 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:21.128 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":31,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:20.140750+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:18.083878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:19.108109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60fc0762d0 msgr2=0x7f60fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60fc0762d0 0x7f60fc078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6110006fd0 tx=0x7f6110008040 comp rx=0 tx=0).stop 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 msgr2=0x7f611c15b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 0x7f611c15b6f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6108009870 tx=0x7f61080046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 shutdown_connections 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60fc0762d0 0x7f60fc078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f611c15f590 0x7f611c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f611c0d4cf0 0x7f611c15b6f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 --2- 172.21.15.100:0/3584665557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f611c0b45b0 0x7f611c162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 >> 172.21.15.100:0/3584665557 conn(0x7f611c074130 msgr2=0x7f611c0b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:21.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 shutdown_connections 2024-05-09T05:05:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.129+0000 7f6123800640 1 -- 172.21.15.100:0/3584665557 wait complete. 2024-05-09T05:05:21.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.325+0000 7fd427200640 1 Processor -- start 2024-05-09T05:05:21.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.325+0000 7fd427200640 1 -- start start 2024-05-09T05:05:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.326+0000 7fd427200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd4280b4530 0x7fd4280b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.326+0000 7fd427200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4280d2f80 con 0x7fd4280d3660 2024-05-09T05:05:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.326+0000 7fd427200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4280b51e0 con 0x7fd4280d2120 2024-05-09T05:05:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.326+0000 7fd427200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fd4280b6190 con 0x7fd4280b4530 2024-05-09T05:05:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.327+0000 7fd41fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd4280d3660 0x7fd4280d1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54574/0 (socket says 172.21.15.100:54574) 2024-05-09T05:05:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.327+0000 7fd41fe00640 1 -- 172.21.15.100:0/3349471505 learned_addr learned my addr 172.21.15.100:0/3349471505 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.327+0000 7fd425e00640 1 --2- 172.21.15.100:0/3349471505 >> v2:172.21.15.133:3300/0 conn(0x7fd4280b4530 0x7fd4280b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.327+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731386870 0 0) 0x7fd4280d2f80 con 0x7fd4280d3660 2024-05-09T05:05:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.327+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd40c003520 con 0x7fd4280d3660 2024-05-09T05:05:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2119550235 0 0) 0x7fd40c003520 con 0x7fd4280d3660 2024-05-09T05:05:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 >> v2:172.21.15.133:3300/0 conn(0x7fd4280b4530 msgr2=0x7fd4280b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 --2- 172.21.15.100:0/3349471505 >> v2:172.21.15.133:3300/0 conn(0x7fd4280b4530 0x7fd4280b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 >> v1:172.21.15.133:6789/0 conn(0x7fd4280d2120 legacy=0x7fd4280cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4280d25f0 con 0x7fd4280d3660 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fd4100016f0 con 0x7fd4280d3660 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 >> v1:172.21.15.100:6789/0 conn(0x7fd4280d3660 legacy=0x7fd4280d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40c003a50 0x7fd40c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c004800 0x7fd40c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0051c0 0x7fd40c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4280b6190 con 0x7fd40c003a50 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c00c160 con 0x7fd40c0051c0 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c00c360 con 0x7fd40c004800 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425e00640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40c003a50 0x7fd40c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd41fe00640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c004800 0x7fd40c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd425e00640 1 -- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c004800 msgr2=0x7fd40c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.328+0000 7fd426800640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0051c0 0x7fd40c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd425e00640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c004800 0x7fd40c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd425e00640 1 -- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0051c0 msgr2=0x7fd40c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd425e00640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0051c0 0x7fd40c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd425e00640 1 -- 172.21.15.100:0/3349471505 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c003520 con 0x7fd40c003a50 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd41fe00640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c004800 0x7fd40c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd426800640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0051c0 0x7fd40c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.329+0000 7fd426800640 1 -- 172.21.15.100:0/3349471505 reap_dead start 2024-05-09T05:05:21.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.330+0000 7fd425e00640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40c003a50 0x7fd40c003e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd418009ac0 tx=0x7fd40c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f22ae9ddf630dea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:21.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.330+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418036070 con 0x7fd40c003a50 2024-05-09T05:05:21.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.330+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd418031400 con 0x7fd40c003a50 2024-05-09T05:05:21.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.330+0000 7fd425400640 1 -- 172.21.15.100:0/3349471505 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418009690 con 0x7fd40c003a50 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.330+0000 7fd427200640 1 -- 172.21.15.100:0/3349471505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40c003a50 msgr2=0x7fd40c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.330+0000 7fd427200640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40c003a50 0x7fd40c003e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd418009ac0 tx=0x7fd40c005830 comp rx=0 tx=0).stop 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.331+0000 7fd427200640 1 -- 172.21.15.100:0/3349471505 shutdown_connections 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.331+0000 7fd427200640 1 --2- 172.21.15.100:0/3349471505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd40c003a50 0x7fd40c003e70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.331+0000 7fd427200640 1 -- 172.21.15.100:0/3349471505 >> 172.21.15.100:0/3349471505 conn(0x7fd42808eb30 msgr2=0x7fd42809e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.331+0000 7fd427200640 1 -- 172.21.15.100:0/3349471505 shutdown_connections 2024-05-09T05:05:21.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.331+0000 7fd427200640 1 -- 172.21.15.100:0/3349471505 wait complete. 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.332+0000 7fd427200640 1 Processor -- start 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.332+0000 7fd427200640 1 -- start start 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.333+0000 7fd427200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c003a50 0x7fd42815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.333+0000 7fd427200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 0x7fd4281e8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.333+0000 7fd427200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4280cd000 0x7fd4281e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.333+0000 7fd427200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4280d28d0 con 0x7fd4280ccb80 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.333+0000 7fd427200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd4280b5730 con 0x7fd4280cd000 2024-05-09T05:05:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.333+0000 7fd427200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd4280b4910 con 0x7fd40c003a50 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 0x7fd4281e8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 0x7fd4281e8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38568/0 (socket says 172.21.15.100:38568) 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 -- 172.21.15.100:0/715001246 learned_addr learned my addr 172.21.15.100:0/715001246 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd426800640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4280cd000 0x7fd4281e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd425e00640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c003a50 0x7fd42815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 -- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c003a50 msgr2=0x7fd42815ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c003a50 0x7fd42815ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 -- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4280cd000 msgr2=0x7fd4281e9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4280cd000 0x7fd4281e9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 -- 172.21.15.100:0/715001246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4280cd540 con 0x7fd4280ccb80 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41fe00640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 0x7fd4281e8cf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d900 tx=0x7fd41000ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.334+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4100074e0 con 0x7fd4280ccb80 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.335+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd410007680 con 0x7fd4280ccb80 2024-05-09T05:05:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.335+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4280cd820 con 0x7fd4280ccb80 2024-05-09T05:05:21.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.335+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4100049e0 con 0x7fd4280ccb80 2024-05-09T05:05:21.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.335+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4280cdde0 con 0x7fd4280ccb80 2024-05-09T05:05:21.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.336+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42806a550 con 0x7fd4280ccb80 2024-05-09T05:05:21.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.337+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd41001b020 con 0x7fd4280ccb80 2024-05-09T05:05:21.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.338+0000 7fd41e000640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4040762d0 0x7fd404078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.338+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd4100975c0 con 0x7fd4280ccb80 2024-05-09T05:05:21.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.338+0000 7fd425e00640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4040762d0 0x7fd404078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.339+0000 7fd425e00640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4040762d0 0x7fd404078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd418033000 tx=0x7fd418008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:21.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.346+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd410060ea0 con 0x7fd4280ccb80 2024-05-09T05:05:21.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.539+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4280b4bd0 con 0x7fd4280ccb80 2024-05-09T05:05:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.541+0000 7fd41e000640 1 -- 172.21.15.100:0/715001246 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16706 (secure 0 0 0) 0x7fd4100607a0 con 0x7fd4280ccb80 2024-05-09T05:05:21.543 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:21.543 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":31,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:20.140750+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:18.083878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:19.108109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4040762d0 msgr2=0x7fd404078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4040762d0 0x7fd404078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd418033000 tx=0x7fd418008030 comp rx=0 tx=0).stop 2024-05-09T05:05:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 msgr2=0x7fd4281e8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 0x7fd4281e8cf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d900 tx=0x7fd41000ddc0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 shutdown_connections 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4040762d0 0x7fd404078790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4280cd000 0x7fd4281e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4280ccb80 0x7fd4281e8cf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 --2- 172.21.15.100:0/715001246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd40c003a50 0x7fd42815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.543+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 >> 172.21.15.100:0/715001246 conn(0x7fd42808eb30 msgr2=0x7fd4280d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.544+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 shutdown_connections 2024-05-09T05:05:21.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.544+0000 7fd427200640 1 -- 172.21.15.100:0/715001246 wait complete. 2024-05-09T05:05:21.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T05:05:21.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.743+0000 7f79ca000640 1 Processor -- start 2024-05-09T05:05:21.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.743+0000 7f79ca000640 1 -- start start 2024-05-09T05:05:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.744+0000 7f79ca000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79c415f6f0 0x7f79c40d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.744+0000 7f79ca000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 0x7f79c40d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.744+0000 7f79ca000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c40d1240 con 0x7f79c40d1c10 2024-05-09T05:05:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.744+0000 7f79ca000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f79c40d2e90 con 0x7f79c415f6f0 2024-05-09T05:05:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.744+0000 7f79ca000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f79c40d3170 con 0x7f79c40d5e00 2024-05-09T05:05:21.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.745+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 0x7f79c40d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.745+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 0x7f79c40d3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:53066/0 (socket says 172.21.15.100:53066) 2024-05-09T05:05:21.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.745+0000 7f79c2a00640 1 -- 172.21.15.100:0/55832418 learned_addr learned my addr 172.21.15.100:0/55832418 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:21.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.745+0000 7f79c3400640 1 --2- 172.21.15.100:0/55832418 >> v2:172.21.15.133:3300/0 conn(0x7f79c415f6f0 0x7f79c40d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.746+0000 7f79c2a00640 1 -- 172.21.15.100:0/55832418 >> v2:172.21.15.133:3300/0 conn(0x7f79c415f6f0 msgr2=0x7f79c40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:21.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.746+0000 7f79c2a00640 1 --2- 172.21.15.100:0/55832418 >> v2:172.21.15.133:3300/0 conn(0x7f79c415f6f0 0x7f79c40d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.746+0000 7f79c2a00640 1 -- 172.21.15.100:0/55832418 >> v1:172.21.15.133:6789/0 conn(0x7f79c40d1c10 legacy=0x7f79c40b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.746+0000 7f79c2000640 1 -- 172.21.15.100:0/55832418 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343675240 0 0) 0x7f79c40d1240 con 0x7f79c40d1c10 2024-05-09T05:05:21.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.746+0000 7f79c2a00640 1 -- 172.21.15.100:0/55832418 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c40d3450 con 0x7f79c40d5e00 2024-05-09T05:05:21.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.748+0000 7f79c2a00640 1 --2- 172.21.15.100:0/55832418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 0x7f79c40d3c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009870 tx=0x7f79b002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ab9cfd14f2369b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:21.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79c2000640 1 -- 172.21.15.100:0/55832418 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0037070 con 0x7f79c40d5e00 2024-05-09T05:05:21.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79c2000640 1 -- 172.21.15.100:0/55832418 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b0032440 con 0x7f79c40d5e00 2024-05-09T05:05:21.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79c2000640 1 -- 172.21.15.100:0/55832418 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0032810 con 0x7f79c40d5e00 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 -- 172.21.15.100:0/55832418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 msgr2=0x7f79c40d3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 --2- 172.21.15.100:0/55832418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 0x7f79c40d3c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009870 tx=0x7f79b002a270 comp rx=0 tx=0).stop 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 -- 172.21.15.100:0/55832418 shutdown_connections 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 --2- 172.21.15.100:0/55832418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c40d5e00 0x7f79c40d3c50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 --2- 172.21.15.100:0/55832418 >> v2:172.21.15.133:3300/0 conn(0x7f79c415f6f0 0x7f79c40d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 -- 172.21.15.100:0/55832418 >> 172.21.15.100:0/55832418 conn(0x7f79c409e600 msgr2=0x7f79c40d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.749+0000 7f79ca000640 1 -- 172.21.15.100:0/55832418 shutdown_connections 2024-05-09T05:05:21.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.750+0000 7f79ca000640 1 -- 172.21.15.100:0/55832418 wait complete. 2024-05-09T05:05:21.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.751+0000 7f79ca000640 1 Processor -- start 2024-05-09T05:05:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.751+0000 7f79ca000640 1 -- start start 2024-05-09T05:05:21.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79ca000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c40d1c10 0x7f79c4154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79ca000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 0x7f79c40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79ca000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c415f6f0 0x7f79c415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79ca000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79c40d4190 con 0x7f79c40d5e00 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79ca000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f79c40d0f00 con 0x7f79c40d1c10 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79ca000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f79c41600a0 con 0x7f79c415f6f0 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 0x7f79c40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79c2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 0x7f79c40cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38576/0 (socket says 172.21.15.100:38576) 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.752+0000 7f79c2a00640 1 -- 172.21.15.100:0/840460417 learned_addr learned my addr 172.21.15.100:0/840460417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c3e00640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c415f6f0 0x7f79c415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c3400640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c40d1c10 0x7f79c4154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c2a00640 1 -- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c415f6f0 msgr2=0x7f79c415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c2a00640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c415f6f0 0x7f79c415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c2a00640 1 -- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c40d1c10 msgr2=0x7f79c4154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:21.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c2a00640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c40d1c10 0x7f79c4154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:21.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c2a00640 1 -- 172.21.15.100:0/840460417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c41602e0 con 0x7f79c40d5e00 2024-05-09T05:05:21.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.753+0000 7f79c2a00640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 0x7f79c40cdea0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79b002a2b0 tx=0x7f79b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:21.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.754+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0037040 con 0x7f79c40d5e00 2024-05-09T05:05:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.754+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b0042070 con 0x7f79c40d5e00 2024-05-09T05:05:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.754+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c41605c0 con 0x7f79c40d5e00 2024-05-09T05:05:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.754+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0030880 con 0x7f79c40d5e00 2024-05-09T05:05:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.754+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c4161900 con 0x7f79c40d5e00 2024-05-09T05:05:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.755+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c406a630 con 0x7f79c40d5e00 2024-05-09T05:05:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.756+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f79b0030a20 con 0x7f79c40d5e00 2024-05-09T05:05:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.757+0000 7f79bb400640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f79a40762d0 0x7f79a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.757+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f79b00b7e90 con 0x7f79c40d5e00 2024-05-09T05:05:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.757+0000 7f79c3400640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f79a40762d0 0x7f79a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.758+0000 7f79c3400640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f79a40762d0 0x7f79a4078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009a10 tx=0x7f79b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:21.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:21.761+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f79b0081760 con 0x7f79c40d5e00 2024-05-09T05:05:22.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.006+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f79c4163b60 con 0x7f79c40d5e00 2024-05-09T05:05:22.481 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-05-09T05:05:22.480+0000 7f6db9c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:05:22.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.704+0000 7f79bb400640 1 -- 172.21.15.100:0/840460417 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f79b0081060 con 0x7f79c40d5e00 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f79a40762d0 msgr2=0x7f79a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f79a40762d0 0x7f79a4078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f79b4009a10 tx=0x7f79b4008040 comp rx=0 tx=0).stop 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 msgr2=0x7f79c40cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 0x7f79c40cdea0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79b002a2b0 tx=0x7f79b00046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 shutdown_connections 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f79a40762d0 0x7f79a4078790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f79c415f6f0 0x7f79c415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c40d5e00 0x7f79c40cdea0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 --2- 172.21.15.100:0/840460417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c40d1c10 0x7f79c4154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 >> 172.21.15.100:0/840460417 conn(0x7f79c409e600 msgr2=0x7f79c40b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:22.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.708+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 shutdown_connections 2024-05-09T05:05:22.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.709+0000 7f79ca000640 1 -- 172.21.15.100:0/840460417 wait complete. 2024-05-09T05:05:22.732 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-09T05:05:22.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T05:05:22.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.935+0000 7fcbb7c00640 1 Processor -- start 2024-05-09T05:05:22.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.936+0000 7fcbb7c00640 1 -- start start 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.937+0000 7fcbb7c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbb00b02a0 0x7fcbb00cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbb7c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb0160ba0 con 0x7fcbb00b0750 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbb7c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbb015d590 con 0x7fcbb015d1b0 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbb7c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcbb015ff90 con 0x7fcbb00b02a0 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbafe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbb00b02a0 0x7fcbb00cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbb5c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcbb00b0750 0x7fcbb0163510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33402/0 (socket says 172.21.15.100:33402) 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbb5c00640 1 -- 172.21.15.100:0/1107398419 learned_addr learned my addr 172.21.15.100:0/1107398419 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbafe00640 1 -- 172.21.15.100:0/1107398419 >> v1:172.21.15.133:6789/0 conn(0x7fcbb015d1b0 legacy=0x7fcbb00b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbafe00640 1 -- 172.21.15.100:0/1107398419 >> v1:172.21.15.100:6789/0 conn(0x7fcbb00b0750 legacy=0x7fcbb0163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:22.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbafe00640 1 -- 172.21.15.100:0/1107398419 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb0160270 con 0x7fcbb00b02a0 2024-05-09T05:05:22.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.938+0000 7fcbaf400640 1 -- 172.21.15.100:0/1107398419 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253932656 0 0) 0x7fcbb0160ba0 con 0x7fcbb00b0750 2024-05-09T05:05:22.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.940+0000 7fcbafe00640 1 --2- 172.21.15.100:0/1107398419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b02a0 0x7fcbb00cff00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcb980097a0 tx=0x7fcb9802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e57f62e48685c50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:22.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.940+0000 7fcbaf400640 1 -- 172.21.15.100:0/1107398419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98037070 con 0x7fcbb00b02a0 2024-05-09T05:05:22.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.940+0000 7fcbaf400640 1 -- 172.21.15.100:0/1107398419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9802ae50 con 0x7fcbb00b02a0 2024-05-09T05:05:22.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.940+0000 7fcbaf400640 1 -- 172.21.15.100:0/1107398419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98032660 con 0x7fcbb00b02a0 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 -- 172.21.15.100:0/1107398419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b02a0 msgr2=0x7fcbb00cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/1107398419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b02a0 0x7fcbb00cff00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcb980097a0 tx=0x7fcb9802a100 comp rx=0 tx=0).stop 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 -- 172.21.15.100:0/1107398419 shutdown_connections 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/1107398419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b02a0 0x7fcbb00cff00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 -- 172.21.15.100:0/1107398419 >> 172.21.15.100:0/1107398419 conn(0x7fcbb00b2c90 msgr2=0x7fcbb00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 -- 172.21.15.100:0/1107398419 shutdown_connections 2024-05-09T05:05:22.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.941+0000 7fcbb7c00640 1 -- 172.21.15.100:0/1107398419 wait complete. 2024-05-09T05:05:22.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.943+0000 7fcbb7c00640 1 Processor -- start 2024-05-09T05:05:22.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.943+0000 7fcbb7c00640 1 -- start start 2024-05-09T05:05:22.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbb7c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbb00b02a0 0x7fcbb01f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:22.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbb7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 0x7fcbb00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbb7c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbb015d1b0 0x7fcbb00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbb7c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb015fc10 con 0x7fcbb00b0750 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbb7c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb0160830 con 0x7fcbb015d1b0 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbb7c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb00d0440 con 0x7fcbb00b02a0 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbafe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 0x7fcbb00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbafe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 0x7fcbb00ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34062/0 (socket says 172.21.15.100:34062) 2024-05-09T05:05:22.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbafe00640 1 -- 172.21.15.100:0/3598226452 learned_addr learned my addr 172.21.15.100:0/3598226452 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:22.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbafe00640 1 -- 172.21.15.100:0/3598226452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbb00b02a0 msgr2=0x7fcbb01f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:22.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.944+0000 7fcbafe00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbb00b02a0 0x7fcbb01f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbafe00640 1 -- 172.21.15.100:0/3598226452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbb015d1b0 msgr2=0x7fcbb00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbafe00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbb015d1b0 0x7fcbb00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbafe00640 1 -- 172.21.15.100:0/3598226452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb00cc1b0 con 0x7fcbb00b0750 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbafe00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 0x7fcbb00ccd30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcb98000c00 tx=0x7fcb980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98037040 con 0x7fcbb00b0750 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb98004030 con 0x7fcbb00b0750 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98006e10 con 0x7fcbb00b0750 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb01f5af0 con 0x7fcbb00b0750 2024-05-09T05:05:22.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.945+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb01f60b0 con 0x7fcbb00b0750 2024-05-09T05:05:22.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.946+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb006a630 con 0x7fcbb00b0750 2024-05-09T05:05:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.947+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcb9803d650 con 0x7fcbb00b0750 2024-05-09T05:05:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.949+0000 7fcbacc00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb8c0762d0 0x7fcb8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:22.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.949+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fcb980b7ee0 con 0x7fcbb00b0750 2024-05-09T05:05:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.949+0000 7fcbb5200640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb8c0762d0 0x7fcb8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:22.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.950+0000 7fcbb5200640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb8c0762d0 0x7fcb8c078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcba00043c0 tx=0x7fcba0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:22.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:22.954+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcb98042020 con 0x7fcbb00b0750 2024-05-09T05:05:23.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.196+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcbb00b3280 con 0x7fcbb00b0750 2024-05-09T05:05:23.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.717+0000 7fcbacc00640 1 -- 172.21.15.100:0/3598226452 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fcb980817a0 con 0x7fcbb00b0750 2024-05-09T05:05:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.720+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb8c0762d0 msgr2=0x7fcb8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.720+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb8c0762d0 0x7fcb8c078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcba00043c0 tx=0x7fcba0007d30 comp rx=0 tx=0).stop 2024-05-09T05:05:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.720+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 msgr2=0x7fcbb00ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.720+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 0x7fcbb00ccd30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcb98000c00 tx=0x7fcb980046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 shutdown_connections 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fcb8c0762d0 0x7fcb8c078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbb015d1b0 0x7fcbb00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb00b0750 0x7fcbb00ccd30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 --2- 172.21.15.100:0/3598226452 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcbb00b02a0 0x7fcbb01f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 >> 172.21.15.100:0/3598226452 conn(0x7fcbb00b2c90 msgr2=0x7fcbb00cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:23.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 shutdown_connections 2024-05-09T05:05:23.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.721+0000 7fcbb7c00640 1 -- 172.21.15.100:0/3598226452 wait complete. 2024-05-09T05:05:23.744 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T05:05:23.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:23.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.938+0000 7ff5d7600640 1 Processor -- start 2024-05-09T05:05:23.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.939+0000 7ff5d7600640 1 -- start start 2024-05-09T05:05:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.940+0000 7ff5d7600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 0x7ff5d00b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.940+0000 7ff5d7600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d00b55b0 con 0x7ff5d00afb70 2024-05-09T05:05:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.940+0000 7ff5d7600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d00ae3a0 con 0x7ff5d00d0a70 2024-05-09T05:05:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.940+0000 7ff5d7600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d00b4590 con 0x7ff5d00ade90 2024-05-09T05:05:23.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.941+0000 7ff5d5600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff5d00afb70 0x7ff5d00affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33408/0 (socket says 172.21.15.100:33408) 2024-05-09T05:05:23.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.941+0000 7ff5d5600640 1 -- 172.21.15.100:0/2802279862 learned_addr learned my addr 172.21.15.100:0/2802279862 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:23.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.941+0000 7ff5cfe00640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 0x7ff5d00b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.941+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824880493 0 0) 0x7ff5c8001490 con 0x7ff5d00afb70 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.941+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5b8003520 con 0x7ff5d00afb70 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 830270428 0 0) 0x7ff5b8003520 con 0x7ff5d00afb70 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 msgr2=0x7ff5d00b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 0x7ff5d00b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 >> v1:172.21.15.133:6789/0 conn(0x7ff5d00d0a70 legacy=0x7ff5d015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d00b4870 con 0x7ff5d00afb70 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7ff5c8001c40 con 0x7ff5d00afb70 2024-05-09T05:05:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 >> v1:172.21.15.100:6789/0 conn(0x7ff5d00afb70 legacy=0x7ff5d00affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8003a30 0x7ff5b8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 0x7ff5b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5b8004d40 0x7ff5b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00b4590 con 0x7ff5b8003a30 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b800baa0 con 0x7ff5b8004d40 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b800bca0 con 0x7ff5d00ade90 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8003a30 0x7ff5b8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.942+0000 7ff5cfe00640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 0x7ff5b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d4c00640 1 -- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 msgr2=0x7ff5b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d00ade90 0x7ff5b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d5600640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5b8004d40 0x7ff5b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d4c00640 1 -- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5b8004d40 msgr2=0x7ff5b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5b8004d40 0x7ff5b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d4c00640 1 -- 172.21.15.100:0/2802279862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d00b4870 con 0x7ff5b8003a30 2024-05-09T05:05:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.943+0000 7ff5d5600640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5b8004d40 0x7ff5b80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.944+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8003a30 0x7ff5b8003e50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4001760 tx=0x7ff5b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac2ebab9af1913c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.944+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40013b0 con 0x7ff5b8003a30 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.944+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c40052d0 con 0x7ff5b8003a30 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.944+0000 7ff5cf400640 1 -- 172.21.15.100:0/2802279862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c402aaa0 con 0x7ff5b8003a30 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d7600640 1 -- 172.21.15.100:0/2802279862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8003a30 msgr2=0x7ff5b8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d7600640 1 --2- 172.21.15.100:0/2802279862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5b8003a30 0x7ff5b8003e50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4001760 tx=0x7ff5b8005830 comp rx=0 tx=0).stop 2024-05-09T05:05:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d5600640 1 -- 172.21.15.100:0/2802279862 reap_dead start 2024-05-09T05:05:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d7600640 1 -- 172.21.15.100:0/2802279862 shutdown_connections 2024-05-09T05:05:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d7600640 1 -- 172.21.15.100:0/2802279862 >> 172.21.15.100:0/2802279862 conn(0x7ff5d00b31e0 msgr2=0x7ff5d00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d7600640 1 -- 172.21.15.100:0/2802279862 shutdown_connections 2024-05-09T05:05:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.945+0000 7ff5d7600640 1 -- 172.21.15.100:0/2802279862 wait complete. 2024-05-09T05:05:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.947+0000 7ff5d7600640 1 Processor -- start 2024-05-09T05:05:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.947+0000 7ff5d7600640 1 -- start start 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d7600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5b8003a30 0x7ff5d01f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d7600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d01e73d0 0x7ff5d01e7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 0x7ff5d01e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00b5070 con 0x7ff5d01e5d70 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d7600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00ae680 con 0x7ff5d01e73d0 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d7600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d00b51f0 con 0x7ff5b8003a30 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 0x7ff5d01e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 0x7ff5d01e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34080/0 (socket says 172.21.15.100:34080) 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 -- 172.21.15.100:0/3212533766 learned_addr learned my addr 172.21.15.100:0/3212533766 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5b8003a30 0x7ff5d01f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5cfe00640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d01e73d0 0x7ff5d01e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 -- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5b8003a30 msgr2=0x7ff5d01f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5b8003a30 0x7ff5d01f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 -- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d01e73d0 msgr2=0x7ff5d01e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.948+0000 7ff5d5600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d01e73d0 0x7ff5d01e7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5d5600640 1 -- 172.21.15.100:0/3212533766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d01e6e20 con 0x7ff5d01e5d70 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5d5600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 0x7ff5d01e61d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000f80 tx=0x7ff5c800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800bb80 con 0x7ff5d01e5d70 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c800bd40 con 0x7ff5d01e5d70 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80072b0 con 0x7ff5d01e5d70 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d01e6b40 con 0x7ff5d01e5d70 2024-05-09T05:05:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.949+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d015dbb0 con 0x7ff5d01e5d70 2024-05-09T05:05:23.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.950+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d0076070 con 0x7ff5d01e5d70 2024-05-09T05:05:23.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.952+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff5c801b020 con 0x7ff5d01e5d70 2024-05-09T05:05:23.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.953+0000 7ff5ccc00640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5b00762d0 0x7ff5b0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.953+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff5c80978e0 con 0x7ff5d01e5d70 2024-05-09T05:05:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.953+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5b00762d0 0x7ff5b0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:23.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.954+0000 7ff5d4c00640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5b00762d0 0x7ff5b0078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4032000 tx=0x7ff5c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:23.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:23.958+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff5d00b55b0 con 0x7ff5d01e5d70 2024-05-09T05:05:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.203+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5d00d05e0 con 0x7ff5d01e5d70 2024-05-09T05:05:24.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.204+0000 7ff5ccc00640 1 -- 172.21.15.100:0/3212533766 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5193 (secure 0 0 0) 0x7ff5c80611a0 con 0x7ff5d01e5d70 2024-05-09T05:05:24.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:24.206 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:23.198643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:24.206 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-05-09T05:05:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5b00762d0 msgr2=0x7ff5b0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5b00762d0 0x7ff5b0078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4032000 tx=0x7ff5c402e000 comp rx=0 tx=0).stop 2024-05-09T05:05:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 msgr2=0x7ff5d01e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 0x7ff5d01e61d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8000f80 tx=0x7ff5c800b4a0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 shutdown_connections 2024-05-09T05:05:24.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff5b00762d0 0x7ff5b0078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d01e5d70 0x7ff5d01e61d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d01e73d0 0x7ff5d01e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 --2- 172.21.15.100:0/3212533766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5b8003a30 0x7ff5d01f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 >> 172.21.15.100:0/3212533766 conn(0x7ff5d00b31e0 msgr2=0x7ff5d0072570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 shutdown_connections 2024-05-09T05:05:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.207+0000 7ff5d7600640 1 -- 172.21.15.100:0/3212533766 wait complete. 2024-05-09T05:05:24.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:24.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.425+0000 7f858b000640 1 Processor -- start 2024-05-09T05:05:24.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.425+0000 7f858b000640 1 -- start start 2024-05-09T05:05:24.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.426+0000 7f858b000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8584161730 0x7f85840cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.426+0000 7f858b000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85840ce580 con 0x7f85840ce160 2024-05-09T05:05:24.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.426+0000 7f858b000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8584143af0 con 0x7f8584143710 2024-05-09T05:05:24.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.426+0000 7f858b000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f8584160ce0 con 0x7f8584161730 2024-05-09T05:05:24.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.426+0000 7f858a600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f85840ce160 0x7f85840cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33412/0 (socket says 172.21.15.100:33412) 2024-05-09T05:05:24.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.426+0000 7f858a600640 1 -- 172.21.15.100:0/90438732 learned_addr learned my addr 172.21.15.100:0/90438732 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8589200640 1 --2- 172.21.15.100:0/90438732 >> v2:172.21.15.133:3300/0 conn(0x7f8584161730 0x7f85840cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020647290 0 0) 0x7f85840ce580 con 0x7f85840ce160 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f856c003520 con 0x7f85840ce160 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1517613422 0 0) 0x7f856c003520 con 0x7f85840ce160 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 >> v2:172.21.15.133:3300/0 conn(0x7f8584161730 msgr2=0x7f85840cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 --2- 172.21.15.100:0/90438732 >> v2:172.21.15.133:3300/0 conn(0x7f8584161730 0x7f85840cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 >> v1:172.21.15.133:6789/0 conn(0x7f8584143710 legacy=0x7f858415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858415e240 con 0x7f85840ce160 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f857c001a70 con 0x7f85840ce160 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 >> v1:172.21.15.100:6789/0 conn(0x7f85840ce160 legacy=0x7f85840cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c003a50 0x7f856c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f856c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f856c0052e0 0x7f856c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8584160ce0 con 0x7f856c004800 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f856c00c1b0 con 0x7f856c003a50 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f856c00c3b0 con 0x7f856c0052e0 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.427+0000 7f8589200640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f856c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f8589c00640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c003a50 0x7f856c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f858a600640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f856c0052e0 0x7f856c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f8589200640 1 -- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f856c0052e0 msgr2=0x7f856c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f8589200640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f856c0052e0 0x7f856c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f8589200640 1 -- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c003a50 msgr2=0x7f856c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f8589200640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c003a50 0x7f856c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f8589200640 1 -- 172.21.15.100:0/90438732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c003520 con 0x7f856c004800 2024-05-09T05:05:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.428+0000 7f858a600640 1 -- 172.21.15.100:0/90438732 reap_dead start 2024-05-09T05:05:24.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.429+0000 7f8589200640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f856c004c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8570009a70 tx=0x7f856c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d739c892485a5f1b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.429+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570036070 con 0x7f856c004800 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.429+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8570031400 con 0x7f856c004800 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.429+0000 7f8583e00640 1 -- 172.21.15.100:0/90438732 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570009670 con 0x7f856c004800 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 -- 172.21.15.100:0/90438732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 msgr2=0x7f856c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f856c004c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8570009a70 tx=0x7f856c005830 comp rx=0 tx=0).stop 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 -- 172.21.15.100:0/90438732 shutdown_connections 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 --2- 172.21.15.100:0/90438732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f856c004c80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 -- 172.21.15.100:0/90438732 >> 172.21.15.100:0/90438732 conn(0x7f858406c7f0 msgr2=0x7f858406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 -- 172.21.15.100:0/90438732 shutdown_connections 2024-05-09T05:05:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.430+0000 7f858b000640 1 -- 172.21.15.100:0/90438732 wait complete. 2024-05-09T05:05:24.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.432+0000 7f858b000640 1 Processor -- start 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.432+0000 7f858b000640 1 -- start start 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f858b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f8584146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f858b000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858413e760 0x7f858413ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f858b000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f858413d540 0x7f8584140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f858b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8584161210 con 0x7f856c004800 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f858b000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8584160f30 con 0x7f858413e760 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f858b000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8584072490 con 0x7f858413d540 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f8584146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f8584146350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34090/0 (socket says 172.21.15.100:34090) 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 -- 172.21.15.100:0/1402941953 learned_addr learned my addr 172.21.15.100:0/1402941953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 -- 172.21.15.100:0/1402941953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f858413d540 msgr2=0x7f8584140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f858413d540 0x7f8584140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 -- 172.21.15.100:0/1402941953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858413e760 msgr2=0x7f858413ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858413e760 0x7f858413ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.433+0000 7f8589c00640 1 -- 172.21.15.100:0/1402941953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858413ec20 con 0x7f856c004800 2024-05-09T05:05:24.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.434+0000 7f8589c00640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f8584146350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f857800e550 tx=0x7f857800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.434+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85780052e0 con 0x7f856c004800 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.434+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578005480 con 0x7f856c004800 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.434+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8578007020 con 0x7f856c004800 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.434+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8584145870 con 0x7f856c004800 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.434+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85841540a0 con 0x7f856c004800 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.435+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858406a550 con 0x7f856c004800 2024-05-09T05:05:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.436+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f857801a020 con 0x7f856c004800 2024-05-09T05:05:24.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.437+0000 7f8581600640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.437+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8578096bf0 con 0x7f856c004800 2024-05-09T05:05:24.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.438+0000 7f8589200640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.438+0000 7f8589200640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8570033000 tx=0x7f857002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.442+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85780605e0 con 0x7f856c004800 2024-05-09T05:05:24.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.648+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f858406fc30 con 0x7f856c004800 2024-05-09T05:05:24.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.652+0000 7f8581600640 1 -- 172.21.15.100:0/1402941953 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16693 (secure 0 0 0) 0x7f857805fee0 con 0x7f856c004800 2024-05-09T05:05:24.654 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:24.654 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:21.682766+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:18.083878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:19.108109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 msgr2=0x7f8564078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8570033000 tx=0x7f857002e000 comp rx=0 tx=0).stop 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 msgr2=0x7f8584146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f8584146350 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f857800e550 tx=0x7f857800ea10 comp rx=0 tx=0).stop 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 shutdown_connections 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f85640762d0 0x7f8564078790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f858413d540 0x7f8584140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f858413e760 0x7f858413ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 --2- 172.21.15.100:0/1402941953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f856c004800 0x7f8584146350 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 >> 172.21.15.100:0/1402941953 conn(0x7f858406c7f0 msgr2=0x7f858415f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 shutdown_connections 2024-05-09T05:05:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.655+0000 7f858b000640 1 -- 172.21.15.100:0/1402941953 wait complete. 2024-05-09T05:05:24.676 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:05:24.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:05:24.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.875+0000 7f7522000640 1 Processor -- start 2024-05-09T05:05:24.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.875+0000 7f7522000640 1 -- start start 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f7522000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 0x7f751c16a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f7522000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751c163200 con 0x7f751c162e20 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f7522000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751c0b3180 con 0x7f751c0b44e0 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f7522000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f751c0b2f30 con 0x7f751c06eb30 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f751b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f751c162e20 0x7f751c0d3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33426/0 (socket says 172.21.15.100:33426) 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f751b400640 1 -- 172.21.15.100:0/1653552766 learned_addr learned my addr 172.21.15.100:0/1653552766 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744217734 0 0) 0x7f751c163200 con 0x7f751c162e20 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7500003520 con 0x7f751c162e20 2024-05-09T05:05:24.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.877+0000 7f751be00640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 0x7f751c16a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2721880413 0 0) 0x7f7500003520 con 0x7f751c162e20 2024-05-09T05:05:24.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 msgr2=0x7f751c16a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 0x7f751c16a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 >> v1:172.21.15.133:6789/0 conn(0x7f751c0b44e0 legacy=0x7f751c06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c0b3460 con 0x7f751c162e20 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f750c0016f0 con 0x7f751c162e20 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 >> v1:172.21.15.100:6789/0 conn(0x7f751c162e20 legacy=0x7f751c0d3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7500003ad0 0x7f7500003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 0x7f7500004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7500004e60 0x7f750000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f751c0b2f30 con 0x7f7500003ad0 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7500005540 con 0x7f7500004e60 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f750000bf00 con 0x7f751c06eb30 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.878+0000 7f751b400640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7500003ad0 0x7f7500003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751aa00640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 0x7f7500004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751be00640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7500004e60 0x7f750000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751b400640 1 -- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 msgr2=0x7f7500004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751b400640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f751c06eb30 0x7f7500004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751b400640 1 -- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7500004e60 msgr2=0x7f750000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751b400640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7500004e60 0x7f750000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.879+0000 7f751b400640 1 -- 172.21.15.100:0/1653552766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7500003520 con 0x7f7500003ad0 2024-05-09T05:05:24.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.880+0000 7f751b400640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7500003ad0 0x7f7500003ef0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c190 tx=0x7f7500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3570f78ec1567674 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.880+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c007c80 con 0x7f7500003ad0 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.880+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c005ad0 con 0x7f7500003ad0 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.880+0000 7f751a000640 1 -- 172.21.15.100:0/1653552766 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c007070 con 0x7f7500003ad0 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f7522000640 1 -- 172.21.15.100:0/1653552766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7500003ad0 msgr2=0x7f7500003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f7522000640 1 --2- 172.21.15.100:0/1653552766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7500003ad0 0x7f7500003ef0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c190 tx=0x7f7500005830 comp rx=0 tx=0).stop 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f751be00640 1 -- 172.21.15.100:0/1653552766 reap_dead start 2024-05-09T05:05:24.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f7522000640 1 -- 172.21.15.100:0/1653552766 shutdown_connections 2024-05-09T05:05:24.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f7522000640 1 -- 172.21.15.100:0/1653552766 >> 172.21.15.100:0/1653552766 conn(0x7f751c09e630 msgr2=0x7f751c0d5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:24.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f7522000640 1 -- 172.21.15.100:0/1653552766 shutdown_connections 2024-05-09T05:05:24.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.881+0000 7f7522000640 1 -- 172.21.15.100:0/1653552766 wait complete. 2024-05-09T05:05:24.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.883+0000 7f7522000640 1 Processor -- start 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.883+0000 7f7522000640 1 -- start start 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f7522000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7500003ad0 0x7f751c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f7522000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 0x7f751c0bab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f7522000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c0d0d00 0x7f751c0d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f7522000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f751c06ef60 con 0x7f751c0ca750 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f7522000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f751c0b3a20 con 0x7f751c0d0d00 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f7522000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f751c06f0e0 con 0x7f7500003ad0 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f751aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 0x7f751c0bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f751aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 0x7f751c0bab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34108/0 (socket says 172.21.15.100:34108) 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.884+0000 7f751aa00640 1 -- 172.21.15.100:0/1593200454 learned_addr learned my addr 172.21.15.100:0/1593200454 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751b400640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7500003ad0 0x7f751c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751aa00640 1 -- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7500003ad0 msgr2=0x7f751c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751be00640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c0d0d00 0x7f751c0d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751aa00640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7500003ad0 0x7f751c15d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751aa00640 1 -- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c0d0d00 msgr2=0x7f751c0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751aa00640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c0d0d00 0x7f751c0d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751aa00640 1 -- 172.21.15.100:0/1593200454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c1f5190 con 0x7f751c0ca750 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751be00640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c0d0d00 0x7f751c0d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f751aa00640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 0x7f751c0bab70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f750800e580 tx=0x7f750800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75080052e0 con 0x7f751c0ca750 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7508005480 con 0x7f751c0ca750 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508007020 con 0x7f751c0ca750 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.885+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c1f5450 con 0x7f751c0ca750 2024-05-09T05:05:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.886+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c1f5a10 con 0x7f751c0ca750 2024-05-09T05:05:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.887+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c1f60d0 con 0x7f751c0ca750 2024-05-09T05:05:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.888+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f750801a020 con 0x7f751c0ca750 2024-05-09T05:05:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.889+0000 7f7513400640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f74fc0762d0 0x7f74fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.889+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7508096dc0 con 0x7f751c0ca750 2024-05-09T05:05:24.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.889+0000 7f751b400640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f74fc0762d0 0x7f74fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:24.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.890+0000 7f751b400640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f74fc0762d0 0x7f74fc078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f750c032000 tx=0x7f750c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:24.893+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f751c1f60d0 con 0x7f751c0ca750 2024-05-09T05:05:25.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.080+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f751c06a5c0 con 0x7f74fc0762d0 2024-05-09T05:05:25.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.092+0000 7f7513400640 1 -- 172.21.15.100:0/1593200454 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251914 (secure 0 0 0) 0x7f751c06a5c0 con 0x7f74fc0762d0 2024-05-09T05:05:25.096 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:25.098 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.096+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f74fc0762d0 msgr2=0x7f74fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.096+0000 7f7522000640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f74fc0762d0 0x7f74fc078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f750c032000 tx=0x7f750c009030 comp rx=0 tx=0).stop 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.096+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 msgr2=0x7f751c0bab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.096+0000 7f7522000640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 0x7f751c0bab70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f750800e580 tx=0x7f750800ea40 comp rx=0 tx=0).stop 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 shutdown_connections 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f74fc0762d0 0x7f74fc078790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c0d0d00 0x7f751c0d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f751c0ca750 0x7f751c0bab70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 --2- 172.21.15.100:0/1593200454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7500003ad0 0x7f751c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 >> 172.21.15.100:0/1593200454 conn(0x7f751c09e630 msgr2=0x7f751c161e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 shutdown_connections 2024-05-09T05:05:25.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.097+0000 7f7522000640 1 -- 172.21.15.100:0/1593200454 wait complete. 2024-05-09T05:05:25.114 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-09T05:05:23.899433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220164,"kb_used_data":3968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754556,"statfs":{"total":773094113280,"available":772868665344,"internally_reserved":0,"allocated":4063232,"data_stored":2266476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.251101"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.715824+0000","last_change":"2024-05-09T05:05:20.712280+0000","last_active":"2024-05-09T05:05:20.715824+0000","last_peered":"2024-05-09T05:05:20.715824+0000","last_clean":"2024-05-09T05:05:20.715824+0000","last_became_active":"2024-05-09T05:05:20.711994+0000","last_became_peered":"2024-05-09T05:05:20.711994+0000","last_unstale":"2024-05-09T05:05:20.715824+0000","last_undegraded":"2024-05-09T05:05:20.715824+0000","last_fullsized":"2024-05-09T05:05:20.715824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:20.928452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705030+0000","last_change":"2024-05-09T05:05:20.697871+0000","last_active":"2024-05-09T05:05:21.705030+0000","last_peered":"2024-05-09T05:05:21.705030+0000","last_clean":"2024-05-09T05:05:21.705030+0000","last_became_active":"2024-05-09T05:05:20.697547+0000","last_became_peered":"2024-05-09T05:05:20.697547+0000","last_unstale":"2024-05-09T05:05:21.705030+0000","last_undegraded":"2024-05-09T05:05:21.705030+0000","last_fullsized":"2024-05-09T05:05:21.705030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:46.526610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705056+0000","last_change":"2024-05-09T05:05:20.693844+0000","last_active":"2024-05-09T05:05:21.705056+0000","last_peered":"2024-05-09T05:05:21.705056+0000","last_clean":"2024-05-09T05:05:21.705056+0000","last_became_active":"2024-05-09T05:05:20.693525+0000","last_became_peered":"2024-05-09T05:05:20.693525+0000","last_unstale":"2024-05-09T05:05:21.705056+0000","last_undegraded":"2024-05-09T05:05:21.705056+0000","last_fullsized":"2024-05-09T05:05:21.705056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:43.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712860+0000","last_change":"2024-05-09T05:05:20.712589+0000","last_active":"2024-05-09T05:05:21.712860+0000","last_peered":"2024-05-09T05:05:21.712860+0000","last_clean":"2024-05-09T05:05:21.712860+0000","last_became_active":"2024-05-09T05:05:20.712315+0000","last_became_peered":"2024-05-09T05:05:20.712315+0000","last_unstale":"2024-05-09T05:05:21.712860+0000","last_undegraded":"2024-05-09T05:05:21.712860+0000","last_fullsized":"2024-05-09T05:05:21.712860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:55.907395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701062+0000","last_change":"2024-05-09T05:05:20.711709+0000","last_active":"2024-05-09T05:05:21.701062+0000","last_peered":"2024-05-09T05:05:21.701062+0000","last_clean":"2024-05-09T05:05:21.701062+0000","last_became_active":"2024-05-09T05:05:20.711443+0000","last_became_peered":"2024-05-09T05:05:20.711443+0000","last_unstale":"2024-05-09T05:05:21.701062+0000","last_undegraded":"2024-05-09T05:05:21.701062+0000","last_fullsized":"2024-05-09T05:05:21.701062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:24.649065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703823+0000","last_change":"2024-05-09T05:05:20.700778+0000","last_active":"2024-05-09T05:05:21.703823+0000","last_peered":"2024-05-09T05:05:21.703823+0000","last_clean":"2024-05-09T05:05:21.703823+0000","last_became_active":"2024-05-09T05:05:20.700463+0000","last_became_peered":"2024-05-09T05:05:20.700463+0000","last_unstale":"2024-05-09T05:05:21.703823+0000","last_undegraded":"2024-05-09T05:05:21.703823+0000","last_fullsized":"2024-05-09T05:05:21.703823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:02.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717289+0000","last_change":"2024-05-09T05:05:20.709419+0000","last_active":"2024-05-09T05:05:20.717289+0000","last_peered":"2024-05-09T05:05:20.717289+0000","last_clean":"2024-05-09T05:05:20.717289+0000","last_became_active":"2024-05-09T05:05:20.708780+0000","last_became_peered":"2024-05-09T05:05:20.708780+0000","last_unstale":"2024-05-09T05:05:20.717289+0000","last_undegraded":"2024-05-09T05:05:20.717289+0000","last_fullsized":"2024-05-09T05:05:20.717289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:16.816105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.708636+0000","last_change":"2024-05-09T05:05:20.703176+0000","last_active":"2024-05-09T05:05:20.708636+0000","last_peered":"2024-05-09T05:05:20.708636+0000","last_clean":"2024-05-09T05:05:20.708636+0000","last_became_active":"2024-05-09T05:05:20.702897+0000","last_became_peered":"2024-05-09T05:05:20.702897+0000","last_unstale":"2024-05-09T05:05:20.708636+0000","last_undegraded":"2024-05-09T05:05:20.708636+0000","last_fullsized":"2024-05-09T05:05:20.708636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:53.603845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.731185+0000","last_change":"2024-05-09T05:05:20.730184+0000","last_active":"2024-05-09T05:05:20.731185+0000","last_peered":"2024-05-09T05:05:20.731185+0000","last_clean":"2024-05-09T05:05:20.731185+0000","last_became_active":"2024-05-09T05:05:20.729900+0000","last_became_peered":"2024-05-09T05:05:20.729900+0000","last_unstale":"2024-05-09T05:05:20.731185+0000","last_undegraded":"2024-05-09T05:05:20.731185+0000","last_fullsized":"2024-05-09T05:05:20.731185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:23:32.275627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713610+0000","last_change":"2024-05-09T05:05:20.717393+0000","last_active":"2024-05-09T05:05:21.713610+0000","last_peered":"2024-05-09T05:05:21.713610+0000","last_clean":"2024-05-09T05:05:21.713610+0000","last_became_active":"2024-05-09T05:05:20.716476+0000","last_became_peered":"2024-05-09T05:05:20.716476+0000","last_unstale":"2024-05-09T05:05:21.713610+0000","last_undegraded":"2024-05-09T05:05:21.713610+0000","last_fullsized":"2024-05-09T05:05:21.713610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:02.428980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.731743+0000","last_change":"2024-05-09T05:05:20.730842+0000","last_active":"2024-05-09T05:05:20.731743+0000","last_peered":"2024-05-09T05:05:20.731743+0000","last_clean":"2024-05-09T05:05:20.731743+0000","last_became_active":"2024-05-09T05:05:20.730516+0000","last_became_peered":"2024-05-09T05:05:20.730516+0000","last_unstale":"2024-05-09T05:05:20.731743+0000","last_undegraded":"2024-05-09T05:05:20.731743+0000","last_fullsized":"2024-05-09T05:05:20.731743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:02.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704749+0000","last_change":"2024-05-09T05:05:20.700678+0000","last_active":"2024-05-09T05:05:21.704749+0000","last_peered":"2024-05-09T05:05:21.704749+0000","last_clean":"2024-05-09T05:05:21.704749+0000","last_became_active":"2024-05-09T05:05:20.697751+0000","last_became_peered":"2024-05-09T05:05:20.697751+0000","last_unstale":"2024-05-09T05:05:21.704749+0000","last_undegraded":"2024-05-09T05:05:21.704749+0000","last_fullsized":"2024-05-09T05:05:21.704749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:27.088377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701161+0000","last_change":"2024-05-09T05:05:20.722945+0000","last_active":"2024-05-09T05:05:21.701161+0000","last_peered":"2024-05-09T05:05:21.701161+0000","last_clean":"2024-05-09T05:05:21.701161+0000","last_became_active":"2024-05-09T05:05:20.722712+0000","last_became_peered":"2024-05-09T05:05:20.722712+0000","last_unstale":"2024-05-09T05:05:21.701161+0000","last_undegraded":"2024-05-09T05:05:21.701161+0000","last_fullsized":"2024-05-09T05:05:21.701161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:02.966629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703905+0000","last_change":"2024-05-09T05:05:20.693653+0000","last_active":"2024-05-09T05:05:21.703905+0000","last_peered":"2024-05-09T05:05:21.703905+0000","last_clean":"2024-05-09T05:05:21.703905+0000","last_became_active":"2024-05-09T05:05:20.693310+0000","last_became_peered":"2024-05-09T05:05:20.693310+0000","last_unstale":"2024-05-09T05:05:21.703905+0000","last_undegraded":"2024-05-09T05:05:21.703905+0000","last_fullsized":"2024-05-09T05:05:21.703905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:41.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704016+0000","last_change":"2024-05-09T05:05:20.706205+0000","last_active":"2024-05-09T05:05:21.704016+0000","last_peered":"2024-05-09T05:05:21.704016+0000","last_clean":"2024-05-09T05:05:21.704016+0000","last_became_active":"2024-05-09T05:05:20.704653+0000","last_became_peered":"2024-05-09T05:05:20.704653+0000","last_unstale":"2024-05-09T05:05:21.704016+0000","last_undegraded":"2024-05-09T05:05:21.704016+0000","last_fullsized":"2024-05-09T05:05:21.704016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:02.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717767+0000","last_change":"2024-05-09T05:05:20.713412+0000","last_active":"2024-05-09T05:05:20.717767+0000","last_peered":"2024-05-09T05:05:20.717767+0000","last_clean":"2024-05-09T05:05:20.717767+0000","last_became_active":"2024-05-09T05:05:20.713094+0000","last_became_peered":"2024-05-09T05:05:20.713094+0000","last_unstale":"2024-05-09T05:05:20.717767+0000","last_undegraded":"2024-05-09T05:05:20.717767+0000","last_fullsized":"2024-05-09T05:05:20.717767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:15.277815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.719485+0000","last_change":"2024-05-09T05:05:20.717128+0000","last_active":"2024-05-09T05:05:20.719485+0000","last_peered":"2024-05-09T05:05:20.719485+0000","last_clean":"2024-05-09T05:05:20.719485+0000","last_became_active":"2024-05-09T05:05:20.715765+0000","last_became_peered":"2024-05-09T05:05:20.715765+0000","last_unstale":"2024-05-09T05:05:20.719485+0000","last_undegraded":"2024-05-09T05:05:20.719485+0000","last_fullsized":"2024-05-09T05:05:20.719485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705144+0000","last_change":"2024-05-09T05:05:20.728358+0000","last_active":"2024-05-09T05:05:21.705144+0000","last_peered":"2024-05-09T05:05:21.705144+0000","last_clean":"2024-05-09T05:05:21.705144+0000","last_became_active":"2024-05-09T05:05:20.724556+0000","last_became_peered":"2024-05-09T05:05:20.724556+0000","last_unstale":"2024-05-09T05:05:21.705144+0000","last_undegraded":"2024-05-09T05:05:21.705144+0000","last_fullsized":"2024-05-09T05:05:21.705144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:44.831017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705118+0000","last_change":"2024-05-09T05:05:20.715446+0000","last_active":"2024-05-09T05:05:21.705118+0000","last_peered":"2024-05-09T05:05:21.705118+0000","last_clean":"2024-05-09T05:05:21.705118+0000","last_became_active":"2024-05-09T05:05:20.711356+0000","last_became_peered":"2024-05-09T05:05:20.711356+0000","last_unstale":"2024-05-09T05:05:21.705118+0000","last_undegraded":"2024-05-09T05:05:21.705118+0000","last_fullsized":"2024-05-09T05:05:21.705118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:43.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701760+0000","last_change":"2024-05-09T05:05:20.711093+0000","last_active":"2024-05-09T05:05:21.701760+0000","last_peered":"2024-05-09T05:05:21.701760+0000","last_clean":"2024-05-09T05:05:21.701760+0000","last_became_active":"2024-05-09T05:05:20.706285+0000","last_became_peered":"2024-05-09T05:05:20.706285+0000","last_unstale":"2024-05-09T05:05:21.701760+0000","last_undegraded":"2024-05-09T05:05:21.701760+0000","last_fullsized":"2024-05-09T05:05:21.701760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:33.236625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.706468+0000","last_change":"2024-05-09T05:05:20.700240+0000","last_active":"2024-05-09T05:05:20.706468+0000","last_peered":"2024-05-09T05:05:20.706468+0000","last_clean":"2024-05-09T05:05:20.706468+0000","last_became_active":"2024-05-09T05:05:20.699974+0000","last_became_peered":"2024-05-09T05:05:20.699974+0000","last_unstale":"2024-05-09T05:05:20.706468+0000","last_undegraded":"2024-05-09T05:05:20.706468+0000","last_fullsized":"2024-05-09T05:05:20.706468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:02.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716423+0000","last_change":"2024-05-09T05:05:20.712019+0000","last_active":"2024-05-09T05:05:20.716423+0000","last_peered":"2024-05-09T05:05:20.716423+0000","last_clean":"2024-05-09T05:05:20.716423+0000","last_became_active":"2024-05-09T05:05:20.709191+0000","last_became_peered":"2024-05-09T05:05:20.709191+0000","last_unstale":"2024-05-09T05:05:20.716423+0000","last_undegraded":"2024-05-09T05:05:20.716423+0000","last_fullsized":"2024-05-09T05:05:20.716423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:56.294035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708389+0000","last_change":"2024-05-09T05:05:20.707560+0000","last_active":"2024-05-09T05:05:21.708389+0000","last_peered":"2024-05-09T05:05:21.708389+0000","last_clean":"2024-05-09T05:05:21.708389+0000","last_became_active":"2024-05-09T05:05:20.707292+0000","last_became_peered":"2024-05-09T05:05:20.707292+0000","last_unstale":"2024-05-09T05:05:21.708389+0000","last_undegraded":"2024-05-09T05:05:21.708389+0000","last_fullsized":"2024-05-09T05:05:21.708389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:39.758693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703804+0000","last_change":"2024-05-09T05:05:20.697629+0000","last_active":"2024-05-09T05:05:21.703804+0000","last_peered":"2024-05-09T05:05:21.703804+0000","last_clean":"2024-05-09T05:05:21.703804+0000","last_became_active":"2024-05-09T05:05:20.697340+0000","last_became_peered":"2024-05-09T05:05:20.697340+0000","last_unstale":"2024-05-09T05:05:21.703804+0000","last_undegraded":"2024-05-09T05:05:21.703804+0000","last_fullsized":"2024-05-09T05:05:21.703804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713546+0000","last_change":"2024-05-09T05:05:20.708695+0000","last_active":"2024-05-09T05:05:21.713546+0000","last_peered":"2024-05-09T05:05:21.713546+0000","last_clean":"2024-05-09T05:05:21.713546+0000","last_became_active":"2024-05-09T05:05:20.708335+0000","last_became_peered":"2024-05-09T05:05:20.708335+0000","last_unstale":"2024-05-09T05:05:21.713546+0000","last_undegraded":"2024-05-09T05:05:21.713546+0000","last_fullsized":"2024-05-09T05:05:21.713546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:06.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705262+0000","last_change":"2024-05-09T05:05:20.708731+0000","last_active":"2024-05-09T05:05:21.705262+0000","last_peered":"2024-05-09T05:05:21.705262+0000","last_clean":"2024-05-09T05:05:21.705262+0000","last_became_active":"2024-05-09T05:05:20.708085+0000","last_became_peered":"2024-05-09T05:05:20.708085+0000","last_unstale":"2024-05-09T05:05:21.705262+0000","last_undegraded":"2024-05-09T05:05:21.705262+0000","last_fullsized":"2024-05-09T05:05:21.705262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:34.282027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713555+0000","last_change":"2024-05-09T05:05:20.713702+0000","last_active":"2024-05-09T05:05:21.713555+0000","last_peered":"2024-05-09T05:05:21.713555+0000","last_clean":"2024-05-09T05:05:21.713555+0000","last_became_active":"2024-05-09T05:05:20.713169+0000","last_became_peered":"2024-05-09T05:05:20.713169+0000","last_unstale":"2024-05-09T05:05:21.713555+0000","last_undegraded":"2024-05-09T05:05:21.713555+0000","last_fullsized":"2024-05-09T05:05:21.713555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:15.277815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704835+0000","last_change":"2024-05-09T05:05:20.696708+0000","last_active":"2024-05-09T05:05:21.704835+0000","last_peered":"2024-05-09T05:05:21.704835+0000","last_clean":"2024-05-09T05:05:21.704835+0000","last_became_active":"2024-05-09T05:05:20.696377+0000","last_became_peered":"2024-05-09T05:05:20.696377+0000","last_unstale":"2024-05-09T05:05:21.704835+0000","last_undegraded":"2024-05-09T05:05:21.704835+0000","last_fullsized":"2024-05-09T05:05:21.704835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:46.526610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.718647+0000","last_change":"2024-05-09T05:05:20.709566+0000","last_active":"2024-05-09T05:05:20.718647+0000","last_peered":"2024-05-09T05:05:20.718647+0000","last_clean":"2024-05-09T05:05:20.718647+0000","last_became_active":"2024-05-09T05:05:20.709249+0000","last_became_peered":"2024-05-09T05:05:20.709249+0000","last_unstale":"2024-05-09T05:05:20.718647+0000","last_undegraded":"2024-05-09T05:05:20.718647+0000","last_fullsized":"2024-05-09T05:05:20.718647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:52.483480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716701+0000","last_change":"2024-05-09T05:05:20.708485+0000","last_active":"2024-05-09T05:05:20.716701+0000","last_peered":"2024-05-09T05:05:20.716701+0000","last_clean":"2024-05-09T05:05:20.716701+0000","last_became_active":"2024-05-09T05:05:20.708207+0000","last_became_peered":"2024-05-09T05:05:20.708207+0000","last_unstale":"2024-05-09T05:05:20.716701+0000","last_undegraded":"2024-05-09T05:05:20.716701+0000","last_fullsized":"2024-05-09T05:05:20.716701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:35.514890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.711752+0000","last_change":"2024-05-09T05:05:20.705140+0000","last_active":"2024-05-09T05:05:20.711752+0000","last_peered":"2024-05-09T05:05:20.711752+0000","last_clean":"2024-05-09T05:05:20.711752+0000","last_became_active":"2024-05-09T05:05:20.704831+0000","last_became_peered":"2024-05-09T05:05:20.704831+0000","last_unstale":"2024-05-09T05:05:20.711752+0000","last_undegraded":"2024-05-09T05:05:20.711752+0000","last_fullsized":"2024-05-09T05:05:20.711752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:49.621021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717332+0000","last_change":"2024-05-09T05:05:20.709117+0000","last_active":"2024-05-09T05:05:20.717332+0000","last_peered":"2024-05-09T05:05:20.717332+0000","last_clean":"2024-05-09T05:05:20.717332+0000","last_became_active":"2024-05-09T05:05:20.708793+0000","last_became_peered":"2024-05-09T05:05:20.708793+0000","last_unstale":"2024-05-09T05:05:20.717332+0000","last_undegraded":"2024-05-09T05:05:20.717332+0000","last_fullsized":"2024-05-09T05:05:20.717332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:55.907395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708676+0000","last_change":"2024-05-09T05:05:20.710734+0000","last_active":"2024-05-09T05:05:21.708676+0000","last_peered":"2024-05-09T05:05:21.708676+0000","last_clean":"2024-05-09T05:05:21.708676+0000","last_became_active":"2024-05-09T05:05:20.710481+0000","last_became_peered":"2024-05-09T05:05:20.710481+0000","last_unstale":"2024-05-09T05:05:21.708676+0000","last_undegraded":"2024-05-09T05:05:21.708676+0000","last_fullsized":"2024-05-09T05:05:21.708676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:53.603845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.718279+0000","last_change":"2024-05-09T05:05:19.703849+0000","last_active":"2024-05-09T05:05:20.718279+0000","last_peered":"2024-05-09T05:05:20.718279+0000","last_clean":"2024-05-09T05:05:20.718279+0000","last_became_active":"2024-05-09T05:05:19.702065+0000","last_became_peered":"2024-05-09T05:05:19.702065+0000","last_unstale":"2024-05-09T05:05:20.718279+0000","last_undegraded":"2024-05-09T05:05:20.718279+0000","last_fullsized":"2024-05-09T05:05:20.718279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.715845+0000","last_change":"2024-05-09T05:05:20.712830+0000","last_active":"2024-05-09T05:05:20.715845+0000","last_peered":"2024-05-09T05:05:20.715845+0000","last_clean":"2024-05-09T05:05:20.715845+0000","last_became_active":"2024-05-09T05:05:20.712519+0000","last_became_peered":"2024-05-09T05:05:20.712519+0000","last_unstale":"2024-05-09T05:05:20.715845+0000","last_undegraded":"2024-05-09T05:05:20.715845+0000","last_fullsized":"2024-05-09T05:05:20.715845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:52.483480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708499+0000","last_change":"2024-05-09T05:05:19.698667+0000","last_active":"2024-05-09T05:05:21.708499+0000","last_peered":"2024-05-09T05:05:21.708499+0000","last_clean":"2024-05-09T05:05:21.708499+0000","last_became_active":"2024-05-09T05:05:19.697642+0000","last_became_peered":"2024-05-09T05:05:19.697642+0000","last_unstale":"2024-05-09T05:05:21.708499+0000","last_undegraded":"2024-05-09T05:05:21.708499+0000","last_fullsized":"2024-05-09T05:05:21.708499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716047+0000","last_change":"2024-05-09T05:05:20.711117+0000","last_active":"2024-05-09T05:05:20.716047+0000","last_peered":"2024-05-09T05:05:20.716047+0000","last_clean":"2024-05-09T05:05:20.716047+0000","last_became_active":"2024-05-09T05:05:20.709512+0000","last_became_peered":"2024-05-09T05:05:20.709512+0000","last_unstale":"2024-05-09T05:05:20.716047+0000","last_undegraded":"2024-05-09T05:05:20.716047+0000","last_fullsized":"2024-05-09T05:05:20.716047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:34.268678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704568+0000","last_change":"2024-05-09T05:05:19.686507+0000","last_active":"2024-05-09T05:05:21.704568+0000","last_peered":"2024-05-09T05:05:21.704568+0000","last_clean":"2024-05-09T05:05:21.704568+0000","last_became_active":"2024-05-09T05:05:19.686207+0000","last_became_peered":"2024-05-09T05:05:19.686207+0000","last_unstale":"2024-05-09T05:05:21.704568+0000","last_undegraded":"2024-05-09T05:05:21.704568+0000","last_fullsized":"2024-05-09T05:05:21.704568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:55.279622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713781+0000","last_change":"2024-05-09T05:05:20.713417+0000","last_active":"2024-05-09T05:05:21.713781+0000","last_peered":"2024-05-09T05:05:21.713781+0000","last_clean":"2024-05-09T05:05:21.713781+0000","last_became_active":"2024-05-09T05:05:20.712829+0000","last_became_peered":"2024-05-09T05:05:20.712829+0000","last_unstale":"2024-05-09T05:05:21.713781+0000","last_undegraded":"2024-05-09T05:05:21.713781+0000","last_fullsized":"2024-05-09T05:05:21.713781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701660+0000","last_change":"2024-05-09T05:05:19.694319+0000","last_active":"2024-05-09T05:05:21.701660+0000","last_peered":"2024-05-09T05:05:21.701660+0000","last_clean":"2024-05-09T05:05:21.701660+0000","last_became_active":"2024-05-09T05:05:19.693984+0000","last_became_peered":"2024-05-09T05:05:19.693984+0000","last_unstale":"2024-05-09T05:05:21.701660+0000","last_undegraded":"2024-05-09T05:05:21.701660+0000","last_fullsized":"2024-05-09T05:05:21.701660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:12.107329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716834+0000","last_change":"2024-05-09T05:05:20.708929+0000","last_active":"2024-05-09T05:05:20.716834+0000","last_peered":"2024-05-09T05:05:20.716834+0000","last_clean":"2024-05-09T05:05:20.716834+0000","last_became_active":"2024-05-09T05:05:20.707694+0000","last_became_peered":"2024-05-09T05:05:20.707694+0000","last_unstale":"2024-05-09T05:05:20.716834+0000","last_undegraded":"2024-05-09T05:05:20.716834+0000","last_fullsized":"2024-05-09T05:05:20.716834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:23.552137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.723894+0000","last_change":"2024-05-09T05:05:19.700536+0000","last_active":"2024-05-09T05:05:20.723894+0000","last_peered":"2024-05-09T05:05:20.723894+0000","last_clean":"2024-05-09T05:05:20.723894+0000","last_became_active":"2024-05-09T05:05:19.700245+0000","last_became_peered":"2024-05-09T05:05:19.700245+0000","last_unstale":"2024-05-09T05:05:20.723894+0000","last_undegraded":"2024-05-09T05:05:20.723894+0000","last_fullsized":"2024-05-09T05:05:20.723894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:01.952216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704475+0000","last_change":"2024-05-09T05:05:20.697065+0000","last_active":"2024-05-09T05:05:21.704475+0000","last_peered":"2024-05-09T05:05:21.704475+0000","last_clean":"2024-05-09T05:05:21.704475+0000","last_became_active":"2024-05-09T05:05:20.696750+0000","last_became_peered":"2024-05-09T05:05:20.696750+0000","last_unstale":"2024-05-09T05:05:21.704475+0000","last_undegraded":"2024-05-09T05:05:21.704475+0000","last_fullsized":"2024-05-09T05:05:21.704475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:41.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.721744+0000","last_change":"2024-05-09T05:05:19.694267+0000","last_active":"2024-05-09T05:05:20.721744+0000","last_peered":"2024-05-09T05:05:20.721744+0000","last_clean":"2024-05-09T05:05:20.721744+0000","last_became_active":"2024-05-09T05:05:19.692996+0000","last_became_peered":"2024-05-09T05:05:19.692996+0000","last_unstale":"2024-05-09T05:05:20.721744+0000","last_undegraded":"2024-05-09T05:05:20.721744+0000","last_fullsized":"2024-05-09T05:05:20.721744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:23.634652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.714862+0000","last_change":"2024-05-09T05:05:20.705534+0000","last_active":"2024-05-09T05:05:20.714862+0000","last_peered":"2024-05-09T05:05:20.714862+0000","last_clean":"2024-05-09T05:05:20.714862+0000","last_became_active":"2024-05-09T05:05:20.704060+0000","last_became_peered":"2024-05-09T05:05:20.704060+0000","last_unstale":"2024-05-09T05:05:20.714862+0000","last_undegraded":"2024-05-09T05:05:20.714862+0000","last_fullsized":"2024-05-09T05:05:20.714862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:20.928452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703399+0000","last_change":"2024-05-09T05:05:19.686003+0000","last_active":"2024-05-09T05:05:21.703399+0000","last_peered":"2024-05-09T05:05:21.703399+0000","last_clean":"2024-05-09T05:05:21.703399+0000","last_became_active":"2024-05-09T05:05:19.685625+0000","last_became_peered":"2024-05-09T05:05:19.685625+0000","last_unstale":"2024-05-09T05:05:21.703399+0000","last_undegraded":"2024-05-09T05:05:21.703399+0000","last_fullsized":"2024-05-09T05:05:21.703399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:03.738324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712571+0000","last_change":"2024-05-09T05:05:20.684494+0000","last_active":"2024-05-09T05:05:21.712571+0000","last_peered":"2024-05-09T05:05:21.712571+0000","last_clean":"2024-05-09T05:05:21.712571+0000","last_became_active":"2024-05-09T05:05:20.684215+0000","last_became_peered":"2024-05-09T05:05:20.684215+0000","last_unstale":"2024-05-09T05:05:21.712571+0000","last_undegraded":"2024-05-09T05:05:21.712571+0000","last_fullsized":"2024-05-09T05:05:21.712571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:35.514890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.693164+0000","last_change":"2024-05-09T05:05:19.702146+0000","last_active":"2024-05-09T05:05:20.693164+0000","last_peered":"2024-05-09T05:05:20.693164+0000","last_clean":"2024-05-09T05:05:20.693164+0000","last_became_active":"2024-05-09T05:05:19.701806+0000","last_became_peered":"2024-05-09T05:05:19.701806+0000","last_unstale":"2024-05-09T05:05:20.693164+0000","last_undegraded":"2024-05-09T05:05:20.693164+0000","last_fullsized":"2024-05-09T05:05:20.693164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:43.196316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705348+0000","last_change":"2024-05-09T05:05:20.697556+0000","last_active":"2024-05-09T05:05:21.705348+0000","last_peered":"2024-05-09T05:05:21.705348+0000","last_clean":"2024-05-09T05:05:21.705348+0000","last_became_active":"2024-05-09T05:05:20.696543+0000","last_became_peered":"2024-05-09T05:05:20.696543+0000","last_unstale":"2024-05-09T05:05:21.705348+0000","last_undegraded":"2024-05-09T05:05:21.705348+0000","last_fullsized":"2024-05-09T05:05:21.705348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:44.831017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705553+0000","last_change":"2024-05-09T05:05:19.691827+0000","last_active":"2024-05-09T05:05:21.705553+0000","last_peered":"2024-05-09T05:05:21.705553+0000","last_clean":"2024-05-09T05:05:21.705553+0000","last_became_active":"2024-05-09T05:05:19.691476+0000","last_became_peered":"2024-05-09T05:05:19.691476+0000","last_unstale":"2024-05-09T05:05:21.705553+0000","last_undegraded":"2024-05-09T05:05:21.705553+0000","last_fullsized":"2024-05-09T05:05:21.705553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:38.744280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705470+0000","last_change":"2024-05-09T05:05:20.705962+0000","last_active":"2024-05-09T05:05:21.705470+0000","last_peered":"2024-05-09T05:05:21.705470+0000","last_clean":"2024-05-09T05:05:21.705470+0000","last_became_active":"2024-05-09T05:05:20.705396+0000","last_became_peered":"2024-05-09T05:05:20.705396+0000","last_unstale":"2024-05-09T05:05:21.705470+0000","last_undegraded":"2024-05-09T05:05:21.705470+0000","last_fullsized":"2024-05-09T05:05:21.705470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:17.566126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708582+0000","last_change":"2024-05-09T05:05:19.699552+0000","last_active":"2024-05-09T05:05:21.708582+0000","last_peered":"2024-05-09T05:05:21.708582+0000","last_clean":"2024-05-09T05:05:21.708582+0000","last_became_active":"2024-05-09T05:05:19.697143+0000","last_became_peered":"2024-05-09T05:05:19.697143+0000","last_unstale":"2024-05-09T05:05:21.708582+0000","last_undegraded":"2024-05-09T05:05:21.708582+0000","last_fullsized":"2024-05-09T05:05:21.708582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:01.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704598+0000","last_change":"2024-05-09T05:05:20.710035+0000","last_active":"2024-05-09T05:05:21.704598+0000","last_peered":"2024-05-09T05:05:21.704598+0000","last_clean":"2024-05-09T05:05:21.704598+0000","last_became_active":"2024-05-09T05:05:20.708125+0000","last_became_peered":"2024-05-09T05:05:20.708125+0000","last_unstale":"2024-05-09T05:05:21.704598+0000","last_undegraded":"2024-05-09T05:05:21.704598+0000","last_fullsized":"2024-05-09T05:05:21.704598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:27.088377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705353+0000","last_change":"2024-05-09T05:05:19.696117+0000","last_active":"2024-05-09T05:05:21.705353+0000","last_peered":"2024-05-09T05:05:21.705353+0000","last_clean":"2024-05-09T05:05:21.705353+0000","last_became_active":"2024-05-09T05:05:19.695811+0000","last_became_peered":"2024-05-09T05:05:19.695811+0000","last_unstale":"2024-05-09T05:05:21.705353+0000","last_undegraded":"2024-05-09T05:05:21.705353+0000","last_fullsized":"2024-05-09T05:05:21.705353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:23:31.261214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704716+0000","last_change":"2024-05-09T05:05:20.689561+0000","last_active":"2024-05-09T05:05:21.704716+0000","last_peered":"2024-05-09T05:05:21.704716+0000","last_clean":"2024-05-09T05:05:21.704716+0000","last_became_active":"2024-05-09T05:05:20.688795+0000","last_became_peered":"2024-05-09T05:05:20.688795+0000","last_unstale":"2024-05-09T05:05:21.704716+0000","last_undegraded":"2024-05-09T05:05:21.704716+0000","last_fullsized":"2024-05-09T05:05:21.704716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:00.145749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704698+0000","last_change":"2024-05-09T05:05:19.691937+0000","last_active":"2024-05-09T05:05:21.704698+0000","last_peered":"2024-05-09T05:05:21.704698+0000","last_clean":"2024-05-09T05:05:21.704698+0000","last_became_active":"2024-05-09T05:05:19.691322+0000","last_became_peered":"2024-05-09T05:05:19.691322+0000","last_unstale":"2024-05-09T05:05:21.704698+0000","last_undegraded":"2024-05-09T05:05:21.704698+0000","last_fullsized":"2024-05-09T05:05:21.704698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:23:31.261214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712758+0000","last_change":"2024-05-09T05:05:20.717097+0000","last_active":"2024-05-09T05:05:21.712758+0000","last_peered":"2024-05-09T05:05:21.712758+0000","last_clean":"2024-05-09T05:05:21.712758+0000","last_became_active":"2024-05-09T05:05:20.716828+0000","last_became_peered":"2024-05-09T05:05:20.716828+0000","last_unstale":"2024-05-09T05:05:21.712758+0000","last_undegraded":"2024-05-09T05:05:21.712758+0000","last_fullsized":"2024-05-09T05:05:21.712758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:23.552137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.722540+0000","last_change":"2024-05-09T05:05:19.704552+0000","last_active":"2024-05-09T05:05:20.722540+0000","last_peered":"2024-05-09T05:05:20.722540+0000","last_clean":"2024-05-09T05:05:20.722540+0000","last_became_active":"2024-05-09T05:05:19.704254+0000","last_became_peered":"2024-05-09T05:05:19.704254+0000","last_unstale":"2024-05-09T05:05:20.722540+0000","last_undegraded":"2024-05-09T05:05:20.722540+0000","last_fullsized":"2024-05-09T05:05:20.722540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:06.387644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704393+0000","last_change":"2024-05-09T05:05:20.697934+0000","last_active":"2024-05-09T05:05:21.704393+0000","last_peered":"2024-05-09T05:05:21.704393+0000","last_clean":"2024-05-09T05:05:21.704393+0000","last_became_active":"2024-05-09T05:05:20.697601+0000","last_became_peered":"2024-05-09T05:05:20.697601+0000","last_unstale":"2024-05-09T05:05:21.704393+0000","last_undegraded":"2024-05-09T05:05:21.704393+0000","last_fullsized":"2024-05-09T05:05:21.704393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:00.145749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712729+0000","last_change":"2024-05-09T05:05:19.699753+0000","last_active":"2024-05-09T05:05:21.712729+0000","last_peered":"2024-05-09T05:05:21.712729+0000","last_clean":"2024-05-09T05:05:21.712729+0000","last_became_active":"2024-05-09T05:05:19.699474+0000","last_became_peered":"2024-05-09T05:05:19.699474+0000","last_unstale":"2024-05-09T05:05:21.712729+0000","last_undegraded":"2024-05-09T05:05:21.712729+0000","last_fullsized":"2024-05-09T05:05:21.712729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:01.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717949+0000","last_change":"2024-05-09T05:05:20.714857+0000","last_active":"2024-05-09T05:05:20.717949+0000","last_peered":"2024-05-09T05:05:20.717949+0000","last_clean":"2024-05-09T05:05:20.717949+0000","last_became_active":"2024-05-09T05:05:20.714551+0000","last_became_peered":"2024-05-09T05:05:20.714551+0000","last_unstale":"2024-05-09T05:05:20.717949+0000","last_undegraded":"2024-05-09T05:05:20.717949+0000","last_fullsized":"2024-05-09T05:05:20.717949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:02.428980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703495+0000","last_change":"2024-05-09T05:05:19.692580+0000","last_active":"2024-05-09T05:05:21.703495+0000","last_peered":"2024-05-09T05:05:21.703495+0000","last_clean":"2024-05-09T05:05:21.703495+0000","last_became_active":"2024-05-09T05:05:19.692278+0000","last_became_peered":"2024-05-09T05:05:19.692278+0000","last_unstale":"2024-05-09T05:05:21.703495+0000","last_undegraded":"2024-05-09T05:05:21.703495+0000","last_fullsized":"2024-05-09T05:05:21.703495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:33.254266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.711727+0000","last_change":"2024-05-09T05:05:20.703241+0000","last_active":"2024-05-09T05:05:20.711727+0000","last_peered":"2024-05-09T05:05:20.711727+0000","last_clean":"2024-05-09T05:05:20.711727+0000","last_became_active":"2024-05-09T05:05:20.702925+0000","last_became_peered":"2024-05-09T05:05:20.702925+0000","last_unstale":"2024-05-09T05:05:20.711727+0000","last_undegraded":"2024-05-09T05:05:20.711727+0000","last_fullsized":"2024-05-09T05:05:20.711727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:02.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703242+0000","last_change":"2024-05-09T05:05:19.683961+0000","last_active":"2024-05-09T05:05:21.703242+0000","last_peered":"2024-05-09T05:05:21.703242+0000","last_clean":"2024-05-09T05:05:21.703242+0000","last_became_active":"2024-05-09T05:05:19.683281+0000","last_became_peered":"2024-05-09T05:05:19.683281+0000","last_unstale":"2024-05-09T05:05:21.703242+0000","last_undegraded":"2024-05-09T05:05:21.703242+0000","last_fullsized":"2024-05-09T05:05:21.703242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:19.914040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.714176+0000","last_change":"2024-05-09T05:05:20.705392+0000","last_active":"2024-05-09T05:05:20.714176+0000","last_peered":"2024-05-09T05:05:20.714176+0000","last_clean":"2024-05-09T05:05:20.714176+0000","last_became_active":"2024-05-09T05:05:20.705032+0000","last_became_peered":"2024-05-09T05:05:20.705032+0000","last_unstale":"2024-05-09T05:05:20.714176+0000","last_undegraded":"2024-05-09T05:05:20.714176+0000","last_fullsized":"2024-05-09T05:05:20.714176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:49.621021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713609+0000","last_change":"2024-05-09T05:05:19.688690+0000","last_active":"2024-05-09T05:05:21.713609+0000","last_peered":"2024-05-09T05:05:21.713609+0000","last_clean":"2024-05-09T05:05:21.713609+0000","last_became_active":"2024-05-09T05:05:19.688171+0000","last_became_peered":"2024-05-09T05:05:19.688171+0000","last_unstale":"2024-05-09T05:05:21.713609+0000","last_undegraded":"2024-05-09T05:05:21.713609+0000","last_fullsized":"2024-05-09T05:05:21.713609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705417+0000","last_change":"2024-05-09T05:05:20.701302+0000","last_active":"2024-05-09T05:05:21.705417+0000","last_peered":"2024-05-09T05:05:21.705417+0000","last_clean":"2024-05-09T05:05:21.705417+0000","last_became_active":"2024-05-09T05:05:20.700110+0000","last_became_peered":"2024-05-09T05:05:20.700110+0000","last_unstale":"2024-05-09T05:05:21.705417+0000","last_undegraded":"2024-05-09T05:05:21.705417+0000","last_fullsized":"2024-05-09T05:05:21.705417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:34.282027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717624+0000","last_change":"2024-05-09T05:05:19.702844+0000","last_active":"2024-05-09T05:05:20.717624+0000","last_peered":"2024-05-09T05:05:20.717624+0000","last_clean":"2024-05-09T05:05:20.717624+0000","last_became_active":"2024-05-09T05:05:19.702209+0000","last_became_peered":"2024-05-09T05:05:19.702209+0000","last_unstale":"2024-05-09T05:05:20.717624+0000","last_undegraded":"2024-05-09T05:05:20.717624+0000","last_fullsized":"2024-05-09T05:05:20.717624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:32.222213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712986+0000","last_change":"2024-05-09T05:05:20.712678+0000","last_active":"2024-05-09T05:05:21.712986+0000","last_peered":"2024-05-09T05:05:21.712986+0000","last_clean":"2024-05-09T05:05:21.712986+0000","last_became_active":"2024-05-09T05:05:20.712373+0000","last_became_peered":"2024-05-09T05:05:20.712373+0000","last_unstale":"2024-05-09T05:05:21.712986+0000","last_undegraded":"2024-05-09T05:05:21.712986+0000","last_fullsized":"2024-05-09T05:05:21.712986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:16.816105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.718848+0000","last_change":"2024-05-09T05:05:19.699398+0000","last_active":"2024-05-09T05:05:20.718848+0000","last_peered":"2024-05-09T05:05:20.718848+0000","last_clean":"2024-05-09T05:05:20.718848+0000","last_became_active":"2024-05-09T05:05:19.699011+0000","last_became_peered":"2024-05-09T05:05:19.699011+0000","last_unstale":"2024-05-09T05:05:20.718848+0000","last_undegraded":"2024-05-09T05:05:20.718848+0000","last_fullsized":"2024-05-09T05:05:20.718848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701882+0000","last_change":"2024-05-09T05:05:20.710239+0000","last_active":"2024-05-09T05:05:21.701882+0000","last_peered":"2024-05-09T05:05:21.701882+0000","last_clean":"2024-05-09T05:05:21.701882+0000","last_became_active":"2024-05-09T05:05:20.709997+0000","last_became_peered":"2024-05-09T05:05:20.709997+0000","last_unstale":"2024-05-09T05:05:21.701882+0000","last_undegraded":"2024-05-09T05:05:21.701882+0000","last_fullsized":"2024-05-09T05:05:21.701882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:04.654241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.698794+0000","last_change":"2024-05-09T05:05:19.693797+0000","last_active":"2024-05-09T05:05:20.698794+0000","last_peered":"2024-05-09T05:05:20.698794+0000","last_clean":"2024-05-09T05:05:20.698794+0000","last_became_active":"2024-05-09T05:05:19.693505+0000","last_became_peered":"2024-05-09T05:05:19.693505+0000","last_unstale":"2024-05-09T05:05:20.698794+0000","last_undegraded":"2024-05-09T05:05:20.698794+0000","last_fullsized":"2024-05-09T05:05:20.698794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:52.732633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701504+0000","last_change":"2024-05-09T05:05:20.696919+0000","last_active":"2024-05-09T05:05:21.701504+0000","last_peered":"2024-05-09T05:05:21.701504+0000","last_clean":"2024-05-09T05:05:21.701504+0000","last_became_active":"2024-05-09T05:05:20.696628+0000","last_became_peered":"2024-05-09T05:05:20.696628+0000","last_unstale":"2024-05-09T05:05:21.701504+0000","last_undegraded":"2024-05-09T05:05:21.701504+0000","last_fullsized":"2024-05-09T05:05:21.701504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:53.747045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708992+0000","last_change":"2024-05-09T05:05:19.695385+0000","last_active":"2024-05-09T05:05:21.708992+0000","last_peered":"2024-05-09T05:05:21.708992+0000","last_clean":"2024-05-09T05:05:21.708992+0000","last_became_active":"2024-05-09T05:05:19.693753+0000","last_became_peered":"2024-05-09T05:05:19.693753+0000","last_unstale":"2024-05-09T05:05:21.708992+0000","last_undegraded":"2024-05-09T05:05:21.708992+0000","last_fullsized":"2024-05-09T05:05:21.708992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:19.914040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701210+0000","last_change":"2024-05-09T05:05:20.699143+0000","last_active":"2024-05-09T05:05:21.701210+0000","last_peered":"2024-05-09T05:05:21.701210+0000","last_clean":"2024-05-09T05:05:21.701210+0000","last_became_active":"2024-05-09T05:05:20.698832+0000","last_became_peered":"2024-05-09T05:05:20.698832+0000","last_unstale":"2024-05-09T05:05:21.701210+0000","last_undegraded":"2024-05-09T05:05:21.701210+0000","last_fullsized":"2024-05-09T05:05:21.701210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:37.389279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.700469+0000","last_change":"2024-05-09T05:05:19.703160+0000","last_active":"2024-05-09T05:05:20.700469+0000","last_peered":"2024-05-09T05:05:20.700469+0000","last_clean":"2024-05-09T05:05:20.700469+0000","last_became_active":"2024-05-09T05:05:19.702750+0000","last_became_peered":"2024-05-09T05:05:19.702750+0000","last_unstale":"2024-05-09T05:05:20.700469+0000","last_undegraded":"2024-05-09T05:05:20.700469+0000","last_fullsized":"2024-05-09T05:05:20.700469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:52.732633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.700735+0000","last_change":"2024-05-09T05:05:20.695033+0000","last_active":"2024-05-09T05:05:21.700735+0000","last_peered":"2024-05-09T05:05:21.700735+0000","last_clean":"2024-05-09T05:05:21.700735+0000","last_became_active":"2024-05-09T05:05:20.694752+0000","last_became_peered":"2024-05-09T05:05:20.694752+0000","last_unstale":"2024-05-09T05:05:21.700735+0000","last_undegraded":"2024-05-09T05:05:21.700735+0000","last_fullsized":"2024-05-09T05:05:21.700735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:44.210729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.693146+0000","last_change":"2024-05-09T05:05:19.695547+0000","last_active":"2024-05-09T05:05:20.693146+0000","last_peered":"2024-05-09T05:05:20.693146+0000","last_clean":"2024-05-09T05:05:20.693146+0000","last_became_active":"2024-05-09T05:05:19.695341+0000","last_became_peered":"2024-05-09T05:05:19.695341+0000","last_unstale":"2024-05-09T05:05:20.693146+0000","last_undegraded":"2024-05-09T05:05:20.693146+0000","last_fullsized":"2024-05-09T05:05:20.693146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:18.438609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717312+0000","last_change":"2024-05-09T05:05:20.709670+0000","last_active":"2024-05-09T05:05:20.717312+0000","last_peered":"2024-05-09T05:05:20.717312+0000","last_clean":"2024-05-09T05:05:20.717312+0000","last_became_active":"2024-05-09T05:05:20.709162+0000","last_became_peered":"2024-05-09T05:05:20.709162+0000","last_unstale":"2024-05-09T05:05:20.717312+0000","last_undegraded":"2024-05-09T05:05:20.717312+0000","last_fullsized":"2024-05-09T05:05:20.717312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:06.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703699+0000","last_change":"2024-05-09T05:05:19.699217+0000","last_active":"2024-05-09T05:05:21.703699+0000","last_peered":"2024-05-09T05:05:21.703699+0000","last_clean":"2024-05-09T05:05:21.703699+0000","last_became_active":"2024-05-09T05:05:19.698780+0000","last_became_peered":"2024-05-09T05:05:19.698780+0000","last_unstale":"2024-05-09T05:05:21.703699+0000","last_undegraded":"2024-05-09T05:05:21.703699+0000","last_fullsized":"2024-05-09T05:05:21.703699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:55.279622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701419+0000","last_change":"2024-05-09T05:05:20.714324+0000","last_active":"2024-05-09T05:05:21.701419+0000","last_peered":"2024-05-09T05:05:21.701419+0000","last_clean":"2024-05-09T05:05:21.701419+0000","last_became_active":"2024-05-09T05:05:20.714038+0000","last_became_peered":"2024-05-09T05:05:20.714038+0000","last_unstale":"2024-05-09T05:05:21.701419+0000","last_undegraded":"2024-05-09T05:05:21.701419+0000","last_fullsized":"2024-05-09T05:05:21.701419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:07.402057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713663+0000","last_change":"2024-05-09T05:05:19.696833+0000","last_active":"2024-05-09T05:05:21.713663+0000","last_peered":"2024-05-09T05:05:21.713663+0000","last_clean":"2024-05-09T05:05:21.713663+0000","last_became_active":"2024-05-09T05:05:19.696453+0000","last_became_peered":"2024-05-09T05:05:19.696453+0000","last_unstale":"2024-05-09T05:05:21.713663+0000","last_undegraded":"2024-05-09T05:05:21.713663+0000","last_fullsized":"2024-05-09T05:05:21.713663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:48.606608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705678+0000","last_change":"2024-05-09T05:05:20.691893+0000","last_active":"2024-05-09T05:05:21.705678+0000","last_peered":"2024-05-09T05:05:21.705678+0000","last_clean":"2024-05-09T05:05:21.705678+0000","last_became_active":"2024-05-09T05:05:20.688202+0000","last_became_peered":"2024-05-09T05:05:20.688202+0000","last_unstale":"2024-05-09T05:05:21.705678+0000","last_undegraded":"2024-05-09T05:05:21.705678+0000","last_fullsized":"2024-05-09T05:05:21.705678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:17.566126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.711011+0000","last_change":"2024-05-09T05:05:19.694457+0000","last_active":"2024-05-09T05:05:21.711011+0000","last_peered":"2024-05-09T05:05:21.711011+0000","last_clean":"2024-05-09T05:05:21.711011+0000","last_became_active":"2024-05-09T05:05:19.694039+0000","last_became_peered":"2024-05-09T05:05:19.694039+0000","last_unstale":"2024-05-09T05:05:21.711011+0000","last_undegraded":"2024-05-09T05:05:21.711011+0000","last_fullsized":"2024-05-09T05:05:21.711011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:48.606608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708402+0000","last_change":"2024-05-09T05:05:20.688077+0000","last_active":"2024-05-09T05:05:21.708402+0000","last_peered":"2024-05-09T05:05:21.708402+0000","last_clean":"2024-05-09T05:05:21.708402+0000","last_became_active":"2024-05-09T05:05:20.687799+0000","last_became_peered":"2024-05-09T05:05:20.687799+0000","last_unstale":"2024-05-09T05:05:21.708402+0000","last_undegraded":"2024-05-09T05:05:21.708402+0000","last_fullsized":"2024-05-09T05:05:21.708402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:16.906676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713072+0000","last_change":"2024-05-09T05:05:19.692750+0000","last_active":"2024-05-09T05:05:21.713072+0000","last_peered":"2024-05-09T05:05:21.713072+0000","last_clean":"2024-05-09T05:05:21.713072+0000","last_became_active":"2024-05-09T05:05:19.692479+0000","last_became_peered":"2024-05-09T05:05:19.692479+0000","last_unstale":"2024-05-09T05:05:21.713072+0000","last_undegraded":"2024-05-09T05:05:21.713072+0000","last_fullsized":"2024-05-09T05:05:21.713072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:32.222213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.707468+0000","last_change":"2024-05-09T05:05:20.702350+0000","last_active":"2024-05-09T05:05:20.707468+0000","last_peered":"2024-05-09T05:05:20.707468+0000","last_clean":"2024-05-09T05:05:20.707468+0000","last_became_active":"2024-05-09T05:05:20.702050+0000","last_became_peered":"2024-05-09T05:05:20.702050+0000","last_unstale":"2024-05-09T05:05:20.707468+0000","last_undegraded":"2024-05-09T05:05:20.707468+0000","last_fullsized":"2024-05-09T05:05:20.707468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:33.236625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708967+0000","last_change":"2024-05-09T05:05:19.696025+0000","last_active":"2024-05-09T05:05:21.708967+0000","last_peered":"2024-05-09T05:05:21.708967+0000","last_clean":"2024-05-09T05:05:21.708967+0000","last_became_active":"2024-05-09T05:05:19.695721+0000","last_became_peered":"2024-05-09T05:05:19.695721+0000","last_unstale":"2024-05-09T05:05:21.708967+0000","last_undegraded":"2024-05-09T05:05:21.708967+0000","last_fullsized":"2024-05-09T05:05:21.708967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:51.469068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708712+0000","last_change":"2024-05-09T05:05:20.709953+0000","last_active":"2024-05-09T05:05:21.708712+0000","last_peered":"2024-05-09T05:05:21.708712+0000","last_clean":"2024-05-09T05:05:21.708712+0000","last_became_active":"2024-05-09T05:05:20.709661+0000","last_became_peered":"2024-05-09T05:05:20.709661+0000","last_unstale":"2024-05-09T05:05:21.708712+0000","last_undegraded":"2024-05-09T05:05:21.708712+0000","last_fullsized":"2024-05-09T05:05:21.708712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:02.432292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712831+0000","last_change":"2024-05-09T05:05:19.696048+0000","last_active":"2024-05-09T05:05:21.712831+0000","last_peered":"2024-05-09T05:05:21.712831+0000","last_clean":"2024-05-09T05:05:21.712831+0000","last_became_active":"2024-05-09T05:05:19.695748+0000","last_became_peered":"2024-05-09T05:05:19.695748+0000","last_unstale":"2024-05-09T05:05:21.712831+0000","last_undegraded":"2024-05-09T05:05:21.712831+0000","last_fullsized":"2024-05-09T05:05:21.712831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:19.914040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703479+0000","last_change":"2024-05-09T05:05:20.687149+0000","last_active":"2024-05-09T05:05:21.703479+0000","last_peered":"2024-05-09T05:05:21.703479+0000","last_clean":"2024-05-09T05:05:21.703479+0000","last_became_active":"2024-05-09T05:05:20.686859+0000","last_became_peered":"2024-05-09T05:05:20.686859+0000","last_unstale":"2024-05-09T05:05:21.703479+0000","last_undegraded":"2024-05-09T05:05:21.703479+0000","last_fullsized":"2024-05-09T05:05:21.703479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.693581+0000","last_change":"2024-05-09T05:05:19.700290+0000","last_active":"2024-05-09T05:05:20.693581+0000","last_peered":"2024-05-09T05:05:20.693581+0000","last_clean":"2024-05-09T05:05:20.693581+0000","last_became_active":"2024-05-09T05:05:19.699956+0000","last_became_peered":"2024-05-09T05:05:19.699956+0000","last_unstale":"2024-05-09T05:05:20.693581+0000","last_undegraded":"2024-05-09T05:05:20.693581+0000","last_fullsized":"2024-05-09T05:05:20.693581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:36.374866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716253+0000","last_change":"2024-05-09T05:05:20.711134+0000","last_active":"2024-05-09T05:05:20.716253+0000","last_peered":"2024-05-09T05:05:20.716253+0000","last_clean":"2024-05-09T05:05:20.716253+0000","last_became_active":"2024-05-09T05:05:20.709105+0000","last_became_peered":"2024-05-09T05:05:20.709105+0000","last_unstale":"2024-05-09T05:05:20.716253+0000","last_undegraded":"2024-05-09T05:05:20.716253+0000","last_fullsized":"2024-05-09T05:05:20.716253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:04.752736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703346+0000","last_change":"2024-05-09T05:05:19.698511+0000","last_active":"2024-05-09T05:05:21.703346+0000","last_peered":"2024-05-09T05:05:21.703346+0000","last_clean":"2024-05-09T05:05:21.703346+0000","last_became_active":"2024-05-09T05:05:19.698184+0000","last_became_peered":"2024-05-09T05:05:19.698184+0000","last_unstale":"2024-05-09T05:05:21.703346+0000","last_undegraded":"2024-05-09T05:05:21.703346+0000","last_fullsized":"2024-05-09T05:05:21.703346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:51.469068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717194+0000","last_change":"2024-05-09T05:05:20.706812+0000","last_active":"2024-05-09T05:05:20.717194+0000","last_peered":"2024-05-09T05:05:20.717194+0000","last_clean":"2024-05-09T05:05:20.717194+0000","last_became_active":"2024-05-09T05:05:20.706396+0000","last_became_peered":"2024-05-09T05:05:20.706396+0000","last_unstale":"2024-05-09T05:05:20.717194+0000","last_undegraded":"2024-05-09T05:05:20.717194+0000","last_fullsized":"2024-05-09T05:05:20.717194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:02.432292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.686233+0000","last_change":"2024-05-09T05:05:19.704198+0000","last_active":"2024-05-09T05:05:20.686233+0000","last_peered":"2024-05-09T05:05:20.686233+0000","last_clean":"2024-05-09T05:05:20.686233+0000","last_became_active":"2024-05-09T05:05:19.703885+0000","last_became_peered":"2024-05-09T05:05:19.703885+0000","last_unstale":"2024-05-09T05:05:20.686233+0000","last_undegraded":"2024-05-09T05:05:20.686233+0000","last_fullsized":"2024-05-09T05:05:20.686233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:06.387644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.692628+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:05:20.692628+0000","last_peered":"2024-05-09T05:05:20.692628+0000","last_clean":"2024-05-09T05:05:20.692628+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:05:20.692628+0000","last_undegraded":"2024-05-09T05:05:20.692628+0000","last_fullsized":"2024-05-09T05:05:20.692628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":723998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":141474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:05:25.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:05:25.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.355+0000 7f7a9be00640 1 Processor -- start 2024-05-09T05:05:25.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.355+0000 7f7a9be00640 1 -- start start 2024-05-09T05:05:25.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.356+0000 7f7a9be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7a9c15f2b0 0x7f7a9c15f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.356+0000 7f7a9be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a9c151e10 0x7f7a9c152280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.356+0000 7f7a9be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c0cf150 con 0x7f7a9c0742b0 2024-05-09T05:05:25.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.356+0000 7f7a9be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9c15fc60 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.357+0000 7f7a9be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9c0cfd60 con 0x7f7a9c151e10 2024-05-09T05:05:25.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.357+0000 7f7a9a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7a9c15f2b0 0x7f7a9c15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.357+0000 7f7a9aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7a9c0742b0 0x7f7a9c0b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33428/0 (socket says 172.21.15.100:33428) 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.357+0000 7f7a9aa00640 1 -- 172.21.15.100:0/1651713229 learned_addr learned my addr 172.21.15.100:0/1651713229 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.357+0000 7f7a9b400640 1 --2- 172.21.15.100:0/1651713229 >> v2:172.21.15.133:3300/0 conn(0x7f7a9c151e10 0x7f7a9c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.357+0000 7f7a9a000640 1 -- 172.21.15.100:0/1651713229 >> v2:172.21.15.133:3300/0 conn(0x7f7a9c151e10 msgr2=0x7f7a9c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.358+0000 7f7a9a000640 1 --2- 172.21.15.100:0/1651713229 >> v2:172.21.15.133:3300/0 conn(0x7f7a9c151e10 0x7f7a9c152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.358+0000 7f7a9a000640 1 -- 172.21.15.100:0/1651713229 >> v1:172.21.15.100:6789/0 conn(0x7f7a9c0742b0 legacy=0x7f7a9c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.358+0000 7f7a9a000640 1 -- 172.21.15.100:0/1651713229 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c0cf430 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.358+0000 7f7a99600640 1 -- 172.21.15.100:0/1651713229 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198768852 0 0) 0x7f7a9c0cf150 con 0x7f7a9c0742b0 2024-05-09T05:05:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.358+0000 7f7a9b400640 1 --2- 172.21.15.100:0/1651713229 >> v2:172.21.15.133:3300/0 conn(0x7f7a9c151e10 0x7f7a9c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:25.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.359+0000 7f7a9a000640 1 --2- 172.21.15.100:0/1651713229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15f720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0728c0 tx=0x7f7a8802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c8921118bc484e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:25.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.359+0000 7f7a99600640 1 -- 172.21.15.100:0/1651713229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88037070 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.359+0000 7f7a99600640 1 -- 172.21.15.100:0/1651713229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a88032440 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.359+0000 7f7a99600640 1 -- 172.21.15.100:0/1651713229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8802ae60 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.359+0000 7f7a9be00640 1 -- 172.21.15.100:0/1651713229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 msgr2=0x7f7a9c15f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.359+0000 7f7a9be00640 1 --2- 172.21.15.100:0/1651713229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15f720 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0728c0 tx=0x7f7a8802a110 comp rx=0 tx=0).stop 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.360+0000 7f7a9be00640 1 -- 172.21.15.100:0/1651713229 shutdown_connections 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.360+0000 7f7a9be00640 1 --2- 172.21.15.100:0/1651713229 >> v2:172.21.15.133:3300/0 conn(0x7f7a9c151e10 0x7f7a9c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.360+0000 7f7a9be00640 1 --2- 172.21.15.100:0/1651713229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15f720 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.360+0000 7f7a9be00640 1 -- 172.21.15.100:0/1651713229 >> 172.21.15.100:0/1651713229 conn(0x7f7a9c06c7f0 msgr2=0x7f7a9c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.360+0000 7f7a9be00640 1 -- 172.21.15.100:0/1651713229 shutdown_connections 2024-05-09T05:05:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.360+0000 7f7a9be00640 1 -- 172.21.15.100:0/1651713229 wait complete. 2024-05-09T05:05:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.361+0000 7f7a9be00640 1 Processor -- start 2024-05-09T05:05:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 -- start start 2024-05-09T05:05:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a9c0742b0 0x7f7a9c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9c151e10 0x7f7a9c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c0d0a20 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c0cf9f0 con 0x7f7a9c151e10 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.362+0000 7f7a9be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c074690 con 0x7f7a9c0742b0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34122/0 (socket says 172.21.15.100:34122) 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 -- 172.21.15.100:0/2230616539 learned_addr learned my addr 172.21.15.100:0/2230616539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9aa00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a9c0742b0 0x7f7a9c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9a000640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9c151e10 0x7f7a9c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 -- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a9c0742b0 msgr2=0x7f7a9c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a9c0742b0 0x7f7a9c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 -- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9c151e10 msgr2=0x7f7a9c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9c151e10 0x7f7a9c14eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 -- 172.21.15.100:0/2230616539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c14f540 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.363+0000 7f7a9b400640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15e130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400cef0 tx=0x7f7a9400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.364+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9401a070 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.364+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9400d860 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.364+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9400dc50 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.364+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c14f820 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.364+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c136cf0 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.365+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c06a550 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.366+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a9401d070 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.368+0000 7f7a92a00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a7c0762d0 0x7f7a7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.368+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7a94097f40 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.368+0000 7f7a9aa00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a7c0762d0 0x7f7a7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.368+0000 7f7a9aa00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a7c0762d0 0x7f7a7c078790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c000f60 tx=0x7f7a8c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:25.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.372+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a940618c0 con 0x7f7a9c15f2b0 2024-05-09T05:05:25.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.577+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a9c06cde0 con 0x7f7a7c0762d0 2024-05-09T05:05:25.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.596+0000 7f7a92a00640 1 -- 172.21.15.100:0/2230616539 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251914 (secure 0 0 0) 0x7f7a9c06cde0 con 0x7f7a7c0762d0 2024-05-09T05:05:25.600 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:25.602 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.602+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a7c0762d0 msgr2=0x7f7a7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.602+0000 7f7a9be00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a7c0762d0 0x7f7a7c078790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c000f60 tx=0x7f7a8c007c00 comp rx=0 tx=0).stop 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.602+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 msgr2=0x7f7a9c15e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.602+0000 7f7a9be00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15e130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400cef0 tx=0x7f7a9400a710 comp rx=0 tx=0).stop 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 shutdown_connections 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a7c0762d0 0x7f7a7c078790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a9c15f2b0 0x7f7a9c15e130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9c151e10 0x7f7a9c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 --2- 172.21.15.100:0/2230616539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a9c0742b0 0x7f7a9c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 >> 172.21.15.100:0/2230616539 conn(0x7f7a9c06c7f0 msgr2=0x7f7a9c1514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 shutdown_connections 2024-05-09T05:05:25.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.603+0000 7f7a9be00640 1 -- 172.21.15.100:0/2230616539 wait complete. 2024-05-09T05:05:25.622 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-09T05:05:23.899433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220164,"kb_used_data":3968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754556,"statfs":{"total":773094113280,"available":772868665344,"internally_reserved":0,"allocated":4063232,"data_stored":2266476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.251101"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.715824+0000","last_change":"2024-05-09T05:05:20.712280+0000","last_active":"2024-05-09T05:05:20.715824+0000","last_peered":"2024-05-09T05:05:20.715824+0000","last_clean":"2024-05-09T05:05:20.715824+0000","last_became_active":"2024-05-09T05:05:20.711994+0000","last_became_peered":"2024-05-09T05:05:20.711994+0000","last_unstale":"2024-05-09T05:05:20.715824+0000","last_undegraded":"2024-05-09T05:05:20.715824+0000","last_fullsized":"2024-05-09T05:05:20.715824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:20.928452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705030+0000","last_change":"2024-05-09T05:05:20.697871+0000","last_active":"2024-05-09T05:05:21.705030+0000","last_peered":"2024-05-09T05:05:21.705030+0000","last_clean":"2024-05-09T05:05:21.705030+0000","last_became_active":"2024-05-09T05:05:20.697547+0000","last_became_peered":"2024-05-09T05:05:20.697547+0000","last_unstale":"2024-05-09T05:05:21.705030+0000","last_undegraded":"2024-05-09T05:05:21.705030+0000","last_fullsized":"2024-05-09T05:05:21.705030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:46.526610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705056+0000","last_change":"2024-05-09T05:05:20.693844+0000","last_active":"2024-05-09T05:05:21.705056+0000","last_peered":"2024-05-09T05:05:21.705056+0000","last_clean":"2024-05-09T05:05:21.705056+0000","last_became_active":"2024-05-09T05:05:20.693525+0000","last_became_peered":"2024-05-09T05:05:20.693525+0000","last_unstale":"2024-05-09T05:05:21.705056+0000","last_undegraded":"2024-05-09T05:05:21.705056+0000","last_fullsized":"2024-05-09T05:05:21.705056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:43.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712860+0000","last_change":"2024-05-09T05:05:20.712589+0000","last_active":"2024-05-09T05:05:21.712860+0000","last_peered":"2024-05-09T05:05:21.712860+0000","last_clean":"2024-05-09T05:05:21.712860+0000","last_became_active":"2024-05-09T05:05:20.712315+0000","last_became_peered":"2024-05-09T05:05:20.712315+0000","last_unstale":"2024-05-09T05:05:21.712860+0000","last_undegraded":"2024-05-09T05:05:21.712860+0000","last_fullsized":"2024-05-09T05:05:21.712860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:55.907395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701062+0000","last_change":"2024-05-09T05:05:20.711709+0000","last_active":"2024-05-09T05:05:21.701062+0000","last_peered":"2024-05-09T05:05:21.701062+0000","last_clean":"2024-05-09T05:05:21.701062+0000","last_became_active":"2024-05-09T05:05:20.711443+0000","last_became_peered":"2024-05-09T05:05:20.711443+0000","last_unstale":"2024-05-09T05:05:21.701062+0000","last_undegraded":"2024-05-09T05:05:21.701062+0000","last_fullsized":"2024-05-09T05:05:21.701062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:24.649065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703823+0000","last_change":"2024-05-09T05:05:20.700778+0000","last_active":"2024-05-09T05:05:21.703823+0000","last_peered":"2024-05-09T05:05:21.703823+0000","last_clean":"2024-05-09T05:05:21.703823+0000","last_became_active":"2024-05-09T05:05:20.700463+0000","last_became_peered":"2024-05-09T05:05:20.700463+0000","last_unstale":"2024-05-09T05:05:21.703823+0000","last_undegraded":"2024-05-09T05:05:21.703823+0000","last_fullsized":"2024-05-09T05:05:21.703823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:02.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717289+0000","last_change":"2024-05-09T05:05:20.709419+0000","last_active":"2024-05-09T05:05:20.717289+0000","last_peered":"2024-05-09T05:05:20.717289+0000","last_clean":"2024-05-09T05:05:20.717289+0000","last_became_active":"2024-05-09T05:05:20.708780+0000","last_became_peered":"2024-05-09T05:05:20.708780+0000","last_unstale":"2024-05-09T05:05:20.717289+0000","last_undegraded":"2024-05-09T05:05:20.717289+0000","last_fullsized":"2024-05-09T05:05:20.717289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:16.816105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.708636+0000","last_change":"2024-05-09T05:05:20.703176+0000","last_active":"2024-05-09T05:05:20.708636+0000","last_peered":"2024-05-09T05:05:20.708636+0000","last_clean":"2024-05-09T05:05:20.708636+0000","last_became_active":"2024-05-09T05:05:20.702897+0000","last_became_peered":"2024-05-09T05:05:20.702897+0000","last_unstale":"2024-05-09T05:05:20.708636+0000","last_undegraded":"2024-05-09T05:05:20.708636+0000","last_fullsized":"2024-05-09T05:05:20.708636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:53.603845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.731185+0000","last_change":"2024-05-09T05:05:20.730184+0000","last_active":"2024-05-09T05:05:20.731185+0000","last_peered":"2024-05-09T05:05:20.731185+0000","last_clean":"2024-05-09T05:05:20.731185+0000","last_became_active":"2024-05-09T05:05:20.729900+0000","last_became_peered":"2024-05-09T05:05:20.729900+0000","last_unstale":"2024-05-09T05:05:20.731185+0000","last_undegraded":"2024-05-09T05:05:20.731185+0000","last_fullsized":"2024-05-09T05:05:20.731185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:23:32.275627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713610+0000","last_change":"2024-05-09T05:05:20.717393+0000","last_active":"2024-05-09T05:05:21.713610+0000","last_peered":"2024-05-09T05:05:21.713610+0000","last_clean":"2024-05-09T05:05:21.713610+0000","last_became_active":"2024-05-09T05:05:20.716476+0000","last_became_peered":"2024-05-09T05:05:20.716476+0000","last_unstale":"2024-05-09T05:05:21.713610+0000","last_undegraded":"2024-05-09T05:05:21.713610+0000","last_fullsized":"2024-05-09T05:05:21.713610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:02.428980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.731743+0000","last_change":"2024-05-09T05:05:20.730842+0000","last_active":"2024-05-09T05:05:20.731743+0000","last_peered":"2024-05-09T05:05:20.731743+0000","last_clean":"2024-05-09T05:05:20.731743+0000","last_became_active":"2024-05-09T05:05:20.730516+0000","last_became_peered":"2024-05-09T05:05:20.730516+0000","last_unstale":"2024-05-09T05:05:20.731743+0000","last_undegraded":"2024-05-09T05:05:20.731743+0000","last_fullsized":"2024-05-09T05:05:20.731743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:02.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704749+0000","last_change":"2024-05-09T05:05:20.700678+0000","last_active":"2024-05-09T05:05:21.704749+0000","last_peered":"2024-05-09T05:05:21.704749+0000","last_clean":"2024-05-09T05:05:21.704749+0000","last_became_active":"2024-05-09T05:05:20.697751+0000","last_became_peered":"2024-05-09T05:05:20.697751+0000","last_unstale":"2024-05-09T05:05:21.704749+0000","last_undegraded":"2024-05-09T05:05:21.704749+0000","last_fullsized":"2024-05-09T05:05:21.704749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:27.088377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701161+0000","last_change":"2024-05-09T05:05:20.722945+0000","last_active":"2024-05-09T05:05:21.701161+0000","last_peered":"2024-05-09T05:05:21.701161+0000","last_clean":"2024-05-09T05:05:21.701161+0000","last_became_active":"2024-05-09T05:05:20.722712+0000","last_became_peered":"2024-05-09T05:05:20.722712+0000","last_unstale":"2024-05-09T05:05:21.701161+0000","last_undegraded":"2024-05-09T05:05:21.701161+0000","last_fullsized":"2024-05-09T05:05:21.701161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:02.966629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703905+0000","last_change":"2024-05-09T05:05:20.693653+0000","last_active":"2024-05-09T05:05:21.703905+0000","last_peered":"2024-05-09T05:05:21.703905+0000","last_clean":"2024-05-09T05:05:21.703905+0000","last_became_active":"2024-05-09T05:05:20.693310+0000","last_became_peered":"2024-05-09T05:05:20.693310+0000","last_unstale":"2024-05-09T05:05:21.703905+0000","last_undegraded":"2024-05-09T05:05:21.703905+0000","last_fullsized":"2024-05-09T05:05:21.703905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:41.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704016+0000","last_change":"2024-05-09T05:05:20.706205+0000","last_active":"2024-05-09T05:05:21.704016+0000","last_peered":"2024-05-09T05:05:21.704016+0000","last_clean":"2024-05-09T05:05:21.704016+0000","last_became_active":"2024-05-09T05:05:20.704653+0000","last_became_peered":"2024-05-09T05:05:20.704653+0000","last_unstale":"2024-05-09T05:05:21.704016+0000","last_undegraded":"2024-05-09T05:05:21.704016+0000","last_fullsized":"2024-05-09T05:05:21.704016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:02.524307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717767+0000","last_change":"2024-05-09T05:05:20.713412+0000","last_active":"2024-05-09T05:05:20.717767+0000","last_peered":"2024-05-09T05:05:20.717767+0000","last_clean":"2024-05-09T05:05:20.717767+0000","last_became_active":"2024-05-09T05:05:20.713094+0000","last_became_peered":"2024-05-09T05:05:20.713094+0000","last_unstale":"2024-05-09T05:05:20.717767+0000","last_undegraded":"2024-05-09T05:05:20.717767+0000","last_fullsized":"2024-05-09T05:05:20.717767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:15.277815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.719485+0000","last_change":"2024-05-09T05:05:20.717128+0000","last_active":"2024-05-09T05:05:20.719485+0000","last_peered":"2024-05-09T05:05:20.719485+0000","last_clean":"2024-05-09T05:05:20.719485+0000","last_became_active":"2024-05-09T05:05:20.715765+0000","last_became_peered":"2024-05-09T05:05:20.715765+0000","last_unstale":"2024-05-09T05:05:20.719485+0000","last_undegraded":"2024-05-09T05:05:20.719485+0000","last_fullsized":"2024-05-09T05:05:20.719485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705144+0000","last_change":"2024-05-09T05:05:20.728358+0000","last_active":"2024-05-09T05:05:21.705144+0000","last_peered":"2024-05-09T05:05:21.705144+0000","last_clean":"2024-05-09T05:05:21.705144+0000","last_became_active":"2024-05-09T05:05:20.724556+0000","last_became_peered":"2024-05-09T05:05:20.724556+0000","last_unstale":"2024-05-09T05:05:21.705144+0000","last_undegraded":"2024-05-09T05:05:21.705144+0000","last_fullsized":"2024-05-09T05:05:21.705144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:44.831017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705118+0000","last_change":"2024-05-09T05:05:20.715446+0000","last_active":"2024-05-09T05:05:21.705118+0000","last_peered":"2024-05-09T05:05:21.705118+0000","last_clean":"2024-05-09T05:05:21.705118+0000","last_became_active":"2024-05-09T05:05:20.711356+0000","last_became_peered":"2024-05-09T05:05:20.711356+0000","last_unstale":"2024-05-09T05:05:21.705118+0000","last_undegraded":"2024-05-09T05:05:21.705118+0000","last_fullsized":"2024-05-09T05:05:21.705118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:06:43.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701760+0000","last_change":"2024-05-09T05:05:20.711093+0000","last_active":"2024-05-09T05:05:21.701760+0000","last_peered":"2024-05-09T05:05:21.701760+0000","last_clean":"2024-05-09T05:05:21.701760+0000","last_became_active":"2024-05-09T05:05:20.706285+0000","last_became_peered":"2024-05-09T05:05:20.706285+0000","last_unstale":"2024-05-09T05:05:21.701760+0000","last_undegraded":"2024-05-09T05:05:21.701760+0000","last_fullsized":"2024-05-09T05:05:21.701760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:33.236625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.706468+0000","last_change":"2024-05-09T05:05:20.700240+0000","last_active":"2024-05-09T05:05:20.706468+0000","last_peered":"2024-05-09T05:05:20.706468+0000","last_clean":"2024-05-09T05:05:20.706468+0000","last_became_active":"2024-05-09T05:05:20.699974+0000","last_became_peered":"2024-05-09T05:05:20.699974+0000","last_unstale":"2024-05-09T05:05:20.706468+0000","last_undegraded":"2024-05-09T05:05:20.706468+0000","last_fullsized":"2024-05-09T05:05:20.706468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:02.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716423+0000","last_change":"2024-05-09T05:05:20.712019+0000","last_active":"2024-05-09T05:05:20.716423+0000","last_peered":"2024-05-09T05:05:20.716423+0000","last_clean":"2024-05-09T05:05:20.716423+0000","last_became_active":"2024-05-09T05:05:20.709191+0000","last_became_peered":"2024-05-09T05:05:20.709191+0000","last_unstale":"2024-05-09T05:05:20.716423+0000","last_undegraded":"2024-05-09T05:05:20.716423+0000","last_fullsized":"2024-05-09T05:05:20.716423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:56.294035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708389+0000","last_change":"2024-05-09T05:05:20.707560+0000","last_active":"2024-05-09T05:05:21.708389+0000","last_peered":"2024-05-09T05:05:21.708389+0000","last_clean":"2024-05-09T05:05:21.708389+0000","last_became_active":"2024-05-09T05:05:20.707292+0000","last_became_peered":"2024-05-09T05:05:20.707292+0000","last_unstale":"2024-05-09T05:05:21.708389+0000","last_undegraded":"2024-05-09T05:05:21.708389+0000","last_fullsized":"2024-05-09T05:05:21.708389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:39.758693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703804+0000","last_change":"2024-05-09T05:05:20.697629+0000","last_active":"2024-05-09T05:05:21.703804+0000","last_peered":"2024-05-09T05:05:21.703804+0000","last_clean":"2024-05-09T05:05:21.703804+0000","last_became_active":"2024-05-09T05:05:20.697340+0000","last_became_peered":"2024-05-09T05:05:20.697340+0000","last_unstale":"2024-05-09T05:05:21.703804+0000","last_undegraded":"2024-05-09T05:05:21.703804+0000","last_fullsized":"2024-05-09T05:05:21.703804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713546+0000","last_change":"2024-05-09T05:05:20.708695+0000","last_active":"2024-05-09T05:05:21.713546+0000","last_peered":"2024-05-09T05:05:21.713546+0000","last_clean":"2024-05-09T05:05:21.713546+0000","last_became_active":"2024-05-09T05:05:20.708335+0000","last_became_peered":"2024-05-09T05:05:20.708335+0000","last_unstale":"2024-05-09T05:05:21.713546+0000","last_undegraded":"2024-05-09T05:05:21.713546+0000","last_fullsized":"2024-05-09T05:05:21.713546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:06.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705262+0000","last_change":"2024-05-09T05:05:20.708731+0000","last_active":"2024-05-09T05:05:21.705262+0000","last_peered":"2024-05-09T05:05:21.705262+0000","last_clean":"2024-05-09T05:05:21.705262+0000","last_became_active":"2024-05-09T05:05:20.708085+0000","last_became_peered":"2024-05-09T05:05:20.708085+0000","last_unstale":"2024-05-09T05:05:21.705262+0000","last_undegraded":"2024-05-09T05:05:21.705262+0000","last_fullsized":"2024-05-09T05:05:21.705262+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:34.282027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713555+0000","last_change":"2024-05-09T05:05:20.713702+0000","last_active":"2024-05-09T05:05:21.713555+0000","last_peered":"2024-05-09T05:05:21.713555+0000","last_clean":"2024-05-09T05:05:21.713555+0000","last_became_active":"2024-05-09T05:05:20.713169+0000","last_became_peered":"2024-05-09T05:05:20.713169+0000","last_unstale":"2024-05-09T05:05:21.713555+0000","last_undegraded":"2024-05-09T05:05:21.713555+0000","last_fullsized":"2024-05-09T05:05:21.713555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:15.277815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704835+0000","last_change":"2024-05-09T05:05:20.696708+0000","last_active":"2024-05-09T05:05:21.704835+0000","last_peered":"2024-05-09T05:05:21.704835+0000","last_clean":"2024-05-09T05:05:21.704835+0000","last_became_active":"2024-05-09T05:05:20.696377+0000","last_became_peered":"2024-05-09T05:05:20.696377+0000","last_unstale":"2024-05-09T05:05:21.704835+0000","last_undegraded":"2024-05-09T05:05:21.704835+0000","last_fullsized":"2024-05-09T05:05:21.704835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:46.526610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.718647+0000","last_change":"2024-05-09T05:05:20.709566+0000","last_active":"2024-05-09T05:05:20.718647+0000","last_peered":"2024-05-09T05:05:20.718647+0000","last_clean":"2024-05-09T05:05:20.718647+0000","last_became_active":"2024-05-09T05:05:20.709249+0000","last_became_peered":"2024-05-09T05:05:20.709249+0000","last_unstale":"2024-05-09T05:05:20.718647+0000","last_undegraded":"2024-05-09T05:05:20.718647+0000","last_fullsized":"2024-05-09T05:05:20.718647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:52.483480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716701+0000","last_change":"2024-05-09T05:05:20.708485+0000","last_active":"2024-05-09T05:05:20.716701+0000","last_peered":"2024-05-09T05:05:20.716701+0000","last_clean":"2024-05-09T05:05:20.716701+0000","last_became_active":"2024-05-09T05:05:20.708207+0000","last_became_peered":"2024-05-09T05:05:20.708207+0000","last_unstale":"2024-05-09T05:05:20.716701+0000","last_undegraded":"2024-05-09T05:05:20.716701+0000","last_fullsized":"2024-05-09T05:05:20.716701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:35.514890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.711752+0000","last_change":"2024-05-09T05:05:20.705140+0000","last_active":"2024-05-09T05:05:20.711752+0000","last_peered":"2024-05-09T05:05:20.711752+0000","last_clean":"2024-05-09T05:05:20.711752+0000","last_became_active":"2024-05-09T05:05:20.704831+0000","last_became_peered":"2024-05-09T05:05:20.704831+0000","last_unstale":"2024-05-09T05:05:20.711752+0000","last_undegraded":"2024-05-09T05:05:20.711752+0000","last_fullsized":"2024-05-09T05:05:20.711752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:49.621021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717332+0000","last_change":"2024-05-09T05:05:20.709117+0000","last_active":"2024-05-09T05:05:20.717332+0000","last_peered":"2024-05-09T05:05:20.717332+0000","last_clean":"2024-05-09T05:05:20.717332+0000","last_became_active":"2024-05-09T05:05:20.708793+0000","last_became_peered":"2024-05-09T05:05:20.708793+0000","last_unstale":"2024-05-09T05:05:20.717332+0000","last_undegraded":"2024-05-09T05:05:20.717332+0000","last_fullsized":"2024-05-09T05:05:20.717332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:41:55.907395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708676+0000","last_change":"2024-05-09T05:05:20.710734+0000","last_active":"2024-05-09T05:05:21.708676+0000","last_peered":"2024-05-09T05:05:21.708676+0000","last_clean":"2024-05-09T05:05:21.708676+0000","last_became_active":"2024-05-09T05:05:20.710481+0000","last_became_peered":"2024-05-09T05:05:20.710481+0000","last_unstale":"2024-05-09T05:05:21.708676+0000","last_undegraded":"2024-05-09T05:05:21.708676+0000","last_fullsized":"2024-05-09T05:05:21.708676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:53:53.603845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.718279+0000","last_change":"2024-05-09T05:05:19.703849+0000","last_active":"2024-05-09T05:05:20.718279+0000","last_peered":"2024-05-09T05:05:20.718279+0000","last_clean":"2024-05-09T05:05:20.718279+0000","last_became_active":"2024-05-09T05:05:19.702065+0000","last_became_peered":"2024-05-09T05:05:19.702065+0000","last_unstale":"2024-05-09T05:05:20.718279+0000","last_undegraded":"2024-05-09T05:05:20.718279+0000","last_fullsized":"2024-05-09T05:05:20.718279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.715845+0000","last_change":"2024-05-09T05:05:20.712830+0000","last_active":"2024-05-09T05:05:20.715845+0000","last_peered":"2024-05-09T05:05:20.715845+0000","last_clean":"2024-05-09T05:05:20.715845+0000","last_became_active":"2024-05-09T05:05:20.712519+0000","last_became_peered":"2024-05-09T05:05:20.712519+0000","last_unstale":"2024-05-09T05:05:20.715845+0000","last_undegraded":"2024-05-09T05:05:20.715845+0000","last_fullsized":"2024-05-09T05:05:20.715845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:52.483480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708499+0000","last_change":"2024-05-09T05:05:19.698667+0000","last_active":"2024-05-09T05:05:21.708499+0000","last_peered":"2024-05-09T05:05:21.708499+0000","last_clean":"2024-05-09T05:05:21.708499+0000","last_became_active":"2024-05-09T05:05:19.697642+0000","last_became_peered":"2024-05-09T05:05:19.697642+0000","last_unstale":"2024-05-09T05:05:21.708499+0000","last_undegraded":"2024-05-09T05:05:21.708499+0000","last_fullsized":"2024-05-09T05:05:21.708499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716047+0000","last_change":"2024-05-09T05:05:20.711117+0000","last_active":"2024-05-09T05:05:20.716047+0000","last_peered":"2024-05-09T05:05:20.716047+0000","last_clean":"2024-05-09T05:05:20.716047+0000","last_became_active":"2024-05-09T05:05:20.709512+0000","last_became_peered":"2024-05-09T05:05:20.709512+0000","last_unstale":"2024-05-09T05:05:20.716047+0000","last_undegraded":"2024-05-09T05:05:20.716047+0000","last_fullsized":"2024-05-09T05:05:20.716047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:34.268678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704568+0000","last_change":"2024-05-09T05:05:19.686507+0000","last_active":"2024-05-09T05:05:21.704568+0000","last_peered":"2024-05-09T05:05:21.704568+0000","last_clean":"2024-05-09T05:05:21.704568+0000","last_became_active":"2024-05-09T05:05:19.686207+0000","last_became_peered":"2024-05-09T05:05:19.686207+0000","last_unstale":"2024-05-09T05:05:21.704568+0000","last_undegraded":"2024-05-09T05:05:21.704568+0000","last_fullsized":"2024-05-09T05:05:21.704568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:55.279622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713781+0000","last_change":"2024-05-09T05:05:20.713417+0000","last_active":"2024-05-09T05:05:21.713781+0000","last_peered":"2024-05-09T05:05:21.713781+0000","last_clean":"2024-05-09T05:05:21.713781+0000","last_became_active":"2024-05-09T05:05:20.712829+0000","last_became_peered":"2024-05-09T05:05:20.712829+0000","last_unstale":"2024-05-09T05:05:21.713781+0000","last_undegraded":"2024-05-09T05:05:21.713781+0000","last_fullsized":"2024-05-09T05:05:21.713781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701660+0000","last_change":"2024-05-09T05:05:19.694319+0000","last_active":"2024-05-09T05:05:21.701660+0000","last_peered":"2024-05-09T05:05:21.701660+0000","last_clean":"2024-05-09T05:05:21.701660+0000","last_became_active":"2024-05-09T05:05:19.693984+0000","last_became_peered":"2024-05-09T05:05:19.693984+0000","last_unstale":"2024-05-09T05:05:21.701660+0000","last_undegraded":"2024-05-09T05:05:21.701660+0000","last_fullsized":"2024-05-09T05:05:21.701660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:12.107329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716834+0000","last_change":"2024-05-09T05:05:20.708929+0000","last_active":"2024-05-09T05:05:20.716834+0000","last_peered":"2024-05-09T05:05:20.716834+0000","last_clean":"2024-05-09T05:05:20.716834+0000","last_became_active":"2024-05-09T05:05:20.707694+0000","last_became_peered":"2024-05-09T05:05:20.707694+0000","last_unstale":"2024-05-09T05:05:20.716834+0000","last_undegraded":"2024-05-09T05:05:20.716834+0000","last_fullsized":"2024-05-09T05:05:20.716834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:23.552137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.723894+0000","last_change":"2024-05-09T05:05:19.700536+0000","last_active":"2024-05-09T05:05:20.723894+0000","last_peered":"2024-05-09T05:05:20.723894+0000","last_clean":"2024-05-09T05:05:20.723894+0000","last_became_active":"2024-05-09T05:05:19.700245+0000","last_became_peered":"2024-05-09T05:05:19.700245+0000","last_unstale":"2024-05-09T05:05:20.723894+0000","last_undegraded":"2024-05-09T05:05:20.723894+0000","last_fullsized":"2024-05-09T05:05:20.723894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:00:01.952216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704475+0000","last_change":"2024-05-09T05:05:20.697065+0000","last_active":"2024-05-09T05:05:21.704475+0000","last_peered":"2024-05-09T05:05:21.704475+0000","last_clean":"2024-05-09T05:05:21.704475+0000","last_became_active":"2024-05-09T05:05:20.696750+0000","last_became_peered":"2024-05-09T05:05:20.696750+0000","last_unstale":"2024-05-09T05:05:21.704475+0000","last_undegraded":"2024-05-09T05:05:21.704475+0000","last_fullsized":"2024-05-09T05:05:21.704475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:41.524183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.721744+0000","last_change":"2024-05-09T05:05:19.694267+0000","last_active":"2024-05-09T05:05:20.721744+0000","last_peered":"2024-05-09T05:05:20.721744+0000","last_clean":"2024-05-09T05:05:20.721744+0000","last_became_active":"2024-05-09T05:05:19.692996+0000","last_became_peered":"2024-05-09T05:05:19.692996+0000","last_unstale":"2024-05-09T05:05:20.721744+0000","last_undegraded":"2024-05-09T05:05:20.721744+0000","last_fullsized":"2024-05-09T05:05:20.721744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:23.634652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.714862+0000","last_change":"2024-05-09T05:05:20.705534+0000","last_active":"2024-05-09T05:05:20.714862+0000","last_peered":"2024-05-09T05:05:20.714862+0000","last_clean":"2024-05-09T05:05:20.714862+0000","last_became_active":"2024-05-09T05:05:20.704060+0000","last_became_peered":"2024-05-09T05:05:20.704060+0000","last_unstale":"2024-05-09T05:05:20.714862+0000","last_undegraded":"2024-05-09T05:05:20.714862+0000","last_fullsized":"2024-05-09T05:05:20.714862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:20.928452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703399+0000","last_change":"2024-05-09T05:05:19.686003+0000","last_active":"2024-05-09T05:05:21.703399+0000","last_peered":"2024-05-09T05:05:21.703399+0000","last_clean":"2024-05-09T05:05:21.703399+0000","last_became_active":"2024-05-09T05:05:19.685625+0000","last_became_peered":"2024-05-09T05:05:19.685625+0000","last_unstale":"2024-05-09T05:05:21.703399+0000","last_undegraded":"2024-05-09T05:05:21.703399+0000","last_fullsized":"2024-05-09T05:05:21.703399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:03.738324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712571+0000","last_change":"2024-05-09T05:05:20.684494+0000","last_active":"2024-05-09T05:05:21.712571+0000","last_peered":"2024-05-09T05:05:21.712571+0000","last_clean":"2024-05-09T05:05:21.712571+0000","last_became_active":"2024-05-09T05:05:20.684215+0000","last_became_peered":"2024-05-09T05:05:20.684215+0000","last_unstale":"2024-05-09T05:05:21.712571+0000","last_undegraded":"2024-05-09T05:05:21.712571+0000","last_fullsized":"2024-05-09T05:05:21.712571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:35.514890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.693164+0000","last_change":"2024-05-09T05:05:19.702146+0000","last_active":"2024-05-09T05:05:20.693164+0000","last_peered":"2024-05-09T05:05:20.693164+0000","last_clean":"2024-05-09T05:05:20.693164+0000","last_became_active":"2024-05-09T05:05:19.701806+0000","last_became_peered":"2024-05-09T05:05:19.701806+0000","last_unstale":"2024-05-09T05:05:20.693164+0000","last_undegraded":"2024-05-09T05:05:20.693164+0000","last_fullsized":"2024-05-09T05:05:20.693164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:43.196316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705348+0000","last_change":"2024-05-09T05:05:20.697556+0000","last_active":"2024-05-09T05:05:21.705348+0000","last_peered":"2024-05-09T05:05:21.705348+0000","last_clean":"2024-05-09T05:05:21.705348+0000","last_became_active":"2024-05-09T05:05:20.696543+0000","last_became_peered":"2024-05-09T05:05:20.696543+0000","last_unstale":"2024-05-09T05:05:21.705348+0000","last_undegraded":"2024-05-09T05:05:21.705348+0000","last_fullsized":"2024-05-09T05:05:21.705348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:47:44.831017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705553+0000","last_change":"2024-05-09T05:05:19.691827+0000","last_active":"2024-05-09T05:05:21.705553+0000","last_peered":"2024-05-09T05:05:21.705553+0000","last_clean":"2024-05-09T05:05:21.705553+0000","last_became_active":"2024-05-09T05:05:19.691476+0000","last_became_peered":"2024-05-09T05:05:19.691476+0000","last_unstale":"2024-05-09T05:05:21.705553+0000","last_undegraded":"2024-05-09T05:05:21.705553+0000","last_fullsized":"2024-05-09T05:05:21.705553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:38.744280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705470+0000","last_change":"2024-05-09T05:05:20.705962+0000","last_active":"2024-05-09T05:05:21.705470+0000","last_peered":"2024-05-09T05:05:21.705470+0000","last_clean":"2024-05-09T05:05:21.705470+0000","last_became_active":"2024-05-09T05:05:20.705396+0000","last_became_peered":"2024-05-09T05:05:20.705396+0000","last_unstale":"2024-05-09T05:05:21.705470+0000","last_undegraded":"2024-05-09T05:05:21.705470+0000","last_fullsized":"2024-05-09T05:05:21.705470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:17.566126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708582+0000","last_change":"2024-05-09T05:05:19.699552+0000","last_active":"2024-05-09T05:05:21.708582+0000","last_peered":"2024-05-09T05:05:21.708582+0000","last_clean":"2024-05-09T05:05:21.708582+0000","last_became_active":"2024-05-09T05:05:19.697143+0000","last_became_peered":"2024-05-09T05:05:19.697143+0000","last_unstale":"2024-05-09T05:05:21.708582+0000","last_undegraded":"2024-05-09T05:05:21.708582+0000","last_fullsized":"2024-05-09T05:05:21.708582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:01.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704598+0000","last_change":"2024-05-09T05:05:20.710035+0000","last_active":"2024-05-09T05:05:21.704598+0000","last_peered":"2024-05-09T05:05:21.704598+0000","last_clean":"2024-05-09T05:05:21.704598+0000","last_became_active":"2024-05-09T05:05:20.708125+0000","last_became_peered":"2024-05-09T05:05:20.708125+0000","last_unstale":"2024-05-09T05:05:21.704598+0000","last_undegraded":"2024-05-09T05:05:21.704598+0000","last_fullsized":"2024-05-09T05:05:21.704598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:47:27.088377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705353+0000","last_change":"2024-05-09T05:05:19.696117+0000","last_active":"2024-05-09T05:05:21.705353+0000","last_peered":"2024-05-09T05:05:21.705353+0000","last_clean":"2024-05-09T05:05:21.705353+0000","last_became_active":"2024-05-09T05:05:19.695811+0000","last_became_peered":"2024-05-09T05:05:19.695811+0000","last_unstale":"2024-05-09T05:05:21.705353+0000","last_undegraded":"2024-05-09T05:05:21.705353+0000","last_fullsized":"2024-05-09T05:05:21.705353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:23:31.261214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704716+0000","last_change":"2024-05-09T05:05:20.689561+0000","last_active":"2024-05-09T05:05:21.704716+0000","last_peered":"2024-05-09T05:05:21.704716+0000","last_clean":"2024-05-09T05:05:21.704716+0000","last_became_active":"2024-05-09T05:05:20.688795+0000","last_became_peered":"2024-05-09T05:05:20.688795+0000","last_unstale":"2024-05-09T05:05:21.704716+0000","last_undegraded":"2024-05-09T05:05:21.704716+0000","last_fullsized":"2024-05-09T05:05:21.704716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:00.145749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704698+0000","last_change":"2024-05-09T05:05:19.691937+0000","last_active":"2024-05-09T05:05:21.704698+0000","last_peered":"2024-05-09T05:05:21.704698+0000","last_clean":"2024-05-09T05:05:21.704698+0000","last_became_active":"2024-05-09T05:05:19.691322+0000","last_became_peered":"2024-05-09T05:05:19.691322+0000","last_unstale":"2024-05-09T05:05:21.704698+0000","last_undegraded":"2024-05-09T05:05:21.704698+0000","last_fullsized":"2024-05-09T05:05:21.704698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:23:31.261214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712758+0000","last_change":"2024-05-09T05:05:20.717097+0000","last_active":"2024-05-09T05:05:21.712758+0000","last_peered":"2024-05-09T05:05:21.712758+0000","last_clean":"2024-05-09T05:05:21.712758+0000","last_became_active":"2024-05-09T05:05:20.716828+0000","last_became_peered":"2024-05-09T05:05:20.716828+0000","last_unstale":"2024-05-09T05:05:21.712758+0000","last_undegraded":"2024-05-09T05:05:21.712758+0000","last_fullsized":"2024-05-09T05:05:21.712758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:23.552137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.722540+0000","last_change":"2024-05-09T05:05:19.704552+0000","last_active":"2024-05-09T05:05:20.722540+0000","last_peered":"2024-05-09T05:05:20.722540+0000","last_clean":"2024-05-09T05:05:20.722540+0000","last_became_active":"2024-05-09T05:05:19.704254+0000","last_became_peered":"2024-05-09T05:05:19.704254+0000","last_unstale":"2024-05-09T05:05:20.722540+0000","last_undegraded":"2024-05-09T05:05:20.722540+0000","last_fullsized":"2024-05-09T05:05:20.722540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:06.387644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.704393+0000","last_change":"2024-05-09T05:05:20.697934+0000","last_active":"2024-05-09T05:05:21.704393+0000","last_peered":"2024-05-09T05:05:21.704393+0000","last_clean":"2024-05-09T05:05:21.704393+0000","last_became_active":"2024-05-09T05:05:20.697601+0000","last_became_peered":"2024-05-09T05:05:20.697601+0000","last_unstale":"2024-05-09T05:05:21.704393+0000","last_undegraded":"2024-05-09T05:05:21.704393+0000","last_fullsized":"2024-05-09T05:05:21.704393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:12:00.145749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712729+0000","last_change":"2024-05-09T05:05:19.699753+0000","last_active":"2024-05-09T05:05:21.712729+0000","last_peered":"2024-05-09T05:05:21.712729+0000","last_clean":"2024-05-09T05:05:21.712729+0000","last_became_active":"2024-05-09T05:05:19.699474+0000","last_became_peered":"2024-05-09T05:05:19.699474+0000","last_unstale":"2024-05-09T05:05:21.712729+0000","last_undegraded":"2024-05-09T05:05:21.712729+0000","last_fullsized":"2024-05-09T05:05:21.712729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:01.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717949+0000","last_change":"2024-05-09T05:05:20.714857+0000","last_active":"2024-05-09T05:05:20.717949+0000","last_peered":"2024-05-09T05:05:20.717949+0000","last_clean":"2024-05-09T05:05:20.717949+0000","last_became_active":"2024-05-09T05:05:20.714551+0000","last_became_peered":"2024-05-09T05:05:20.714551+0000","last_unstale":"2024-05-09T05:05:20.717949+0000","last_undegraded":"2024-05-09T05:05:20.717949+0000","last_fullsized":"2024-05-09T05:05:20.717949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:02.428980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703495+0000","last_change":"2024-05-09T05:05:19.692580+0000","last_active":"2024-05-09T05:05:21.703495+0000","last_peered":"2024-05-09T05:05:21.703495+0000","last_clean":"2024-05-09T05:05:21.703495+0000","last_became_active":"2024-05-09T05:05:19.692278+0000","last_became_peered":"2024-05-09T05:05:19.692278+0000","last_unstale":"2024-05-09T05:05:21.703495+0000","last_undegraded":"2024-05-09T05:05:21.703495+0000","last_fullsized":"2024-05-09T05:05:21.703495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:33.254266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.711727+0000","last_change":"2024-05-09T05:05:20.703241+0000","last_active":"2024-05-09T05:05:20.711727+0000","last_peered":"2024-05-09T05:05:20.711727+0000","last_clean":"2024-05-09T05:05:20.711727+0000","last_became_active":"2024-05-09T05:05:20.702925+0000","last_became_peered":"2024-05-09T05:05:20.702925+0000","last_unstale":"2024-05-09T05:05:20.711727+0000","last_undegraded":"2024-05-09T05:05:20.711727+0000","last_fullsized":"2024-05-09T05:05:20.711727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:18:02.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703242+0000","last_change":"2024-05-09T05:05:19.683961+0000","last_active":"2024-05-09T05:05:21.703242+0000","last_peered":"2024-05-09T05:05:21.703242+0000","last_clean":"2024-05-09T05:05:21.703242+0000","last_became_active":"2024-05-09T05:05:19.683281+0000","last_became_peered":"2024-05-09T05:05:19.683281+0000","last_unstale":"2024-05-09T05:05:21.703242+0000","last_undegraded":"2024-05-09T05:05:21.703242+0000","last_fullsized":"2024-05-09T05:05:21.703242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:19.914040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.714176+0000","last_change":"2024-05-09T05:05:20.705392+0000","last_active":"2024-05-09T05:05:20.714176+0000","last_peered":"2024-05-09T05:05:20.714176+0000","last_clean":"2024-05-09T05:05:20.714176+0000","last_became_active":"2024-05-09T05:05:20.705032+0000","last_became_peered":"2024-05-09T05:05:20.705032+0000","last_unstale":"2024-05-09T05:05:20.714176+0000","last_undegraded":"2024-05-09T05:05:20.714176+0000","last_fullsized":"2024-05-09T05:05:20.714176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:49.621021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713609+0000","last_change":"2024-05-09T05:05:19.688690+0000","last_active":"2024-05-09T05:05:21.713609+0000","last_peered":"2024-05-09T05:05:21.713609+0000","last_clean":"2024-05-09T05:05:21.713609+0000","last_became_active":"2024-05-09T05:05:19.688171+0000","last_became_peered":"2024-05-09T05:05:19.688171+0000","last_unstale":"2024-05-09T05:05:21.713609+0000","last_undegraded":"2024-05-09T05:05:21.713609+0000","last_fullsized":"2024-05-09T05:05:21.713609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705417+0000","last_change":"2024-05-09T05:05:20.701302+0000","last_active":"2024-05-09T05:05:21.705417+0000","last_peered":"2024-05-09T05:05:21.705417+0000","last_clean":"2024-05-09T05:05:21.705417+0000","last_became_active":"2024-05-09T05:05:20.700110+0000","last_became_peered":"2024-05-09T05:05:20.700110+0000","last_unstale":"2024-05-09T05:05:21.705417+0000","last_undegraded":"2024-05-09T05:05:21.705417+0000","last_fullsized":"2024-05-09T05:05:21.705417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:34.282027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717624+0000","last_change":"2024-05-09T05:05:19.702844+0000","last_active":"2024-05-09T05:05:20.717624+0000","last_peered":"2024-05-09T05:05:20.717624+0000","last_clean":"2024-05-09T05:05:20.717624+0000","last_became_active":"2024-05-09T05:05:19.702209+0000","last_became_peered":"2024-05-09T05:05:19.702209+0000","last_unstale":"2024-05-09T05:05:20.717624+0000","last_undegraded":"2024-05-09T05:05:20.717624+0000","last_fullsized":"2024-05-09T05:05:20.717624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:32.222213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712986+0000","last_change":"2024-05-09T05:05:20.712678+0000","last_active":"2024-05-09T05:05:21.712986+0000","last_peered":"2024-05-09T05:05:21.712986+0000","last_clean":"2024-05-09T05:05:21.712986+0000","last_became_active":"2024-05-09T05:05:20.712373+0000","last_became_peered":"2024-05-09T05:05:20.712373+0000","last_unstale":"2024-05-09T05:05:21.712986+0000","last_undegraded":"2024-05-09T05:05:21.712986+0000","last_fullsized":"2024-05-09T05:05:21.712986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:41:16.816105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.718848+0000","last_change":"2024-05-09T05:05:19.699398+0000","last_active":"2024-05-09T05:05:20.718848+0000","last_peered":"2024-05-09T05:05:20.718848+0000","last_clean":"2024-05-09T05:05:20.718848+0000","last_became_active":"2024-05-09T05:05:19.699011+0000","last_became_peered":"2024-05-09T05:05:19.699011+0000","last_unstale":"2024-05-09T05:05:20.718848+0000","last_undegraded":"2024-05-09T05:05:20.718848+0000","last_fullsized":"2024-05-09T05:05:20.718848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:03.639828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701882+0000","last_change":"2024-05-09T05:05:20.710239+0000","last_active":"2024-05-09T05:05:21.701882+0000","last_peered":"2024-05-09T05:05:21.701882+0000","last_clean":"2024-05-09T05:05:21.701882+0000","last_became_active":"2024-05-09T05:05:20.709997+0000","last_became_peered":"2024-05-09T05:05:20.709997+0000","last_unstale":"2024-05-09T05:05:21.701882+0000","last_undegraded":"2024-05-09T05:05:21.701882+0000","last_fullsized":"2024-05-09T05:05:21.701882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:54:04.654241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.698794+0000","last_change":"2024-05-09T05:05:19.693797+0000","last_active":"2024-05-09T05:05:20.698794+0000","last_peered":"2024-05-09T05:05:20.698794+0000","last_clean":"2024-05-09T05:05:20.698794+0000","last_became_active":"2024-05-09T05:05:19.693505+0000","last_became_peered":"2024-05-09T05:05:19.693505+0000","last_unstale":"2024-05-09T05:05:20.698794+0000","last_undegraded":"2024-05-09T05:05:20.698794+0000","last_fullsized":"2024-05-09T05:05:20.698794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:52.732633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701504+0000","last_change":"2024-05-09T05:05:20.696919+0000","last_active":"2024-05-09T05:05:21.701504+0000","last_peered":"2024-05-09T05:05:21.701504+0000","last_clean":"2024-05-09T05:05:21.701504+0000","last_became_active":"2024-05-09T05:05:20.696628+0000","last_became_peered":"2024-05-09T05:05:20.696628+0000","last_unstale":"2024-05-09T05:05:21.701504+0000","last_undegraded":"2024-05-09T05:05:21.701504+0000","last_fullsized":"2024-05-09T05:05:21.701504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:53.747045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708992+0000","last_change":"2024-05-09T05:05:19.695385+0000","last_active":"2024-05-09T05:05:21.708992+0000","last_peered":"2024-05-09T05:05:21.708992+0000","last_clean":"2024-05-09T05:05:21.708992+0000","last_became_active":"2024-05-09T05:05:19.693753+0000","last_became_peered":"2024-05-09T05:05:19.693753+0000","last_unstale":"2024-05-09T05:05:21.708992+0000","last_undegraded":"2024-05-09T05:05:21.708992+0000","last_fullsized":"2024-05-09T05:05:21.708992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:19.914040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701210+0000","last_change":"2024-05-09T05:05:20.699143+0000","last_active":"2024-05-09T05:05:21.701210+0000","last_peered":"2024-05-09T05:05:21.701210+0000","last_clean":"2024-05-09T05:05:21.701210+0000","last_became_active":"2024-05-09T05:05:20.698832+0000","last_became_peered":"2024-05-09T05:05:20.698832+0000","last_unstale":"2024-05-09T05:05:21.701210+0000","last_undegraded":"2024-05-09T05:05:21.701210+0000","last_fullsized":"2024-05-09T05:05:21.701210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:37.389279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.700469+0000","last_change":"2024-05-09T05:05:19.703160+0000","last_active":"2024-05-09T05:05:20.700469+0000","last_peered":"2024-05-09T05:05:20.700469+0000","last_clean":"2024-05-09T05:05:20.700469+0000","last_became_active":"2024-05-09T05:05:19.702750+0000","last_became_peered":"2024-05-09T05:05:19.702750+0000","last_unstale":"2024-05-09T05:05:20.700469+0000","last_undegraded":"2024-05-09T05:05:20.700469+0000","last_fullsized":"2024-05-09T05:05:20.700469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:52.732633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.700735+0000","last_change":"2024-05-09T05:05:20.695033+0000","last_active":"2024-05-09T05:05:21.700735+0000","last_peered":"2024-05-09T05:05:21.700735+0000","last_clean":"2024-05-09T05:05:21.700735+0000","last_became_active":"2024-05-09T05:05:20.694752+0000","last_became_peered":"2024-05-09T05:05:20.694752+0000","last_unstale":"2024-05-09T05:05:21.700735+0000","last_undegraded":"2024-05-09T05:05:21.700735+0000","last_fullsized":"2024-05-09T05:05:21.700735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:44.210729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.693146+0000","last_change":"2024-05-09T05:05:19.695547+0000","last_active":"2024-05-09T05:05:20.693146+0000","last_peered":"2024-05-09T05:05:20.693146+0000","last_clean":"2024-05-09T05:05:20.693146+0000","last_became_active":"2024-05-09T05:05:19.695341+0000","last_became_peered":"2024-05-09T05:05:19.695341+0000","last_unstale":"2024-05-09T05:05:20.693146+0000","last_undegraded":"2024-05-09T05:05:20.693146+0000","last_fullsized":"2024-05-09T05:05:20.693146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:18.438609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717312+0000","last_change":"2024-05-09T05:05:20.709670+0000","last_active":"2024-05-09T05:05:20.717312+0000","last_peered":"2024-05-09T05:05:20.717312+0000","last_clean":"2024-05-09T05:05:20.717312+0000","last_became_active":"2024-05-09T05:05:20.709162+0000","last_became_peered":"2024-05-09T05:05:20.709162+0000","last_unstale":"2024-05-09T05:05:20.717312+0000","last_undegraded":"2024-05-09T05:05:20.717312+0000","last_fullsized":"2024-05-09T05:05:20.717312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:06.191775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703699+0000","last_change":"2024-05-09T05:05:19.699217+0000","last_active":"2024-05-09T05:05:21.703699+0000","last_peered":"2024-05-09T05:05:21.703699+0000","last_clean":"2024-05-09T05:05:21.703699+0000","last_became_active":"2024-05-09T05:05:19.698780+0000","last_became_peered":"2024-05-09T05:05:19.698780+0000","last_unstale":"2024-05-09T05:05:21.703699+0000","last_undegraded":"2024-05-09T05:05:21.703699+0000","last_fullsized":"2024-05-09T05:05:21.703699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:55.279622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.701419+0000","last_change":"2024-05-09T05:05:20.714324+0000","last_active":"2024-05-09T05:05:21.701419+0000","last_peered":"2024-05-09T05:05:21.701419+0000","last_clean":"2024-05-09T05:05:21.701419+0000","last_became_active":"2024-05-09T05:05:20.714038+0000","last_became_peered":"2024-05-09T05:05:20.714038+0000","last_unstale":"2024-05-09T05:05:21.701419+0000","last_undegraded":"2024-05-09T05:05:21.701419+0000","last_fullsized":"2024-05-09T05:05:21.701419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:07.402057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713663+0000","last_change":"2024-05-09T05:05:19.696833+0000","last_active":"2024-05-09T05:05:21.713663+0000","last_peered":"2024-05-09T05:05:21.713663+0000","last_clean":"2024-05-09T05:05:21.713663+0000","last_became_active":"2024-05-09T05:05:19.696453+0000","last_became_peered":"2024-05-09T05:05:19.696453+0000","last_unstale":"2024-05-09T05:05:21.713663+0000","last_undegraded":"2024-05-09T05:05:21.713663+0000","last_fullsized":"2024-05-09T05:05:21.713663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:48.606608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.705678+0000","last_change":"2024-05-09T05:05:20.691893+0000","last_active":"2024-05-09T05:05:21.705678+0000","last_peered":"2024-05-09T05:05:21.705678+0000","last_clean":"2024-05-09T05:05:21.705678+0000","last_became_active":"2024-05-09T05:05:20.688202+0000","last_became_peered":"2024-05-09T05:05:20.688202+0000","last_unstale":"2024-05-09T05:05:21.705678+0000","last_undegraded":"2024-05-09T05:05:21.705678+0000","last_fullsized":"2024-05-09T05:05:21.705678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:07:17.566126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.711011+0000","last_change":"2024-05-09T05:05:19.694457+0000","last_active":"2024-05-09T05:05:21.711011+0000","last_peered":"2024-05-09T05:05:21.711011+0000","last_clean":"2024-05-09T05:05:21.711011+0000","last_became_active":"2024-05-09T05:05:19.694039+0000","last_became_peered":"2024-05-09T05:05:19.694039+0000","last_unstale":"2024-05-09T05:05:21.711011+0000","last_undegraded":"2024-05-09T05:05:21.711011+0000","last_fullsized":"2024-05-09T05:05:21.711011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:48.606608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708402+0000","last_change":"2024-05-09T05:05:20.688077+0000","last_active":"2024-05-09T05:05:21.708402+0000","last_peered":"2024-05-09T05:05:21.708402+0000","last_clean":"2024-05-09T05:05:21.708402+0000","last_became_active":"2024-05-09T05:05:20.687799+0000","last_became_peered":"2024-05-09T05:05:20.687799+0000","last_unstale":"2024-05-09T05:05:21.708402+0000","last_undegraded":"2024-05-09T05:05:21.708402+0000","last_fullsized":"2024-05-09T05:05:21.708402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:16.906676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.713072+0000","last_change":"2024-05-09T05:05:19.692750+0000","last_active":"2024-05-09T05:05:21.713072+0000","last_peered":"2024-05-09T05:05:21.713072+0000","last_clean":"2024-05-09T05:05:21.713072+0000","last_became_active":"2024-05-09T05:05:19.692479+0000","last_became_peered":"2024-05-09T05:05:19.692479+0000","last_unstale":"2024-05-09T05:05:21.713072+0000","last_undegraded":"2024-05-09T05:05:21.713072+0000","last_fullsized":"2024-05-09T05:05:21.713072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:32.222213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.707468+0000","last_change":"2024-05-09T05:05:20.702350+0000","last_active":"2024-05-09T05:05:20.707468+0000","last_peered":"2024-05-09T05:05:20.707468+0000","last_clean":"2024-05-09T05:05:20.707468+0000","last_became_active":"2024-05-09T05:05:20.702050+0000","last_became_peered":"2024-05-09T05:05:20.702050+0000","last_unstale":"2024-05-09T05:05:20.707468+0000","last_undegraded":"2024-05-09T05:05:20.707468+0000","last_fullsized":"2024-05-09T05:05:20.707468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:33.236625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708967+0000","last_change":"2024-05-09T05:05:19.696025+0000","last_active":"2024-05-09T05:05:21.708967+0000","last_peered":"2024-05-09T05:05:21.708967+0000","last_clean":"2024-05-09T05:05:21.708967+0000","last_became_active":"2024-05-09T05:05:19.695721+0000","last_became_peered":"2024-05-09T05:05:19.695721+0000","last_unstale":"2024-05-09T05:05:21.708967+0000","last_undegraded":"2024-05-09T05:05:21.708967+0000","last_fullsized":"2024-05-09T05:05:21.708967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:51.469068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.708712+0000","last_change":"2024-05-09T05:05:20.709953+0000","last_active":"2024-05-09T05:05:21.708712+0000","last_peered":"2024-05-09T05:05:21.708712+0000","last_clean":"2024-05-09T05:05:21.708712+0000","last_became_active":"2024-05-09T05:05:20.709661+0000","last_became_peered":"2024-05-09T05:05:20.709661+0000","last_unstale":"2024-05-09T05:05:21.708712+0000","last_undegraded":"2024-05-09T05:05:21.708712+0000","last_fullsized":"2024-05-09T05:05:21.708712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:02.432292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.712831+0000","last_change":"2024-05-09T05:05:19.696048+0000","last_active":"2024-05-09T05:05:21.712831+0000","last_peered":"2024-05-09T05:05:21.712831+0000","last_clean":"2024-05-09T05:05:21.712831+0000","last_became_active":"2024-05-09T05:05:19.695748+0000","last_became_peered":"2024-05-09T05:05:19.695748+0000","last_unstale":"2024-05-09T05:05:21.712831+0000","last_undegraded":"2024-05-09T05:05:21.712831+0000","last_fullsized":"2024-05-09T05:05:21.712831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:19.914040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703479+0000","last_change":"2024-05-09T05:05:20.687149+0000","last_active":"2024-05-09T05:05:21.703479+0000","last_peered":"2024-05-09T05:05:21.703479+0000","last_clean":"2024-05-09T05:05:21.703479+0000","last_became_active":"2024-05-09T05:05:20.686859+0000","last_became_peered":"2024-05-09T05:05:20.686859+0000","last_unstale":"2024-05-09T05:05:21.703479+0000","last_undegraded":"2024-05-09T05:05:21.703479+0000","last_fullsized":"2024-05-09T05:05:21.703479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:00.339366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.693581+0000","last_change":"2024-05-09T05:05:19.700290+0000","last_active":"2024-05-09T05:05:20.693581+0000","last_peered":"2024-05-09T05:05:20.693581+0000","last_clean":"2024-05-09T05:05:20.693581+0000","last_became_active":"2024-05-09T05:05:19.699956+0000","last_became_peered":"2024-05-09T05:05:19.699956+0000","last_unstale":"2024-05-09T05:05:20.693581+0000","last_undegraded":"2024-05-09T05:05:20.693581+0000","last_fullsized":"2024-05-09T05:05:20.693581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:36.374866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.716253+0000","last_change":"2024-05-09T05:05:20.711134+0000","last_active":"2024-05-09T05:05:20.716253+0000","last_peered":"2024-05-09T05:05:20.716253+0000","last_clean":"2024-05-09T05:05:20.716253+0000","last_became_active":"2024-05-09T05:05:20.709105+0000","last_became_peered":"2024-05-09T05:05:20.709105+0000","last_unstale":"2024-05-09T05:05:20.716253+0000","last_undegraded":"2024-05-09T05:05:20.716253+0000","last_fullsized":"2024-05-09T05:05:20.716253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:04:04.752736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-09T05:05:21.703346+0000","last_change":"2024-05-09T05:05:19.698511+0000","last_active":"2024-05-09T05:05:21.703346+0000","last_peered":"2024-05-09T05:05:21.703346+0000","last_clean":"2024-05-09T05:05:21.703346+0000","last_became_active":"2024-05-09T05:05:19.698184+0000","last_became_peered":"2024-05-09T05:05:19.698184+0000","last_unstale":"2024-05-09T05:05:21.703346+0000","last_undegraded":"2024-05-09T05:05:21.703346+0000","last_fullsized":"2024-05-09T05:05:21.703346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:51.469068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.717194+0000","last_change":"2024-05-09T05:05:20.706812+0000","last_active":"2024-05-09T05:05:20.717194+0000","last_peered":"2024-05-09T05:05:20.717194+0000","last_clean":"2024-05-09T05:05:20.717194+0000","last_became_active":"2024-05-09T05:05:20.706396+0000","last_became_peered":"2024-05-09T05:05:20.706396+0000","last_unstale":"2024-05-09T05:05:20.717194+0000","last_undegraded":"2024-05-09T05:05:20.717194+0000","last_fullsized":"2024-05-09T05:05:20.717194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:19.646639+0000","last_clean_scrub_stamp":"2024-05-09T05:05:19.646639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:46:02.432292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.686233+0000","last_change":"2024-05-09T05:05:19.704198+0000","last_active":"2024-05-09T05:05:20.686233+0000","last_peered":"2024-05-09T05:05:20.686233+0000","last_clean":"2024-05-09T05:05:20.686233+0000","last_became_active":"2024-05-09T05:05:19.703885+0000","last_became_peered":"2024-05-09T05:05:19.703885+0000","last_unstale":"2024-05-09T05:05:20.686233+0000","last_undegraded":"2024-05-09T05:05:20.686233+0000","last_fullsized":"2024-05-09T05:05:20.686233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:18.632226+0000","last_clean_scrub_stamp":"2024-05-09T05:05:18.632226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:37:06.387644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-09T05:05:20.692628+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:05:20.692628+0000","last_peered":"2024-05-09T05:05:20.692628+0000","last_clean":"2024-05-09T05:05:20.692628+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:05:20.692628+0000","last_undegraded":"2024-05-09T05:05:20.692628+0000","last_fullsized":"2024-05-09T05:05:20.692628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":723998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":141474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":723908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:05:25.626 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:05:25.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-09T05:05:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.877+0000 7f6b6c600640 1 Processor -- start 2024-05-09T05:05:25.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.877+0000 7f6b6c600640 1 -- start start 2024-05-09T05:05:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6c600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b6415d260 0x7f6b640ade20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6c600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b640ae360 0x7f6b640afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6c600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b640b6310 con 0x7f6b640b0020 2024-05-09T05:05:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6c600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6b64160f30 con 0x7f6b6415d260 2024-05-09T05:05:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6c600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f6b64161210 con 0x7f6b640ae360 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6a600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6b640b0020 0x7f6b6415d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33440/0 (socket says 172.21.15.100:33440) 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b6a600640 1 -- 172.21.15.100:0/1004848663 learned_addr learned my addr 172.21.15.100:0/1004848663 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.879+0000 7f6b69c00640 1 --2- 172.21.15.100:0/1004848663 >> v2:172.21.15.100:3300/0 conn(0x7f6b6415d260 0x7f6b640ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b69200640 1 --2- 172.21.15.100:0/1004848663 >> v2:172.21.15.133:3300/0 conn(0x7f6b640ae360 0x7f6b640afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b63e00640 1 -- 172.21.15.100:0/1004848663 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998732553 0 0) 0x7f6b640b6310 con 0x7f6b640b0020 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b63e00640 1 -- 172.21.15.100:0/1004848663 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b4c003520 con 0x7f6b640b0020 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b69c00640 1 -- 172.21.15.100:0/1004848663 >> v2:172.21.15.133:3300/0 conn(0x7f6b640ae360 msgr2=0x7f6b640afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b69c00640 1 --2- 172.21.15.100:0/1004848663 >> v2:172.21.15.133:3300/0 conn(0x7f6b640ae360 0x7f6b640afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b69c00640 1 -- 172.21.15.100:0/1004848663 >> v1:172.21.15.100:6789/0 conn(0x7f6b640b0020 legacy=0x7f6b6415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.880+0000 7f6b69c00640 1 -- 172.21.15.100:0/1004848663 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b641614f0 con 0x7f6b6415d260 2024-05-09T05:05:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.882+0000 7f6b69c00640 1 --2- 172.21.15.100:0/1004848663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6415d260 0x7f6b640ade20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b640af290 tx=0x7f6b5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148bd047fbff638a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.882+0000 7f6b63e00640 1 -- 172.21.15.100:0/1004848663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58037070 con 0x7f6b6415d260 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.882+0000 7f6b63e00640 1 -- 172.21.15.100:0/1004848663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b58032440 con 0x7f6b6415d260 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.882+0000 7f6b63e00640 1 -- 172.21.15.100:0/1004848663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5802ae60 con 0x7f6b6415d260 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 -- 172.21.15.100:0/1004848663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6415d260 msgr2=0x7f6b640ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 --2- 172.21.15.100:0/1004848663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6415d260 0x7f6b640ade20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b640af290 tx=0x7f6b5802a110 comp rx=0 tx=0).stop 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 -- 172.21.15.100:0/1004848663 shutdown_connections 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 --2- 172.21.15.100:0/1004848663 >> v2:172.21.15.133:3300/0 conn(0x7f6b640ae360 0x7f6b640afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 --2- 172.21.15.100:0/1004848663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6415d260 0x7f6b640ade20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 -- 172.21.15.100:0/1004848663 >> 172.21.15.100:0/1004848663 conn(0x7f6b640b2b40 msgr2=0x7f6b640b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 -- 172.21.15.100:0/1004848663 shutdown_connections 2024-05-09T05:05:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.883+0000 7f6b6c600640 1 -- 172.21.15.100:0/1004848663 wait complete. 2024-05-09T05:05:25.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.885+0000 7f6b6c600640 1 Processor -- start 2024-05-09T05:05:25.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.885+0000 7f6b6c600640 1 -- start start 2024-05-09T05:05:25.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b6c600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b640ae360 0x7f6b6414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b6c600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 0x7f6b6415b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b6c600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b6415d260 0x7f6b6415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b6c600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640b0470 con 0x7f6b640b0020 2024-05-09T05:05:25.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b6c600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6b64161ab0 con 0x7f6b6415d260 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b6c600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6b640b5380 con 0x7f6b640ae360 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b69200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 0x7f6b6415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b69200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 0x7f6b6415b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34134/0 (socket says 172.21.15.100:34134) 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.886+0000 7f6b69200640 1 -- 172.21.15.100:0/2544529451 learned_addr learned my addr 172.21.15.100:0/2544529451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69c00640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b640ae360 0x7f6b6414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69200640 1 -- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b640ae360 msgr2=0x7f6b6414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69200640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b640ae360 0x7f6b6414c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69200640 1 -- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b6415d260 msgr2=0x7f6b6415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69200640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b6415d260 0x7f6b6415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69200640 1 -- 172.21.15.100:0/2544529451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6414ce80 con 0x7f6b640b0020 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b69200640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 0x7f6b6415b010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000e9e0 tx=0x7f6b5000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50017070 con 0x7f6b640b0020 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5000c9d0 con 0x7f6b640b0020 2024-05-09T05:05:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000cdc0 con 0x7f6b640b0020 2024-05-09T05:05:25.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.887+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6409c840 con 0x7f6b640b0020 2024-05-09T05:05:25.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.888+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6409ce00 con 0x7f6b640b0020 2024-05-09T05:05:25.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.889+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6406a6d0 con 0x7f6b640b0020 2024-05-09T05:05:25.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.890+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b5001a070 con 0x7f6b640b0020 2024-05-09T05:05:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.891+0000 7f6b61600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6b440762d0 0x7f6b44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.891+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6b500979c0 con 0x7f6b640b0020 2024-05-09T05:05:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.892+0000 7f6b69c00640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6b440762d0 0x7f6b44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:25.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.892+0000 7f6b69c00640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6b440762d0 0x7f6b44078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:25.896+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b50061310 con 0x7f6b640b0020 2024-05-09T05:05:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.174+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6b6406ff90 con 0x7f6b640b0020 2024-05-09T05:05:26.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.180+0000 7f6b61600640 1 -- 172.21.15.100:0/2544529451 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f6b50060c10 con 0x7f6b640b0020 2024-05-09T05:05:26.181 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-05-09T05:05:26.181 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxm/8wxGBAA16AyM9b+UYE5joYlLTmgZA== 2024-05-09T05:05:26.181 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-05-09T05:05:26.181 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-05-09T05:05:26.181 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-09T05:05:26.181 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6b440762d0 msgr2=0x7f6b44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6b440762d0 0x7f6b44078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b58034000 tx=0x7f6b5802e000 comp rx=0 tx=0).stop 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 msgr2=0x7f6b6415b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 0x7f6b6415b010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000e9e0 tx=0x7f6b5000eea0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 shutdown_connections 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6b440762d0 0x7f6b44078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b6415d260 0x7f6b6415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b640b0020 0x7f6b6415b010 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 --2- 172.21.15.100:0/2544529451 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b640ae360 0x7f6b6414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 >> 172.21.15.100:0/2544529451 conn(0x7f6b640b2b40 msgr2=0x7f6b640729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:26.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 shutdown_connections 2024-05-09T05:05:26.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.183+0000 7f6b6c600640 1 -- 172.21.15.100:0/2544529451 wait complete. 2024-05-09T05:05:26.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.384+0000 7f5fcf800640 1 Processor -- start 2024-05-09T05:05:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.385+0000 7f5fcf800640 1 -- start start 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcf800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5fc8073cd0 0x7f5fc80af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcf800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc806f390 con 0x7f5fc806fd60 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcf800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc806e810 con 0x7f5fc8073840 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcf800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc806eaf0 con 0x7f5fc8073cd0 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5fc806fd60 0x7f5fc8070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33446/0 (socket says 172.21.15.100:33446) 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcce00640 1 -- 172.21.15.100:0/2270668672 learned_addr learned my addr 172.21.15.100:0/2270668672 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.386+0000 7f5fcd800640 1 --2- 172.21.15.100:0/2270668672 >> v2:172.21.15.100:3300/0 conn(0x7f5fc8073cd0 0x7f5fc80af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.387+0000 7f5fc7e00640 1 -- 172.21.15.100:0/2270668672 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923736101 0 0) 0x7f5fc806f390 con 0x7f5fc806fd60 2024-05-09T05:05:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.387+0000 7f5fc7e00640 1 -- 172.21.15.100:0/2270668672 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fac003520 con 0x7f5fc806fd60 2024-05-09T05:05:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.387+0000 7f5fcd800640 1 -- 172.21.15.100:0/2270668672 >> v1:172.21.15.133:6789/0 conn(0x7f5fc8073840 legacy=0x7f5fc80aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.387+0000 7f5fcd800640 1 -- 172.21.15.100:0/2270668672 >> v1:172.21.15.100:6789/0 conn(0x7f5fc806fd60 legacy=0x7f5fc8070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.387+0000 7f5fcd800640 1 -- 172.21.15.100:0/2270668672 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc806edd0 con 0x7f5fc8073cd0 2024-05-09T05:05:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.388+0000 7f5fcd800640 1 --2- 172.21.15.100:0/2270668672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073cd0 0x7f5fc80af520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009d90 tx=0x7f5fc002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2020a06ffbf179 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.388+0000 7f5fc7e00640 1 -- 172.21.15.100:0/2270668672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0007740 con 0x7f5fc8073cd0 2024-05-09T05:05:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fc7e00640 1 -- 172.21.15.100:0/2270668672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc00078e0 con 0x7f5fc8073cd0 2024-05-09T05:05:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fc7e00640 1 -- 172.21.15.100:0/2270668672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0007c90 con 0x7f5fc8073cd0 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 -- 172.21.15.100:0/2270668672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073cd0 msgr2=0x7f5fc80af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 --2- 172.21.15.100:0/2270668672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073cd0 0x7f5fc80af520 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009d90 tx=0x7f5fc002a6f0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 -- 172.21.15.100:0/2270668672 shutdown_connections 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 --2- 172.21.15.100:0/2270668672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073cd0 0x7f5fc80af520 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 -- 172.21.15.100:0/2270668672 >> 172.21.15.100:0/2270668672 conn(0x7f5fc80b31e0 msgr2=0x7f5fc80d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 -- 172.21.15.100:0/2270668672 shutdown_connections 2024-05-09T05:05:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.389+0000 7f5fcf800640 1 -- 172.21.15.100:0/2270668672 wait complete. 2024-05-09T05:05:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.391+0000 7f5fcf800640 1 Processor -- start 2024-05-09T05:05:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.391+0000 7f5fcf800640 1 -- start start 2024-05-09T05:05:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fcf800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fc806fd60 0x7f5fc81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fcf800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 0x7f5fc81f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fcf800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc8073cd0 0x7f5fc81f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fcf800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc8159f00 con 0x7f5fc8073840 2024-05-09T05:05:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fcf800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc806e4a0 con 0x7f5fc8073cd0 2024-05-09T05:05:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fcf800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc81606c0 con 0x7f5fc806fd60 2024-05-09T05:05:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fbfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 0x7f5fc81f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fbfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 0x7f5fc81f8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34146/0 (socket says 172.21.15.100:34146) 2024-05-09T05:05:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.392+0000 7f5fbfe00640 1 -- 172.21.15.100:0/1989114714 learned_addr learned my addr 172.21.15.100:0/1989114714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fbfe00640 1 -- 172.21.15.100:0/1989114714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fc806fd60 msgr2=0x7f5fc81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fbfe00640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fc806fd60 0x7f5fc81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fbfe00640 1 -- 172.21.15.100:0/1989114714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc8073cd0 msgr2=0x7f5fc81f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fbfe00640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc8073cd0 0x7f5fc81f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fbfe00640 1 -- 172.21.15.100:0/1989114714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc8157780 con 0x7f5fc8073840 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fbfe00640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 0x7f5fc81f8e30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c450 tx=0x7f5fb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00052d0 con 0x7f5fc8073840 2024-05-09T05:05:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb0005470 con 0x7f5fc8073840 2024-05-09T05:05:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0012870 con 0x7f5fc8073840 2024-05-09T05:05:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.393+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc8157a60 con 0x7f5fc8073840 2024-05-09T05:05:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.394+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc8158020 con 0x7f5fc8073840 2024-05-09T05:05:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.395+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc8076070 con 0x7f5fc8073840 2024-05-09T05:05:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.396+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5fb0012a10 con 0x7f5fc8073840 2024-05-09T05:05:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.397+0000 7f5fc5600640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5fa40762d0 0x7f5fa4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.397+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5fb00972b0 con 0x7f5fc8073840 2024-05-09T05:05:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.397+0000 7f5fcce00640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5fa40762d0 0x7f5fa4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:26.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.398+0000 7f5fcce00640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5fa40762d0 0x7f5fa4078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8001220 tx=0x7f5fb80078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:26.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.401+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5fb0060b70 con 0x7f5fc8073840 2024-05-09T05:05:26.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.641+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fc80aed10 con 0x7f5fc8073840 2024-05-09T05:05:26.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.642+0000 7f5fc5600640 1 -- 172.21.15.100:0/1989114714 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5193 (secure 0 0 0) 0x7f5fb0060470 con 0x7f5fc8073840 2024-05-09T05:05:26.643 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:26.643 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:23.198643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:26.643 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5fa40762d0 msgr2=0x7f5fa4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5fa40762d0 0x7f5fa4078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8001220 tx=0x7f5fb80078f0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 msgr2=0x7f5fc81f8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 0x7f5fc81f8e30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c450 tx=0x7f5fb000c910 comp rx=0 tx=0).stop 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 shutdown_connections 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5fa40762d0 0x7f5fa4078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fc8073cd0 0x7f5fc81f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fc8073840 0x7f5fc81f8e30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 --2- 172.21.15.100:0/1989114714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fc806fd60 0x7f5fc81555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 >> 172.21.15.100:0/1989114714 conn(0x7f5fc80b31e0 msgr2=0x7f5fc80b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.645+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 shutdown_connections 2024-05-09T05:05:26.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:26.646+0000 7f5fcf800640 1 -- 172.21.15.100:0/1989114714 wait complete. 2024-05-09T05:05:27.066 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:05:20.140697+0000', 'modified': '2024-05-09T05:05:23.198643+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4749}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4749': {'gid': 4749, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.100:6837/1862982495', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 1862982495}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 1862982495}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4749, 'qdb_cluster': [4749]} 2024-05-09T05:05:27.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T05:05:27.067 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-09T05:05:27.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.277+0000 7ff3d9800640 1 Processor -- start 2024-05-09T05:05:27.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.277+0000 7ff3d9800640 1 -- start start 2024-05-09T05:05:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.279+0000 7ff3d9800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d415d670 0x7ff3d415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.279+0000 7ff3d9800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d4160240 con 0x7ff3d41599d0 2024-05-09T05:05:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.279+0000 7ff3d9800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d4160520 con 0x7ff3d406fca0 2024-05-09T05:05:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.279+0000 7ff3d9800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7ff3d4160800 con 0x7ff3d415d670 2024-05-09T05:05:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.279+0000 7ff3d3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff3d41599d0 0x7ff3d406f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33458/0 (socket says 172.21.15.100:33458) 2024-05-09T05:05:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.279+0000 7ff3d3e00640 1 -- 172.21.15.100:0/3506402179 learned_addr learned my addr 172.21.15.100:0/3506402179 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089948600 0 0) 0x7ff3d4160240 con 0x7ff3d41599d0 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3b8003520 con 0x7ff3d41599d0 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3506402179 >> v2:172.21.15.133:3300/0 conn(0x7ff3d415d670 0x7ff3d415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3699910469 0 0) 0x7ff3b8003520 con 0x7ff3d41599d0 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 >> v2:172.21.15.133:3300/0 conn(0x7ff3d415d670 msgr2=0x7ff3d415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 --2- 172.21.15.100:0/3506402179 >> v2:172.21.15.133:3300/0 conn(0x7ff3d415d670 0x7ff3d415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 >> v1:172.21.15.133:6789/0 conn(0x7ff3d406fca0 legacy=0x7ff3d40cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d40cf6b0 con 0x7ff3d41599d0 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7ff3c40016f0 con 0x7ff3d41599d0 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 >> v1:172.21.15.100:6789/0 conn(0x7ff3d41599d0 legacy=0x7ff3d406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3b8003a50 0x7ff3b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8004800 0x7ff3b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80053c0 0x7ff3b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4160800 con 0x7ff3b8004800 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b800c250 con 0x7ff3b80053c0 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.280+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b800c450 con 0x7ff3b8003a50 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8004800 0x7ff3b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80053c0 0x7ff3b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3b8003a50 0x7ff3b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3400640 1 -- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3b8003a50 msgr2=0x7ff3b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3b8003a50 0x7ff3b8003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3400640 1 -- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80053c0 msgr2=0x7ff3b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b80053c0 0x7ff3b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d3400640 1 -- 172.21.15.100:0/3506402179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b8003520 con 0x7ff3b8004800 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.281+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3506402179 reap_dead start 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.282+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8004800 0x7ff3b8004c80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4073dd0 tx=0x7ff3b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a2ed0b0a67de4c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.282+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00013b0 con 0x7ff3b8004800 2024-05-09T05:05:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.282+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c00052d0 con 0x7ff3b8004800 2024-05-09T05:05:27.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.282+0000 7ff3d2a00640 1 -- 172.21.15.100:0/3506402179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c002aa10 con 0x7ff3b8004800 2024-05-09T05:05:27.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 -- 172.21.15.100:0/3506402179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8004800 msgr2=0x7ff3b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8004800 0x7ff3b8004c80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4073dd0 tx=0x7ff3b8005830 comp rx=0 tx=0).stop 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 -- 172.21.15.100:0/3506402179 shutdown_connections 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3506402179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3b8004800 0x7ff3b8004c80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 -- 172.21.15.100:0/3506402179 >> 172.21.15.100:0/3506402179 conn(0x7ff3d40b29b0 msgr2=0x7ff3d40b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 -- 172.21.15.100:0/3506402179 shutdown_connections 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.283+0000 7ff3d9800640 1 -- 172.21.15.100:0/3506402179 wait complete. 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.285+0000 7ff3d9800640 1 Processor -- start 2024-05-09T05:05:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.285+0000 7ff3d9800640 1 -- start start 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d9800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b8004800 0x7ff3d415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d9800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159fc0 0x7ff3d41455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d9800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 0x7ff3d4072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d9800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d415d1b0 con 0x7ff3d4072710 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d9800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d415d030 con 0x7ff3b8004800 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d9800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d415d330 con 0x7ff3d4159fc0 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 0x7ff3d4072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 0x7ff3d4072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34166/0 (socket says 172.21.15.100:34166) 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3548949411 learned_addr learned my addr 172.21.15.100:0/3548949411 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b8004800 0x7ff3d415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159fc0 msgr2=0x7ff3d41455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159fc0 0x7ff3d41455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b8004800 msgr2=0x7ff3d415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b8004800 0x7ff3d415bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.286+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3548949411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d415a440 con 0x7ff3d4072710 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.287+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 0x7ff3d4072b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406d3b0 tx=0x7ff3cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.287+0000 7ff3cbe00640 1 -- 172.21.15.100:0/3548949411 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc007db0 con 0x7ff3d4072710 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.287+0000 7ff3cbe00640 1 -- 172.21.15.100:0/3548949411 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3cc019070 con 0x7ff3d4072710 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.287+0000 7ff3cbe00640 1 -- 172.21.15.100:0/3548949411 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc014650 con 0x7ff3d4072710 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.287+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d415a710 con 0x7ff3d4072710 2024-05-09T05:05:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.287+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d415acd0 con 0x7ff3d4072710 2024-05-09T05:05:27.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.290+0000 7ff3cbe00640 1 -- 172.21.15.100:0/3548949411 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff3cc0147f0 con 0x7ff3d4072710 2024-05-09T05:05:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.291+0000 7ff3cbe00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff3b4076300 0x7ff3b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.291+0000 7ff3cbe00640 1 -- 172.21.15.100:0/3548949411 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff3cc097d60 con 0x7ff3d4072710 2024-05-09T05:05:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.291+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff3b4076300 0x7ff3b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.291+0000 7ff3ddc00740 1 Processor -- start 2024-05-09T05:05:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.292+0000 7ff3ddc00740 1 -- start start 2024-05-09T05:05:27.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.292+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff3b4076300 0x7ff3b40787c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40b41d0 tx=0x7ff3c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.292+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fac5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.292+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461fa958a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.292+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa95de0 0x56461fa992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56461f9fe790 con 0x56461fac57c0 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56461f9a3f20 con 0x56461fa95de0 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x56461f9fa750 con 0x56461fae1180 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fac5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fac5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34180/0 (socket says 172.21.15.100:34180) 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 -- 172.21.15.100:0/2250627521 learned_addr learned my addr 172.21.15.100:0/2250627521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:27.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 -- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 msgr2=0x56461fa958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461fa958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 -- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa95de0 msgr2=0x56461fa992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa95de0 0x56461fa992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa95de0 0x56461fa992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d3e00640 1 -- 172.21.15.100:0/2250627521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56461f7102d0 con 0x56461fac57c0 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.293+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa95de0 0x56461fa992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:27.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.294+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fac5ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4007340 tx=0x7ff3c4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d46b44d04b5e1b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.294+0000 7ff3c8c00640 1 -- 172.21.15.100:0/2250627521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400e970 con 0x56461fac57c0 2024-05-09T05:05:27.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.294+0000 7ff3c8c00640 1 -- 172.21.15.100:0/2250627521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c400eb50 con 0x56461fac57c0 2024-05-09T05:05:27.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.294+0000 7ff3c8c00640 1 -- 172.21.15.100:0/2250627521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4013480 con 0x56461fac57c0 2024-05-09T05:05:27.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.294+0000 7ff3ddc00740 1 -- 172.21.15.100:0/2250627521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 msgr2=0x56461fac5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.294+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fac5ba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4007340 tx=0x7ff3c4011000 comp rx=0 tx=0).stop 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 -- 172.21.15.100:0/2250627521 shutdown_connections 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa95de0 0x56461fa992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461fa958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/2250627521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fac5ba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 -- 172.21.15.100:0/2250627521 >> 172.21.15.100:0/2250627521 conn(0x56461fa97b10 msgr2=0x56461fae05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 -- 172.21.15.100:0/2250627521 shutdown_connections 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 -- 172.21.15.100:0/2250627521 wait complete. 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.295+0000 7ff3ddc00740 1 -- start start 2024-05-09T05:05:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.296+0000 7ff3ddc00740 1 Processor -- start 2024-05-09T05:05:27.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.296+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fac2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.296+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461faf5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.296+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fa9a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.296+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56461fa9b2d0 con 0x56461fa99c00 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x56461f9b79c0 con 0x56461fac57c0 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x56461fa9b570 con 0x56461fae1180 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3ddc00740 10 client.0 _ll_register_callbacks cb 0x56461f984120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fa9a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fa9a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34192/0 (socket says 172.21.15.100:34192) 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3939677663 learned_addr learned my addr 172.21.15.100:0/3939677663 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fac2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 msgr2=0x56461faf5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461faf5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 msgr2=0x56461fac2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fac2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 -- 172.21.15.100:0/3939677663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56461f7da6b0 con 0x56461fa99c00 2024-05-09T05:05:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3d8e00640 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fa9a080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc05d660 tx=0x7ff3cc061690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69eb485e840cfbb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.297+0000 7ff3bd600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3bd600640 1 -- 172.21.15.100:0/3939677663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc061070 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3bd600640 1 -- 172.21.15.100:0/3939677663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff3cc05c9e0 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c400eb50 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3bd600640 1 -- 172.21.15.100:0/3939677663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff3cc065370 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 10 client.4911 fetch_fsmap learned FSMap version 18 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56461fac78e0 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3bd600640 1 -- 172.21.15.100:0/3939677663 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c400eb50 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3bd600640 1 -- 172.21.15.100:0/3939677663 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7ff3cc063070 con 0x56461fa99c00 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 10 client.4911 fetch_fsmap finished waiting for FSMap version 18 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 10 client.4911 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 20 client.4911 populate_metadata read hostname 'smithi100' 2024-05-09T05:05:27.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461faf8930 0x56461faf8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 4 client.4911 mds_command: new command op to 4749 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:05:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 --> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56461fa0c3a0 con 0x56461faf8930 2024-05-09T05:05:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.298+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461faf8930 0x56461faf8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.299+0000 7ff3bd600640 10 client.4911 ms_handle_connect on v2:172.21.15.100:6836/1862982495 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.299+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461faf8930 0x56461faf8d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82602f51e806b355 server_cookie=8e936183a182d84d in_seq=0 out_seq=0 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3bd600640 1 -- 172.21.15.100:0/3939677663 <== mds.0 v2:172.21.15.100:6836/1862982495 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56461fa0c3a0 con 0x56461faf8930 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3bd600640 10 client.4911 handle_command_reply: tid=0 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 client.4911 shutdown 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 msgr2=0x56461fa9a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fa9a080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc05d660 tx=0x7ff3cc061690 comp rx=0 tx=0).stop 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 shutdown_connections 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461faf8930 0x56461faf8d10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fa9a080 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461faf5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3939677663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fac2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 >> 172.21.15.100:0/3939677663 conn(0x56461fa95de0 msgr2=0x56461fa94e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3bd600640 0 client.4911 ms_handle_reset on v2:172.21.15.100:6836/1862982495 2024-05-09T05:05:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 shutdown_connections 2024-05-09T05:05:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.300+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3939677663 wait complete. 2024-05-09T05:05:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.301+0000 7ff3ddc00740 20 client.4911 trim_cache size 0 max 16384 2024-05-09T05:05:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.320+0000 7ff3ddc00740 1 Processor -- start 2024-05-09T05:05:27.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.320+0000 7ff3ddc00740 1 -- start start 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fb08dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fad8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461fad8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41fdcc0 con 0x56461fa99c00 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41fccc0 con 0x56461fac57c0 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d4153bb0 con 0x56461fae1180 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fb08dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fb08dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34204/0 (socket says 172.21.15.100:34204) 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 -- 172.21.15.100:0/681216225 learned_addr learned my addr 172.21.15.100:0/681216225 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 -- 172.21.15.100:0/681216225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 msgr2=0x56461fad8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461fad8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 -- 172.21.15.100:0/681216225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 msgr2=0x56461fad8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fad8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.321+0000 7ff3d3e00640 1 -- 172.21.15.100:0/681216225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56461fac92a0 con 0x56461fa99c00 2024-05-09T05:05:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fb08dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005bc0 tx=0x7ff3c4007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa3dd644da92c00 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3bfe00640 1 -- 172.21.15.100:0/681216225 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400eb30 con 0x56461fa99c00 2024-05-09T05:05:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3bfe00640 1 -- 172.21.15.100:0/681216225 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c400ecd0 con 0x56461fa99c00 2024-05-09T05:05:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3bfe00640 1 -- 172.21.15.100:0/681216225 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4013680 con 0x56461fa99c00 2024-05-09T05:05:27.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 -- 172.21.15.100:0/681216225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 msgr2=0x56461fb08dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fb08dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005bc0 tx=0x7ff3c4007000 comp rx=0 tx=0).stop 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 -- 172.21.15.100:0/681216225 shutdown_connections 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461fad8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fac57c0 0x56461fad8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/681216225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fa99c00 0x56461fb08dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.322+0000 7ff3ddc00740 1 -- 172.21.15.100:0/681216225 >> 172.21.15.100:0/681216225 conn(0x56461fa95de0 msgr2=0x56461fae4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.323+0000 7ff3ddc00740 1 -- 172.21.15.100:0/681216225 shutdown_connections 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.323+0000 7ff3ddc00740 1 -- 172.21.15.100:0/681216225 wait complete. 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.323+0000 7ff3ddc00740 1 -- start start 2024-05-09T05:05:27.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.323+0000 7ff3ddc00740 1 Processor -- start 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa99c00 0x56461fb08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fb62ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461faf3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56461fad7680 con 0x56461fac57c0 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41fc740 con 0x56461fa99c00 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x56461fac6980 con 0x56461fae1180 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.324+0000 7ff3ddc00740 10 client.0 _ll_register_callbacks cb 0x7ff3cc060ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fb62ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fb62ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34208/0 (socket says 172.21.15.100:34208) 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 -- 172.21.15.100:0/3049435217 learned_addr learned my addr 172.21.15.100:0/3049435217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 -- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 msgr2=0x56461faf3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461faf3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa99c00 0x56461fb08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 -- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa99c00 msgr2=0x56461fb08350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa99c00 0x56461fb08350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 -- 172.21.15.100:0/3049435217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56461fae1f10 con 0x56461fac57c0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3d3400640 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fb62ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005040 tx=0x7ff3c0007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1288406314c39e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.325+0000 7ff3bd600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3bd600640 1 -- 172.21.15.100:0/3049435217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0006b20 con 0x56461fac57c0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3bd600640 1 -- 172.21.15.100:0/3049435217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff3c0037040 con 0x56461fac57c0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c400ecd0 con 0x56461fac57c0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3bd600640 1 -- 172.21.15.100:0/3049435217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff3c0006cc0 con 0x56461fac57c0 2024-05-09T05:05:27.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 10 client.4917 fetch_fsmap learned FSMap version 18 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56461faf3df0 con 0x56461fac57c0 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3bd600640 1 -- 172.21.15.100:0/3049435217 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c400ecd0 con 0x56461fac57c0 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3bd600640 1 -- 172.21.15.100:0/3049435217 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7ff3c002a810 con 0x56461fac57c0 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 10 client.4917 fetch_fsmap finished waiting for FSMap version 18 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 10 client.4917 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 20 client.4917 populate_metadata read hostname 'smithi100' 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461fad7940 0x56461fad7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 4 client.4917 mds_command: new command op to 4749 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 --> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] -- command(tid 0: {"prefix": "status"}) -- 0x56461fa06210 con 0x56461fad7940 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.326+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461fad7940 0x56461fad7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3d3e00640 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461fad7940 0x56461fad7d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84688ba9c5ea57 server_cookie=e3b07fcb226d8d5e in_seq=0 out_seq=0 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3bd600640 10 client.4917 ms_handle_connect on v2:172.21.15.100:6836/1862982495 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3bd600640 1 -- 172.21.15.100:0/3049435217 <== mds.0 v2:172.21.15.100:6836/1862982495 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56461fa06210 con 0x56461fad7940 2024-05-09T05:05:27.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3bd600640 10 client.4917 handle_command_reply: tid=0 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 client.4917 shutdown 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 msgr2=0x56461fb62ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fb62ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0005040 tx=0x7ff3c0007b60 comp rx=0 tx=0).stop 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 shutdown_connections 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:6836/1862982495,v1:172.21.15.100:6837/1862982495] conn(0x56461fad7940 0x56461fad7d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x56461fae1180 0x56461faf3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56461fac57c0 0x56461fb62ae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 --2- 172.21.15.100:0/3049435217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56461fa99c00 0x56461fb08350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3bd600640 0 client.4917 ms_handle_reset on v2:172.21.15.100:6836/1862982495 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.327+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 >> 172.21.15.100:0/3049435217 conn(0x56461fa95de0 msgr2=0x56461fae3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 shutdown_connections 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3ddc00740 1 -- 172.21.15.100:0/3049435217 wait complete. 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3ddc00740 20 client.4917 trim_cache size 0 max 16384 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "11e43d29-3063-46a7-bef1-2ecadce2fdc5", 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4749, 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 6.6429197819999999, 2024-05-09T05:05:27.333 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 18, 2024-05-09T05:05:27.334 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 32, 2024-05-09T05:05:27.334 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 32, 2024-05-09T05:05:27.334 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 21.632986785 2024-05-09T05:05:27.334 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff3b4076300 msgr2=0x7ff3b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff3b4076300 0x7ff3b40787c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40b41d0 tx=0x7ff3c4009040 comp rx=0 tx=0).stop 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 msgr2=0x7ff3d4072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 0x7ff3d4072b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3d406d3b0 tx=0x7ff3cc009da0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 shutdown_connections 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff3b4076300 0x7ff3b40787c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3d4072710 0x7ff3d4072b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3d4159fc0 0x7ff3d41455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 --2- 172.21.15.100:0/3548949411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3b8004800 0x7ff3d415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.328+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 >> 172.21.15.100:0/3548949411 conn(0x7ff3d40b29b0 msgr2=0x7ff3d406e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.329+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 shutdown_connections 2024-05-09T05:05:27.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.329+0000 7ff3d9800640 1 -- 172.21.15.100:0/3548949411 wait complete. 2024-05-09T05:05:27.346 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:05:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.531+0000 7f2e95000640 1 Processor -- start 2024-05-09T05:05:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.531+0000 7f2e95000640 1 -- start start 2024-05-09T05:05:27.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.533+0000 7f2e95000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9006fd60 0x7f2e90070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.533+0000 7f2e95000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e900afe20 0x7f2e90073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.533+0000 7f2e95000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e90070680 con 0x7f2e90073840 2024-05-09T05:05:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.533+0000 7f2e95000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9006f390 con 0x7f2e900afe20 2024-05-09T05:05:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.533+0000 7f2e95000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9006e810 con 0x7f2e9006fd60 2024-05-09T05:05:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.534+0000 7f2e8de00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9006fd60 0x7f2e90070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.534+0000 7f2e8d400640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e90073840 0x7f2e9015fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:57878/0 (socket says 172.21.15.100:57878) 2024-05-09T05:05:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.534+0000 7f2e8d400640 1 -- 172.21.15.100:0/478280993 learned_addr learned my addr 172.21.15.100:0/478280993 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.534+0000 7f2e8e800640 1 --2- 172.21.15.100:0/478280993 >> v2:172.21.15.133:3300/0 conn(0x7f2e900afe20 0x7f2e90073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.535+0000 7f2e8e800640 1 -- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9006fd60 msgr2=0x7f2e90070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.535+0000 7f2e8e800640 1 --2- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9006fd60 0x7f2e90070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.535+0000 7f2e8e800640 1 -- 172.21.15.100:0/478280993 >> v1:172.21.15.133:6789/0 conn(0x7f2e90073840 legacy=0x7f2e9015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.535+0000 7f2e8e800640 1 -- 172.21.15.100:0/478280993 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9006eaf0 con 0x7f2e900afe20 2024-05-09T05:05:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.535+0000 7f2e8de00640 1 --2- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9006fd60 0x7f2e90070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:05:27.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.536+0000 7f2e8e800640 1 --2- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e900afe20 0x7f2e90073ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009d90 tx=0x7f2e8802a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5c00b406f617d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.537+0000 7f2e8ca00640 1 -- 172.21.15.100:0/478280993 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88007740 con 0x7f2e900afe20 2024-05-09T05:05:27.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.537+0000 7f2e8ca00640 1 -- 172.21.15.100:0/478280993 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e880078e0 con 0x7f2e900afe20 2024-05-09T05:05:27.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.537+0000 7f2e8ca00640 1 -- 172.21.15.100:0/478280993 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88007cb0 con 0x7f2e900afe20 2024-05-09T05:05:27.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.537+0000 7f2e95000640 1 -- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e900afe20 msgr2=0x7f2e90073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.537+0000 7f2e95000640 1 --2- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e900afe20 0x7f2e90073ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009d90 tx=0x7f2e8802a550 comp rx=0 tx=0).stop 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.538+0000 7f2e95000640 1 -- 172.21.15.100:0/478280993 shutdown_connections 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.538+0000 7f2e95000640 1 --2- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e900afe20 0x7f2e90073ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.538+0000 7f2e95000640 1 --2- 172.21.15.100:0/478280993 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9006fd60 0x7f2e90070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.538+0000 7f2e95000640 1 -- 172.21.15.100:0/478280993 >> 172.21.15.100:0/478280993 conn(0x7f2e900b31e0 msgr2=0x7f2e900d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.538+0000 7f2e95000640 1 -- 172.21.15.100:0/478280993 shutdown_connections 2024-05-09T05:05:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.538+0000 7f2e95000640 1 -- 172.21.15.100:0/478280993 wait complete. 2024-05-09T05:05:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.539+0000 7f2e95000640 1 Processor -- start 2024-05-09T05:05:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.540+0000 7f2e95000640 1 -- start start 2024-05-09T05:05:27.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.540+0000 7f2e95000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9006fd60 0x7f2e900b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e95000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e90073840 0x7f2e90152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e95000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 0x7f2e900cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e95000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9006e4a0 con 0x7f2e900afe20 2024-05-09T05:05:27.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e95000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9006f0b0 con 0x7f2e9006fd60 2024-05-09T05:05:27.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e95000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2e90159f00 con 0x7f2e90073840 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 0x7f2e900cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 0x7f2e900cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34216/0 (socket says 172.21.15.100:34216) 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 -- 172.21.15.100:0/509062990 learned_addr learned my addr 172.21.15.100:0/509062990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8de00640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9006fd60 0x7f2e900b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8d400640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e90073840 0x7f2e90152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 -- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e90073840 msgr2=0x7f2e90152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e90073840 0x7f2e90152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 -- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9006fd60 msgr2=0x7f2e900b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9006fd60 0x7f2e900b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8e800640 1 -- 172.21.15.100:0/509062990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e900cd9d0 con 0x7f2e900afe20 2024-05-09T05:05:27.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.541+0000 7f2e8d400640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e90073840 0x7f2e90152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.542+0000 7f2e8e800640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 0x7f2e900cd490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009eb0 tx=0x7f2e88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.542+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8803f070 con 0x7f2e900afe20 2024-05-09T05:05:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.542+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88031bc0 con 0x7f2e900afe20 2024-05-09T05:05:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.542+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88009450 con 0x7f2e900afe20 2024-05-09T05:05:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.542+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e900b1c60 con 0x7f2e900afe20 2024-05-09T05:05:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.542+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e900b2220 con 0x7f2e900afe20 2024-05-09T05:05:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.543+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e90076070 con 0x7f2e900afe20 2024-05-09T05:05:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.545+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e88003990 con 0x7f2e900afe20 2024-05-09T05:05:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.545+0000 7f2e86000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e70076300 0x7f2e700787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.546+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2e880b8970 con 0x7f2e900afe20 2024-05-09T05:05:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.546+0000 7f2e8de00640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e70076300 0x7f2e700787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:27.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.546+0000 7f2e8de00640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e70076300 0x7f2e700787c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e9009f180 tx=0x7f2e80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:27.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.550+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e880822d0 con 0x7f2e900afe20 2024-05-09T05:05:27.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.804+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2e90073cc0 con 0x7f2e900afe20 2024-05-09T05:05:27.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.805+0000 7f2e86000640 1 -- 172.21.15.100:0/509062990 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f2e90073cc0 con 0x7f2e900afe20 2024-05-09T05:05:27.805 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e70076300 msgr2=0x7f2e700787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e70076300 0x7f2e700787c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e9009f180 tx=0x7f2e80008040 comp rx=0 tx=0).stop 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 msgr2=0x7f2e900cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 0x7f2e900cd490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009eb0 tx=0x7f2e88004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 shutdown_connections 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e70076300 0x7f2e700787c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e900afe20 0x7f2e900cd490 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e90073840 0x7f2e90152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 --2- 172.21.15.100:0/509062990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9006fd60 0x7f2e900b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:27.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 >> 172.21.15.100:0/509062990 conn(0x7f2e900b31e0 msgr2=0x7f2e9015a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:27.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 shutdown_connections 2024-05-09T05:05:27.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:27.808+0000 7f2e95000640 1 -- 172.21.15.100:0/509062990 wait complete. 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-09T05:05:27.826 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:05:27.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:05:27.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:27.827 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.875 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42551sec preferred_lft 42551sec 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.876 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:e9:b2:ad:ea:5a brd ff:ff:ff:ff:ff:ff 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f4a7:a4ff:fe5e:5c5/64 scope link 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:e9:b2:ad:ea:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8ce9:b2ff:fead:ea5a/64 scope link 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 96:4e:c8:25:f6:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::944e:c8ff:fe25:f6dc/64 scope link 2024-05-09T05:05:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:05:27.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:27.878 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:05:27.997 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-05-09T05:05:28.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:28.002 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-05-09T05:05:28.056 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-05-09T05:05:28.056 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:05:28.056 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:05:28.056 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:05:28.056 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:05:28.056 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:05:28.056 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:05:28.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:05:28.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:05:28.057 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:05:28.057 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:05:28.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:05:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:05:28.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:28.265 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:05:28.313 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T05:05:28.313 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-09T05:05:28.313 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:05:28.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:28.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-05-09T05:05:28.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:05:28.392 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T05:05:28.443 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:05:28.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:05:28.443 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:05:28.495 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T05:05:28.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:28.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:05:28.618 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:05:28.618 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:05:28.618 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:05:28.640 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:05:28.640 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:05:28.640 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:05:28.640 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:05:28.640 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790" 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2024-05-09T05:05:28.666 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=11e43d29-3063-46a7-bef1-2ecadce2fdc5" will pass to kernel 2024-05-09T05:05:28.669 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T05:05:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:05:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:05:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:05:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:05:28.674 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:05:28.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:28.674 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:05:28.746 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:05:28.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:05:28.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:05:28.865 INFO:teuthology.orchestra.run.smithi100.stdout:client4648 2024-05-09T05:05:28.865 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:05:28.865 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:28.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery false 2024-05-09T05:05:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.165+0000 7f5e5ba00640 1 Processor -- start 2024-05-09T05:05:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.165+0000 7f5e5ba00640 1 -- start start 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.167+0000 7f5e5ba00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e5415d5a0 0x7f5e54073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.167+0000 7f5e5ba00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e54074490 0x7f5e540cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.167+0000 7f5e5ba00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e5406e520 con 0x7f5e540cff40 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.167+0000 7f5e5ba00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5e5415d980 con 0x7f5e5415d5a0 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.167+0000 7f5e5ba00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f5e540cf440 con 0x7f5e54074490 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.167+0000 7f5e59000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e5415d5a0 0x7f5e54073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e59000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e5415d5a0 0x7f5e54073f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34224/0 (socket says 172.21.15.100:34224) 2024-05-09T05:05:29.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e59000640 1 -- 172.21.15.100:0/4156811804 learned_addr learned my addr 172.21.15.100:0/4156811804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e53e00640 1 --2- 172.21.15.100:0/4156811804 >> v2:172.21.15.133:3300/0 conn(0x7f5e54074490 0x7f5e540cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e59000640 1 -- 172.21.15.100:0/4156811804 >> v2:172.21.15.133:3300/0 conn(0x7f5e54074490 msgr2=0x7f5e540cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e59000640 1 --2- 172.21.15.100:0/4156811804 >> v2:172.21.15.133:3300/0 conn(0x7f5e54074490 0x7f5e540cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e59000640 1 -- 172.21.15.100:0/4156811804 >> v1:172.21.15.133:6789/0 conn(0x7f5e540cff40 legacy=0x7f5e54161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.168+0000 7f5e59000640 1 -- 172.21.15.100:0/4156811804 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e540cf720 con 0x7f5e5415d5a0 2024-05-09T05:05:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.170+0000 7f5e59000640 1 --2- 172.21.15.100:0/4156811804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e5415d5a0 0x7f5e54073f50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406dc30 tx=0x7f5e4402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8434d2513f0f57b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.170+0000 7f5e53400640 1 -- 172.21.15.100:0/4156811804 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44037070 con 0x7f5e5415d5a0 2024-05-09T05:05:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.170+0000 7f5e53400640 1 -- 172.21.15.100:0/4156811804 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e44032440 con 0x7f5e5415d5a0 2024-05-09T05:05:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.170+0000 7f5e53400640 1 -- 172.21.15.100:0/4156811804 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44032810 con 0x7f5e5415d5a0 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 -- 172.21.15.100:0/4156811804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e5415d5a0 msgr2=0x7f5e54073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/4156811804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e5415d5a0 0x7f5e54073f50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5e5406dc30 tx=0x7f5e4402a140 comp rx=0 tx=0).stop 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 -- 172.21.15.100:0/4156811804 shutdown_connections 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/4156811804 >> v2:172.21.15.133:3300/0 conn(0x7f5e54074490 0x7f5e540cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/4156811804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e5415d5a0 0x7f5e54073f50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 -- 172.21.15.100:0/4156811804 >> 172.21.15.100:0/4156811804 conn(0x7f5e540b2c90 msgr2=0x7f5e540b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 -- 172.21.15.100:0/4156811804 shutdown_connections 2024-05-09T05:05:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.171+0000 7f5e5ba00640 1 -- 172.21.15.100:0/4156811804 wait complete. 2024-05-09T05:05:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.173+0000 7f5e5ba00640 1 Processor -- start 2024-05-09T05:05:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.174+0000 7f5e5ba00640 1 -- start start 2024-05-09T05:05:29.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e5ba00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e54074490 0x7f5e54150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e5ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 0x7f5e541f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e5ba00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e5415d5a0 0x7f5e5415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e5ba00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5409ef60 con 0x7f5e540cff40 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e5ba00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5409ede0 con 0x7f5e54074490 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e5ba00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5e540d0350 con 0x7f5e5415d5a0 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 0x7f5e541f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 0x7f5e541f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34236/0 (socket says 172.21.15.100:34236) 2024-05-09T05:05:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.175+0000 7f5e53e00640 1 -- 172.21.15.100:0/1904952868 learned_addr learned my addr 172.21.15.100:0/1904952868 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e59000640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e54074490 0x7f5e54150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e53e00640 1 -- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e5415d5a0 msgr2=0x7f5e5415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e53e00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e5415d5a0 0x7f5e5415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e53e00640 1 -- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e54074490 msgr2=0x7f5e54150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e53e00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e54074490 0x7f5e54150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e53e00640 1 -- 172.21.15.100:0/1904952868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e541510a0 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e59000640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e54074490 0x7f5e54150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e53e00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 0x7f5e541f5670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007ef0 tx=0x7f5e4000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40014620 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e40019070 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40014a00 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.176+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5409d2d0 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.177+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5409d890 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.178+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e5406a630 con 0x7f5e540cff40 2024-05-09T05:05:29.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.179+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e40014ba0 con 0x7f5e540cff40 2024-05-09T05:05:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.180+0000 7f5e50c00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5e340762d0 0x7f5e34078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.180+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5e40097f60 con 0x7f5e540cff40 2024-05-09T05:05:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.180+0000 7f5e59000640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5e340762d0 0x7f5e34078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.181+0000 7f5e59000640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5e340762d0 0x7f5e34078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e44034000 tx=0x7f5e4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:29.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.185+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5e541510a0 con 0x7f5e540cff40 2024-05-09T05:05:29.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.389+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7f5e540b08e0 con 0x7f5e540cff40 2024-05-09T05:05:29.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.396+0000 7f5e50c00640 1 -- 172.21.15.100:0/1904952868 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f5e400618b0 con 0x7f5e540cff40 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5e340762d0 msgr2=0x7f5e34078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5e340762d0 0x7f5e34078790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e44034000 tx=0x7f5e4402e000 comp rx=0 tx=0).stop 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 msgr2=0x7f5e541f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 0x7f5e541f5670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007ef0 tx=0x7f5e4000e4b0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 shutdown_connections 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5e340762d0 0x7f5e34078790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e5415d5a0 0x7f5e5415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e540cff40 0x7f5e541f5670 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 --2- 172.21.15.100:0/1904952868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e54074490 0x7f5e54150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 >> 172.21.15.100:0/1904952868 conn(0x7f5e540b2c90 msgr2=0x7f5e540b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:29.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.399+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 shutdown_connections 2024-05-09T05:05:29.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.400+0000 7f5e5ba00640 1 -- 172.21.15.100:0/1904952868 wait complete. 2024-05-09T05:05:29.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:29.419 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir0) 2024-05-09T05:05:29.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:29.473 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir0/file1) 2024-05-09T05:05:29.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:29.526 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s sym_dir0/file1 sym_dir0/symlink_file1) 2024-05-09T05:05:29.580 DEBUG:teuthology.orchestra.run.smithi100:> stdin-killer -- python3 -c ' 2024-05-09T05:05:29.580 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-05-09T05:05:29.580 DEBUG:teuthology.orchestra.run.smithi100:> import stat 2024-05-09T05:05:29.580 DEBUG:teuthology.orchestra.run.smithi100:> 2024-05-09T05:05:29.580 DEBUG:teuthology.orchestra.run.smithi100:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir0/symlink_file1").st_ino) 2024-05-09T05:05:29.580 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-05-09T05:05:29.719 INFO:teuthology.orchestra.run.smithi100.stdout:1099511628278 2024-05-09T05:05:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:05:29.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.979+0000 7fa5aaa00640 1 Processor -- start 2024-05-09T05:05:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.979+0000 7fa5aaa00640 1 -- start start 2024-05-09T05:05:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5aaa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5a4145900 0x7fa5a4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a40b45c0 0x7fa5a406f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5aaa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a406ead0 con 0x7fa5a40739a0 2024-05-09T05:05:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5aaa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a406f390 con 0x7fa5a4145900 2024-05-09T05:05:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a406ed40 con 0x7fa5a40b45c0 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5a3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5a4145900 0x7fa5a4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa59b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa5a40739a0 0x7fa5a40b3eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33466/0 (socket says 172.21.15.100:33466) 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa5a3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5a4145900 0x7fa5a4073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34252/0 (socket says 172.21.15.100:34252) 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.981+0000 7fa59b400640 1 -- 172.21.15.100:0/3454156665 learned_addr learned my addr 172.21.15.100:0/3454156665 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.982+0000 7fa5a8a00640 1 --2- 172.21.15.100:0/3454156665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a40b45c0 0x7fa5a406f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.982+0000 7fa5a3e00640 1 -- 172.21.15.100:0/3454156665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a40b45c0 msgr2=0x7fa5a406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.982+0000 7fa5a3e00640 1 --2- 172.21.15.100:0/3454156665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a40b45c0 0x7fa5a406f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.982+0000 7fa5a3e00640 1 -- 172.21.15.100:0/3454156665 >> v1:172.21.15.100:6789/0 conn(0x7fa5a40739a0 legacy=0x7fa5a40b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.982+0000 7fa5a3400640 1 -- 172.21.15.100:0/3454156665 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220074736 0 0) 0x7fa5a406ead0 con 0x7fa5a40739a0 2024-05-09T05:05:29.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.982+0000 7fa5a3e00640 1 -- 172.21.15.100:0/3454156665 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a406f020 con 0x7fa5a4145900 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.983+0000 7fa5a3e00640 1 --2- 172.21.15.100:0/3454156665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a4145900 0x7fa5a4073460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5940097a0 tx=0x7fa59402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b991e533cc78a892 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.983+0000 7fa5a3400640 1 -- 172.21.15.100:0/3454156665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594037070 con 0x7fa5a4145900 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.983+0000 7fa5a3400640 1 -- 172.21.15.100:0/3454156665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa594032440 con 0x7fa5a4145900 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.983+0000 7fa5a3400640 1 -- 172.21.15.100:0/3454156665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594032810 con 0x7fa5a4145900 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 -- 172.21.15.100:0/3454156665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a4145900 msgr2=0x7fa5a4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/3454156665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a4145900 0x7fa5a4073460 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5940097a0 tx=0x7fa59402a180 comp rx=0 tx=0).stop 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 -- 172.21.15.100:0/3454156665 shutdown_connections 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/3454156665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a40b45c0 0x7fa5a406f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/3454156665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a4145900 0x7fa5a4073460 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 -- 172.21.15.100:0/3454156665 >> 172.21.15.100:0/3454156665 conn(0x7fa5a40b31e0 msgr2=0x7fa5a40d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 -- 172.21.15.100:0/3454156665 shutdown_connections 2024-05-09T05:05:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.984+0000 7fa5aaa00640 1 -- 172.21.15.100:0/3454156665 wait complete. 2024-05-09T05:05:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.986+0000 7fa5aaa00640 1 Processor -- start 2024-05-09T05:05:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.986+0000 7fa5aaa00640 1 -- start start 2024-05-09T05:05:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5a40739a0 0x7fa5a40b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 0x7fa5a413a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a4145900 0x7fa5a4160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4145ce0 con 0x7fa5a40b45c0 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40ade90 con 0x7fa5a40739a0 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a4145e60 con 0x7fa5a4145900 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa59b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 0x7fa5a413a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa59b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 0x7fa5a413a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34258/0 (socket says 172.21.15.100:34258) 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.987+0000 7fa59b400640 1 -- 172.21.15.100:0/1031241401 learned_addr learned my addr 172.21.15.100:0/1031241401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa5a8a00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a4145900 0x7fa5a4160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa59b400640 1 -- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a4145900 msgr2=0x7fa5a4160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa59b400640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a4145900 0x7fa5a4160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa59b400640 1 -- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5a40739a0 msgr2=0x7fa5a40b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa59b400640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5a40739a0 0x7fa5a40b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa59b400640 1 -- 172.21.15.100:0/1031241401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a413a940 con 0x7fa5a40b45c0 2024-05-09T05:05:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa59b400640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 0x7fa5a413a400 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c450 tx=0x7fa58c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c018070 con 0x7fa5a40b45c0 2024-05-09T05:05:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c007500 con 0x7fa5a40b45c0 2024-05-09T05:05:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c004a20 con 0x7fa5a40b45c0 2024-05-09T05:05:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.988+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a40b0370 con 0x7fa5a40b45c0 2024-05-09T05:05:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.989+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a40b0930 con 0x7fa5a40b45c0 2024-05-09T05:05:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.990+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a4076070 con 0x7fa5a40b45c0 2024-05-09T05:05:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.991+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa58c01b070 con 0x7fa5a40b45c0 2024-05-09T05:05:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.992+0000 7fa5a0c00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa580076300 0x7fa5800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.992+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa58c0968e0 con 0x7fa5a40b45c0 2024-05-09T05:05:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.992+0000 7fa5a3e00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa580076300 0x7fa5800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.993+0000 7fa5a3e00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa580076300 0x7fa5800787c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa594034000 tx=0x7fa59402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:29.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:29.996+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa58c0601a0 con 0x7fa5a40b45c0 2024-05-09T05:05:30.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.242+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5a4072fb0 con 0x7fa5a40b45c0 2024-05-09T05:05:30.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.243+0000 7fa5a0c00640 1 -- 172.21.15.100:0/1031241401 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5193 (secure 0 0 0) 0x7fa58c05faa0 con 0x7fa5a40b45c0 2024-05-09T05:05:30.244 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:23.198643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:30.244 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa580076300 msgr2=0x7fa5800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa580076300 0x7fa5800787c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa594034000 tx=0x7fa59402c000 comp rx=0 tx=0).stop 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 msgr2=0x7fa5a413a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 0x7fa5a413a400 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c450 tx=0x7fa58c00c910 comp rx=0 tx=0).stop 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 shutdown_connections 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa580076300 0x7fa5800787c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa5a4145900 0x7fa5a4160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a40b45c0 0x7fa5a413a400 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 --2- 172.21.15.100:0/1031241401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5a40739a0 0x7fa5a40b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 >> 172.21.15.100:0/1031241401 conn(0x7fa5a40b31e0 msgr2=0x7fa5a40d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 shutdown_connections 2024-05-09T05:05:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.246+0000 7fa5aaa00640 1 -- 172.21.15.100:0/1031241401 wait complete. 2024-05-09T05:05:30.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:30.504 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:30.581 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:30.582 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink 2024-05-09T05:05:30.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.699+0000 7f2b96febf40 1 Processor -- start 2024-05-09T05:05:30.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.699+0000 7f2b96febf40 1 -- start start 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b96febf40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead228960 0x563ead2f1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b96febf40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b96febf40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead300190 0x563ead2f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b96febf40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563ead270d80 con 0x563ead25ba90 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b96febf40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563ead2728c0 con 0x563ead228960 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b96febf40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x563ead300df0 con 0x563ead300190 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b93800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b93800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34268/0 (socket says 172.21.15.100:34268) 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b93800640 1 -- 172.21.15.100:0/1743448770 learned_addr learned my addr 172.21.15.100:0/1743448770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.700+0000 7f2b94200640 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead228960 0x563ead2f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b94c00640 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead300190 0x563ead2f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b93800640 1 -- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead300190 msgr2=0x563ead2f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b93800640 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead300190 0x563ead2f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b93800640 1 -- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead228960 msgr2=0x563ead2f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b93800640 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead228960 0x563ead2f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b93800640 1 -- 172.21.15.100:0/1743448770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ead178300 con 0x563ead25ba90 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b93800640 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f5330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a440 tx=0x7f2b8000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5c6b47d3a09e5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b92400640 1 -- 172.21.15.100:0/1743448770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000b930 con 0x563ead25ba90 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b92400640 1 -- 172.21.15.100:0/1743448770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8000f070 con 0x563ead25ba90 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.701+0000 7f2b92400640 1 -- 172.21.15.100:0/1743448770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000bcf0 con 0x563ead25ba90 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 -- 172.21.15.100:0/1743448770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 msgr2=0x563ead2f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f5330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000a440 tx=0x7f2b8000a900 comp rx=0 tx=0).stop 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 -- 172.21.15.100:0/1743448770 shutdown_connections 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead300190 0x563ead2f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f5330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 --2- 172.21.15.100:0/1743448770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead228960 0x563ead2f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 -- 172.21.15.100:0/1743448770 >> 172.21.15.100:0/1743448770 conn(0x563ead272e20 msgr2=0x563ead226360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 -- 172.21.15.100:0/1743448770 shutdown_connections 2024-05-09T05:05:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.702+0000 7f2b96febf40 1 -- 172.21.15.100:0/1743448770 wait complete. 2024-05-09T05:05:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.703+0000 7f2b96febf40 1 Processor -- start 2024-05-09T05:05:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.703+0000 7f2b96febf40 1 -- start start 2024-05-09T05:05:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b96febf40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead228960 0x563ead2f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b96febf40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b96febf40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead300190 0x563ead2f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b96febf40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563ead301e20 con 0x563ead25ba90 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b96febf40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x563ead274590 con 0x563ead300190 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b96febf40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x563ead3011d0 con 0x563ead228960 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b93800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b93800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34280/0 (socket says 172.21.15.100:34280) 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.704+0000 7f2b93800640 1 -- 172.21.15.100:0/2212619316 learned_addr learned my addr 172.21.15.100:0/2212619316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b94200640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead228960 0x563ead2f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b94c00640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead300190 0x563ead2f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b93800640 1 -- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead228960 msgr2=0x563ead2f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b93800640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563ead228960 0x563ead2f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b93800640 1 -- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead300190 msgr2=0x563ead2f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b93800640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead300190 0x563ead2f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b93800640 1 -- 172.21.15.100:0/2212619316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ead152b30 con 0x563ead25ba90 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b94c00640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563ead300190 0x563ead2f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.705+0000 7f2b93800640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f2cb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b80010000 tx=0x7f2b80002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.706+0000 7f2b91000640 1 -- 172.21.15.100:0/2212619316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80015990 con 0x563ead25ba90 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.706+0000 7f2b91000640 1 -- 172.21.15.100:0/2212619316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80024070 con 0x563ead25ba90 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.706+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563ead2f47e0 con 0x563ead25ba90 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.706+0000 7f2b91000640 1 -- 172.21.15.100:0/2212619316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80015d70 con 0x563ead25ba90 2024-05-09T05:05:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.706+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ead2f24b0 con 0x563ead25ba90 2024-05-09T05:05:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.708+0000 7f2b91000640 1 -- 172.21.15.100:0/2212619316 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2b8001f460 con 0x563ead25ba90 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.709+0000 7f2b91000640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2b74074cb0 0x7f2b74077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.709+0000 7f2b91000640 1 -- 172.21.15.100:0/2212619316 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2b800980b0 con 0x563ead25ba90 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.709+0000 7f2b94200640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2b74074cb0 0x7f2b74077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.710+0000 7f2b96febf40 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x563ead2f8870 0x563ead26b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.710+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 --> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] -- osd_op(unknown.0.0:1 5.2a 5:57fe7535:::100000001f6.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563ead2f1220 con 0x563ead2f8870 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.710+0000 7f2b94200640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2b74074cb0 0x7f2b74077170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x563ead257e70 tx=0x7f2b840057d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.710+0000 7f2b94c00640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x563ead2f8870 0x563ead26b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.711+0000 7f2b94c00640 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x563ead2f8870 0x563ead26b110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b94c00640 1 -- 172.21.15.100:0/2212619316 <== osd.4 v2:172.21.15.133:6800/4260847374 1 ==== osd_op_reply(1 100000001f6.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f2b8c056030 con 0x563ead2f8870 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:error getting xattr cephfs_data/100000001f6.00000000/symlink: (61) No data available 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x563ead2f8870 msgr2=0x563ead26b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x563ead2f8870 0x563ead26b110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2b74074cb0 msgr2=0x7f2b74077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2b74074cb0 0x7f2b74077170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x563ead257e70 tx=0x7f2b840057d0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 msgr2=0x563ead2f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 --2- 172.21.15.100:0/2212619316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ead25ba90 0x563ead2f2cb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2b80010000 tx=0x7f2b80002fb0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b94c00640 1 -- 172.21.15.100:0/2212619316 reap_dead start 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 shutdown_connections 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.712+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 >> 172.21.15.100:0/2212619316 conn(0x563ead272e20 msgr2=0x563ead274a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.713+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 shutdown_connections 2024-05-09T05:05:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.713+0000 7f2b96febf40 1 -- 172.21.15.100:0/2212619316 wait complete. 2024-05-09T05:05:30.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:05:30.718 ERROR:tasks.cephfs.filesystem:Command failed on smithi100 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink' 2024-05-09T05:05:30.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery true 2024-05-09T05:05:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.918+0000 7f08a1e00640 1 Processor -- start 2024-05-09T05:05:30.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.918+0000 7f08a1e00640 1 -- start start 2024-05-09T05:05:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f08a1e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c15f520 0x7f089c0d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f08a1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f089c0b2110 0x7f089c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f08a1e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089c06ef50 con 0x7f089c15f900 2024-05-09T05:05:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f08a1e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f089c06e660 con 0x7f089c0b2110 2024-05-09T05:05:30.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f08a1e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f089c0b43d0 con 0x7f089c15f520 2024-05-09T05:05:30.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f08a1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f089c0b2110 0x7f089c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f0893e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f089c15f900 0x7f089c0d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33468/0 (socket says 172.21.15.100:33468) 2024-05-09T05:05:30.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.920+0000 7f0893e00640 1 -- 172.21.15.100:0/464032153 learned_addr learned my addr 172.21.15.100:0/464032153 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f08a0a00640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c15f520 0x7f089c0d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f08a1400640 1 -- 172.21.15.100:0/464032153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c15f520 msgr2=0x7f089c0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f08a1400640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c15f520 0x7f089c0d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f08a1400640 1 -- 172.21.15.100:0/464032153 >> v1:172.21.15.100:6789/0 conn(0x7f089c15f900 legacy=0x7f089c0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f08a1400640 1 -- 172.21.15.100:0/464032153 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c0b4690 con 0x7f089c0b2110 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f089be00640 1 -- 172.21.15.100:0/464032153 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273671369 0 0) 0x7f089c06ef50 con 0x7f089c15f900 2024-05-09T05:05:30.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.921+0000 7f08a0a00640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c15f520 0x7f089c0d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.922+0000 7f08a1400640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c0b2110 0x7f089c0b2900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0894009d90 tx=0x7f089402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aafef549e54bf22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.922+0000 7f089be00640 1 -- 172.21.15.100:0/464032153 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894007740 con 0x7f089c0b2110 2024-05-09T05:05:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.922+0000 7f089be00640 1 -- 172.21.15.100:0/464032153 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08940078e0 con 0x7f089c0b2110 2024-05-09T05:05:30.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.922+0000 7f089be00640 1 -- 172.21.15.100:0/464032153 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894007cb0 con 0x7f089c0b2110 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 -- 172.21.15.100:0/464032153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c0b2110 msgr2=0x7f089c0b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c0b2110 0x7f089c0b2900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0894009d90 tx=0x7f089402a6f0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 -- 172.21.15.100:0/464032153 shutdown_connections 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c0b2110 0x7f089c0b2900 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 --2- 172.21.15.100:0/464032153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c15f520 0x7f089c0d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 -- 172.21.15.100:0/464032153 >> 172.21.15.100:0/464032153 conn(0x7f089c0d2ec0 msgr2=0x7f089c0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 -- 172.21.15.100:0/464032153 shutdown_connections 2024-05-09T05:05:30.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.923+0000 7f08a1e00640 1 -- 172.21.15.100:0/464032153 wait complete. 2024-05-09T05:05:30.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.925+0000 7f08a1e00640 1 Processor -- start 2024-05-09T05:05:30.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.925+0000 7f08a1e00640 1 -- start start 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c0b2110 0x7f089c1f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c15f520 0x7f089c1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 0x7f089c1f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f089c0d1a10 con 0x7f089c15f900 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f089c06ebe0 con 0x7f089c15f520 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f089c0d1b90 con 0x7f089c0b2110 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 0x7f089c1f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 0x7f089c1f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34300/0 (socket says 172.21.15.100:34300) 2024-05-09T05:05:30.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.926+0000 7f08a1400640 1 -- 172.21.15.100:0/3647271938 learned_addr learned my addr 172.21.15.100:0/3647271938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f0893e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c15f520 0x7f089c1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a0a00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c0b2110 0x7f089c1f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a1400640 1 -- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c0b2110 msgr2=0x7f089c1f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a1400640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c0b2110 0x7f089c1f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a1400640 1 -- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c15f520 msgr2=0x7f089c1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a1400640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c15f520 0x7f089c1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a1400640 1 -- 172.21.15.100:0/3647271938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c1f8be0 con 0x7f089c15f900 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a0a00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c0b2110 0x7f089c1f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f08a1400640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 0x7f089c1f21e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f089402ace0 tx=0x7f0894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.927+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894040070 con 0x7f089c15f900 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.928+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0894031c90 con 0x7f089c15f900 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.928+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894045680 con 0x7f089c15f900 2024-05-09T05:05:30.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.928+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c1f8ec0 con 0x7f089c15f900 2024-05-09T05:05:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.928+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c14bfd0 con 0x7f089c15f900 2024-05-09T05:05:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.929+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c06a550 con 0x7f089c15f900 2024-05-09T05:05:30.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.930+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0894039040 con 0x7f089c15f900 2024-05-09T05:05:30.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.931+0000 7f0899600640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f08780762d0 0x7f0878078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:30.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.931+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f08940b8fc0 con 0x7f089c15f900 2024-05-09T05:05:30.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.931+0000 7f08a0a00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f08780762d0 0x7f0878078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:30.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.932+0000 7f08a0a00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f08780762d0 0x7f0878078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f088c006fd0 tx=0x7f088c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:30.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:30.935+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f08940829d0 con 0x7f089c15f900 2024-05-09T05:05:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.142+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7f089c0d21f0 con 0x7f089c15f900 2024-05-09T05:05:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.146+0000 7f0899600640 1 -- 172.21.15.100:0/3647271938 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f08940822d0 con 0x7f089c15f900 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f08780762d0 msgr2=0x7f0878078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f08780762d0 0x7f0878078790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f088c006fd0 tx=0x7f088c008040 comp rx=0 tx=0).stop 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 msgr2=0x7f089c1f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 0x7f089c1f21e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f089402ace0 tx=0x7f0894004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 shutdown_connections 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f08780762d0 0x7f0878078790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f089c15f900 0x7f089c1f21e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c15f520 0x7f089c1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 --2- 172.21.15.100:0/3647271938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f089c0b2110 0x7f089c1f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 >> 172.21.15.100:0/3647271938 conn(0x7f089c0d2ec0 msgr2=0x7f089c070460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:31.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 shutdown_connections 2024-05-09T05:05:31.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.150+0000 7f08a1e00640 1 -- 172.21.15.100:0/3647271938 wait complete. 2024-05-09T05:05:31.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:31.171 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir) 2024-05-09T05:05:31.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:31.224 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir/file1) 2024-05-09T05:05:31.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:31.282 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s ./file1 sym_dir/symlink_file1) 2024-05-09T05:05:31.334 DEBUG:teuthology.orchestra.run.smithi100:> stdin-killer -- python3 -c ' 2024-05-09T05:05:31.334 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-05-09T05:05:31.334 DEBUG:teuthology.orchestra.run.smithi100:> import stat 2024-05-09T05:05:31.334 DEBUG:teuthology.orchestra.run.smithi100:> 2024-05-09T05:05:31.334 DEBUG:teuthology.orchestra.run.smithi100:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir/symlink_file1").st_ino) 2024-05-09T05:05:31.334 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-05-09T05:05:31.473 INFO:teuthology.orchestra.run.smithi100.stdout:1099511628281 2024-05-09T05:05:31.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:05:31.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:31.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.739+0000 7f2db4600640 1 Processor -- start 2024-05-09T05:05:31.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.739+0000 7f2db4600640 1 -- start start 2024-05-09T05:05:31.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db4600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2dac0d0a70 0x7f2dac15e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:31.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db4600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2dac0afb70 0x7f2dac0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:31.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db4600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dac15e780 con 0x7f2dac0ade90 2024-05-09T05:05:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db4600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac0ae3a0 con 0x7f2dac0d0a70 2024-05-09T05:05:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db4600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac0b4590 con 0x7f2dac0afb70 2024-05-09T05:05:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db1c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2dac0d0a70 0x7f2dac15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db1200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2dac0ade90 0x7f2dac0b5070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33472/0 (socket says 172.21.15.100:33472) 2024-05-09T05:05:31.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db1200640 1 -- 172.21.15.100:0/2877512902 learned_addr learned my addr 172.21.15.100:0/2877512902 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.741+0000 7f2db2600640 1 --2- 172.21.15.100:0/2877512902 >> v2:172.21.15.133:3300/0 conn(0x7f2dac0afb70 0x7f2dac0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.742+0000 7f2dabe00640 1 -- 172.21.15.100:0/2877512902 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391444388 0 0) 0x7f2d98001110 con 0x7f2dac0ade90 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.742+0000 7f2db1c00640 1 -- 172.21.15.100:0/2877512902 >> v2:172.21.15.133:3300/0 conn(0x7f2dac0afb70 msgr2=0x7f2dac0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.742+0000 7f2db1c00640 1 --2- 172.21.15.100:0/2877512902 >> v2:172.21.15.133:3300/0 conn(0x7f2dac0afb70 0x7f2dac0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.742+0000 7f2db1c00640 1 -- 172.21.15.100:0/2877512902 >> v1:172.21.15.100:6789/0 conn(0x7f2dac0ade90 legacy=0x7f2dac0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.742+0000 7f2db1c00640 1 -- 172.21.15.100:0/2877512902 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac0b4870 con 0x7f2dac0d0a70 2024-05-09T05:05:31.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.743+0000 7f2db1c00640 1 --2- 172.21.15.100:0/2877512902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0d0a70 0x7f2dac15e240 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2dac074710 tx=0x7f2da002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83ff670dd9b87ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:31.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.743+0000 7f2dabe00640 1 -- 172.21.15.100:0/2877512902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0037070 con 0x7f2dac0d0a70 2024-05-09T05:05:31.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.743+0000 7f2dabe00640 1 -- 172.21.15.100:0/2877512902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da0032440 con 0x7f2dac0d0a70 2024-05-09T05:05:31.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.743+0000 7f2dabe00640 1 -- 172.21.15.100:0/2877512902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0032810 con 0x7f2dac0d0a70 2024-05-09T05:05:31.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 -- 172.21.15.100:0/2877512902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0d0a70 msgr2=0x7f2dac15e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:31.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 --2- 172.21.15.100:0/2877512902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0d0a70 0x7f2dac15e240 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2dac074710 tx=0x7f2da002a1a0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 -- 172.21.15.100:0/2877512902 shutdown_connections 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 --2- 172.21.15.100:0/2877512902 >> v2:172.21.15.133:3300/0 conn(0x7f2dac0afb70 0x7f2dac0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 --2- 172.21.15.100:0/2877512902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0d0a70 0x7f2dac15e240 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 -- 172.21.15.100:0/2877512902 >> 172.21.15.100:0/2877512902 conn(0x7f2dac0b31e0 msgr2=0x7f2dac0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 -- 172.21.15.100:0/2877512902 shutdown_connections 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.744+0000 7f2db4600640 1 -- 172.21.15.100:0/2877512902 wait complete. 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.746+0000 7f2db4600640 1 Processor -- start 2024-05-09T05:05:31.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.746+0000 7f2db4600640 1 -- start start 2024-05-09T05:05:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db4600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2dac0ade90 0x7f2dac14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db4600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 0x7f2dac151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db4600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dac0d0a70 0x7f2dac153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db4600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac0b04e0 con 0x7f2dac0afb70 2024-05-09T05:05:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db4600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac0ae680 con 0x7f2dac0d0a70 2024-05-09T05:05:31.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db4600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac072570 con 0x7f2dac0ade90 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 0x7f2dac151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 0x7f2dac151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34314/0 (socket says 172.21.15.100:34314) 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 -- 172.21.15.100:0/2366516757 learned_addr learned my addr 172.21.15.100:0/2366516757 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1c00640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2dac0ade90 0x7f2dac14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 -- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2dac0ade90 msgr2=0x7f2dac14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2dac0ade90 0x7f2dac14ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 -- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dac0d0a70 msgr2=0x7f2dac153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.747+0000 7f2db1200640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dac0d0a70 0x7f2dac153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2db1200640 1 -- 172.21.15.100:0/2366516757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac160260 con 0x7f2dac0afb70 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2db1200640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 0x7f2dac151620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c760 tx=0x7f2d9800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98018070 con 0x7f2dac0afb70 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d980070d0 con 0x7f2dac0afb70 2024-05-09T05:05:31.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d980074c0 con 0x7f2dac0afb70 2024-05-09T05:05:31.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dac15f4a0 con 0x7f2dac0afb70 2024-05-09T05:05:31.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.748+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dac15fa60 con 0x7f2dac0afb70 2024-05-09T05:05:31.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.749+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dac157e70 con 0x7f2dac0afb70 2024-05-09T05:05:31.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.751+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d9801b070 con 0x7f2dac0afb70 2024-05-09T05:05:31.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.752+0000 7f2da9600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2d8c0762d0 0x7f2d8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.752+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2d980969b0 con 0x7f2dac0afb70 2024-05-09T05:05:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.752+0000 7f2db1c00640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2d8c0762d0 0x7f2d8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:31.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.753+0000 7f2db1c00640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2d8c0762d0 0x7f2d8c078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2da0034000 tx=0x7f2da002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:31.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:31.756+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2dac15e780 con 0x7f2dac0afb70 2024-05-09T05:05:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.003+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dac076070 con 0x7f2dac0afb70 2024-05-09T05:05:32.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.004+0000 7f2da9600640 1 -- 172.21.15.100:0/2366516757 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5193 (secure 0 0 0) 0x7f2d98060270 con 0x7f2dac0afb70 2024-05-09T05:05:32.006 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:32.006 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:23.198643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:32.007 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2d8c0762d0 msgr2=0x7f2d8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2d8c0762d0 0x7f2d8c078790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2da0034000 tx=0x7f2da002e000 comp rx=0 tx=0).stop 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 msgr2=0x7f2dac151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 0x7f2dac151620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c760 tx=0x7f2d9800cc20 comp rx=0 tx=0).stop 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 shutdown_connections 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2d8c0762d0 0x7f2d8c078790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dac0d0a70 0x7f2dac153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dac0afb70 0x7f2dac151620 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 --2- 172.21.15.100:0/2366516757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2dac0ade90 0x7f2dac14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 >> 172.21.15.100:0/2366516757 conn(0x7f2dac0b31e0 msgr2=0x7f2dac06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 shutdown_connections 2024-05-09T05:05:32.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.007+0000 7f2db4600640 1 -- 172.21.15.100:0/2366516757 wait complete. 2024-05-09T05:05:32.027 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:32.268 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:32.269 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:32.269 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f9.00000000 symlink 2024-05-09T05:05:32.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.375+0000 7fad77279f40 1 Processor -- start 2024-05-09T05:05:32.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.375+0000 7fad77279f40 1 -- start start 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad77279f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad580029a0 0x557f3ea06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad77279f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f3ea92210 0x557f3ea94810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad77279f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 0x557f3e9c1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad77279f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557f3e966f50 con 0x557f3e9c14a0 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad77279f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557f3e96af90 con 0x557f3ea92210 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad77279f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x557f3ea084d0 con 0x7fad580029a0 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad74e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 0x557f3e9c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad74e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 0x557f3e9c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38312/0 (socket says 172.21.15.100:38312) 2024-05-09T05:05:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.376+0000 7fad74e00640 1 -- 172.21.15.100:0/2636639088 learned_addr learned my addr 172.21.15.100:0/2636639088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad73a00640 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f3ea92210 0x557f3ea94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad74e00640 1 -- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad580029a0 msgr2=0x557f3ea06d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad74e00640 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad580029a0 0x557f3ea06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad74e00640 1 -- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f3ea92210 msgr2=0x557f3ea94810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad74e00640 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f3ea92210 0x557f3ea94810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad74e00640 1 -- 172.21.15.100:0/2636639088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3e9c1e70 con 0x557f3e9c14a0 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad74e00640 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 0x557f3e9c1930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557f3ea079f0 tx=0x7fad6c00c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5372ac77cfd94f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad72600640 1 -- 172.21.15.100:0/2636639088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c010470 con 0x557f3e9c14a0 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad72600640 1 -- 172.21.15.100:0/2636639088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c010610 con 0x557f3e9c14a0 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.377+0000 7fad72600640 1 -- 172.21.15.100:0/2636639088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c010a00 con 0x557f3e9c14a0 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 -- 172.21.15.100:0/2636639088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 msgr2=0x557f3e9c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 0x557f3e9c1930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x557f3ea079f0 tx=0x7fad6c00c620 comp rx=0 tx=0).stop 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 -- 172.21.15.100:0/2636639088 shutdown_connections 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3e9c14a0 0x557f3e9c1930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557f3ea92210 0x557f3ea94810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 --2- 172.21.15.100:0/2636639088 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad580029a0 0x557f3ea06d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 -- 172.21.15.100:0/2636639088 >> 172.21.15.100:0/2636639088 conn(0x557f3e9bd600 msgr2=0x557f3e9bd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 -- 172.21.15.100:0/2636639088 shutdown_connections 2024-05-09T05:05:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.378+0000 7fad77279f40 1 -- 172.21.15.100:0/2636639088 wait complete. 2024-05-09T05:05:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.379+0000 7fad77279f40 1 Processor -- start 2024-05-09T05:05:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.379+0000 7fad77279f40 1 -- start start 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad77279f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557f3e9c14a0 0x557f3ea8bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad77279f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3ea92210 0x557f3e9c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad77279f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad580029a0 0x557f3e9c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad77279f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557f3ea06300 con 0x557f3ea92210 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad77279f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x557f3ea930d0 con 0x7fad580029a0 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad77279f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x557f3ea96440 con 0x557f3e9c14a0 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad73a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3ea92210 0x557f3e9c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad73a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3ea92210 0x557f3e9c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38316/0 (socket says 172.21.15.100:38316) 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.380+0000 7fad73a00640 1 -- 172.21.15.100:0/2194264556 learned_addr learned my addr 172.21.15.100:0/2194264556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad74400640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557f3e9c14a0 0x557f3ea8bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad74e00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad580029a0 0x557f3e9c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad73a00640 1 -- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557f3e9c14a0 msgr2=0x557f3ea8bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad73a00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557f3e9c14a0 0x557f3ea8bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad73a00640 1 -- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad580029a0 msgr2=0x557f3e9c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad73a00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad580029a0 0x557f3e9c0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad73a00640 1 -- 172.21.15.100:0/2194264556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f3ea90cc0 con 0x557f3ea92210 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad74400640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x557f3e9c14a0 0x557f3ea8bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad74e00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad580029a0 0x557f3e9c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad73a00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3ea92210 0x557f3e9c0950 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fad5c059040 tx=0x7fad5c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad71200640 1 -- 172.21.15.100:0/2194264556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c066030 con 0x557f3ea92210 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad71200640 1 -- 172.21.15.100:0/2194264556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c00a040 con 0x557f3ea92210 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad71200640 1 -- 172.21.15.100:0/2194264556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00a230 con 0x557f3ea92210 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.381+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f3ea90fa0 con 0x557f3ea92210 2024-05-09T05:05:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.382+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f3ea91560 con 0x557f3ea92210 2024-05-09T05:05:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.384+0000 7fad71200640 1 -- 172.21.15.100:0/2194264556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fad5c069070 con 0x557f3ea92210 2024-05-09T05:05:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.385+0000 7fad71200640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad50074cb0 0x7fad50077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.385+0000 7fad71200640 1 -- 172.21.15.100:0/2194264556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fad5c0d9b70 con 0x557f3ea92210 2024-05-09T05:05:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.385+0000 7fad74400640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad50074cb0 0x7fad50077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.385+0000 7fad77279f40 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x557f3ea8e490 0x557f3eb39720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.385+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 --> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] -- osd_op(unknown.0.0:1 5.36 5:6ee5e2c4:::100000001f9.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f3ea0a6d0 con 0x557f3ea8e490 2024-05-09T05:05:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.385+0000 7fad74e00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x557f3ea8e490 0x557f3eb39720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.386+0000 7fad74400640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad50074cb0 0x7fad50077170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad640015c0 tx=0x7fad64001830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.386+0000 7fad74e00640 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x557f3ea8e490 0x557f3eb39720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.386+0000 7fad74e00640 1 -- 172.21.15.100:0/2194264556 <== osd.1 v2:172.21.15.100:6808/396670832 1 ==== osd_op_reply(1 100000001f9.00000000 [getxattr (11) out=11b] v0'0 uv1 ondisk = 0) ==== 164+0+11 (crc 0 0 0) 0x7fad6c010920 con 0x557f3ea8e490 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.386+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x557f3ea8e490 msgr2=0x557f3eb39720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.386+0000 7fad77279f40 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x557f3ea8e490 0x557f3eb39720 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad50074cb0 msgr2=0x7fad50077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad50074cb0 0x7fad50077170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fad640015c0 tx=0x7fad64001830 comp rx=0 tx=0).stop 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3ea92210 msgr2=0x557f3e9c0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 --2- 172.21.15.100:0/2194264556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557f3ea92210 0x557f3e9c0950 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fad5c059040 tx=0x7fad5c003020 comp rx=0 tx=0).stop 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad74e00640 1 -- 172.21.15.100:0/2194264556 reap_dead start 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 shutdown_connections 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 >> 172.21.15.100:0/2194264556 conn(0x557f3e9bd600 msgr2=0x557f3e9bd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 shutdown_connections 2024-05-09T05:05:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32.387+0000 7fad77279f40 1 -- 172.21.15.100:0/2194264556 wait complete. 2024-05-09T05:05:32.392 INFO:teuthology.orchestra.run.smithi100.stdout:./file1 2024-05-09T05:05:32.392 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type string_wrapper import - decode dump_json 2024-05-09T05:05:32.548 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:32.548 INFO:teuthology.orchestra.run.smithi100.stdout: "s": "./file1" 2024-05-09T05:05:32.548 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:32.549 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:32.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:32.557 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-05-09T05:05:32.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:32.611 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-05-09T05:05:32.665 DEBUG:teuthology.orchestra.run.smithi100:> stdin-killer -- python3 -c ' 2024-05-09T05:05:32.665 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-05-09T05:05:32.665 DEBUG:teuthology.orchestra.run.smithi100:> import stat 2024-05-09T05:05:32.665 DEBUG:teuthology.orchestra.run.smithi100:> 2024-05-09T05:05:32.665 DEBUG:teuthology.orchestra.run.smithi100:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-05-09T05:05:32.665 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-05-09T05:05:32.795 INFO:teuthology.orchestra.run.smithi100.stdout:1099511628283 2024-05-09T05:05:32.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:05:32.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.051+0000 7f8f27c00640 1 Processor -- start 2024-05-09T05:05:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.051+0000 7f8f27c00640 1 -- start start 2024-05-09T05:05:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.052+0000 7f8f27c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f200ade90 0x7f8f200b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.052+0000 7f8f27c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f200b55b0 con 0x7f8f200d0a70 2024-05-09T05:05:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.052+0000 7f8f27c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f200ae3a0 con 0x7f8f200afb70 2024-05-09T05:05:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.052+0000 7f8f27c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200b4590 con 0x7f8f200ade90 2024-05-09T05:05:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.052+0000 7f8f25200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8f200d0a70 0x7f8f2015e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33938/0 (socket says 172.21.15.100:33938) 2024-05-09T05:05:33.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.052+0000 7f8f25200640 1 -- 172.21.15.100:0/2209717224 learned_addr learned my addr 172.21.15.100:0/2209717224 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:33.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937558038 0 0) 0x7f8f14001110 con 0x7f8f200d0a70 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f08003520 con 0x7f8f200d0a70 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f200ade90 0x7f8f200b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4127742906 0 0) 0x7f8f08003520 con 0x7f8f200d0a70 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f200ade90 msgr2=0x7f8f200b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f200ade90 0x7f8f200b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 >> v1:172.21.15.133:6789/0 conn(0x7f8f200afb70 legacy=0x7f8f200affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f200b4870 con 0x7f8f200d0a70 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f8f140018c0 con 0x7f8f200d0a70 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.053+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 >> v1:172.21.15.100:6789/0 conn(0x7f8f200d0a70 legacy=0x7f8f2015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1f400640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f08003a80 0x7f8f08003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1f400640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f08004800 0x7f8f08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1f400640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f080052e0 0x7f8f0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b4590 con 0x7f8f08004800 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0800c160 con 0x7f8f080052e0 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0800c360 con 0x7f8f08003a80 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f08004800 0x7f8f08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f25200640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f08003a80 0x7f8f08003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f25c00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f080052e0 0x7f8f0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1fe00640 1 -- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f08003a80 msgr2=0x7f8f08003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f08003a80 0x7f8f08003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1fe00640 1 -- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f080052e0 msgr2=0x7f8f0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f080052e0 0x7f8f0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f1fe00640 1 -- 172.21.15.100:0/2209717224 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f08003520 con 0x7f8f08004800 2024-05-09T05:05:33.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.054+0000 7f8f25c00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f080052e0 0x7f8f0800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.056+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f08004800 0x7f8f08004c80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b3bc0 tx=0x7f8f08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a6c3898047b476 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.056+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c030070 con 0x7f8f08004800 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.056+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c02ac90 con 0x7f8f08004800 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.056+0000 7f8f1f400640 1 -- 172.21.15.100:0/2209717224 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c00b550 con 0x7f8f08004800 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f27c00640 1 -- 172.21.15.100:0/2209717224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f08004800 msgr2=0x7f8f08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f27c00640 1 --2- 172.21.15.100:0/2209717224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f08004800 0x7f8f08004c80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b3bc0 tx=0x7f8f08005830 comp rx=0 tx=0).stop 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f25c00640 1 -- 172.21.15.100:0/2209717224 reap_dead start 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f27c00640 1 -- 172.21.15.100:0/2209717224 shutdown_connections 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f27c00640 1 -- 172.21.15.100:0/2209717224 >> 172.21.15.100:0/2209717224 conn(0x7f8f200b31e0 msgr2=0x7f8f200d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f27c00640 1 -- 172.21.15.100:0/2209717224 shutdown_connections 2024-05-09T05:05:33.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.057+0000 7f8f27c00640 1 -- 172.21.15.100:0/2209717224 wait complete. 2024-05-09T05:05:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.059+0000 7f8f27c00640 1 Processor -- start 2024-05-09T05:05:33.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.059+0000 7f8f27c00640 1 -- start start 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f27c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 0x7f8f2009cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f27c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f201f36d0 0x7f8f201f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f27c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f20144560 0x7f8f201449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f27c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200b5070 con 0x7f8f20156990 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f27c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8f200ae680 con 0x7f8f201f36d0 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f27c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8f200b51f0 con 0x7f8f20144560 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f25200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 0x7f8f2009cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f25200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 0x7f8f2009cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38338/0 (socket says 172.21.15.100:38338) 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.060+0000 7f8f25200640 1 -- 172.21.15.100:0/1430985563 learned_addr learned my addr 172.21.15.100:0/1430985563 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f25200640 1 -- 172.21.15.100:0/1430985563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f20144560 msgr2=0x7f8f201449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f25200640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f20144560 0x7f8f201449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f25200640 1 -- 172.21.15.100:0/1430985563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f201f36d0 msgr2=0x7f8f201f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f25200640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f201f36d0 0x7f8f201f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f25200640 1 -- 172.21.15.100:0/1430985563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f201f4090 con 0x7f8f20156990 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f25200640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 0x7f8f2009cdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8f14000fb0 tx=0x7f8f1400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400c8d0 con 0x7f8f20156990 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f14018070 con 0x7f8f20156990 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400ccd0 con 0x7f8f20156990 2024-05-09T05:05:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f201434c0 con 0x7f8f20156990 2024-05-09T05:05:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.061+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f20143a80 con 0x7f8f20156990 2024-05-09T05:05:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.063+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f201441a0 con 0x7f8f20156990 2024-05-09T05:05:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.064+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8f1401d460 con 0x7f8f20156990 2024-05-09T05:05:33.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.065+0000 7f8f1cc00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8f00076300 0x7f8f000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.065+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8f140974f0 con 0x7f8f20156990 2024-05-09T05:05:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.065+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8f00076300 0x7f8f000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.066+0000 7f8f1fe00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8f00076300 0x7f8f000787c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0930 tx=0x7f8f0c02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.070+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8f201f4090 con 0x7f8f20156990 2024-05-09T05:05:33.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.319+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f200b2250 con 0x7f8f20156990 2024-05-09T05:05:33.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.320+0000 7f8f1cc00640 1 -- 172.21.15.100:0/1430985563 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5193 (secure 0 0 0) 0x7f8f200b55b0 con 0x7f8f20156990 2024-05-09T05:05:33.321 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:33.321 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:23.198643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:33.321 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-05-09T05:05:33.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8f00076300 msgr2=0x7f8f000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8f00076300 0x7f8f000787c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8f200b0930 tx=0x7f8f0c02c000 comp rx=0 tx=0).stop 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 msgr2=0x7f8f2009cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 0x7f8f2009cdc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8f14000fb0 tx=0x7f8f1400ed00 comp rx=0 tx=0).stop 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 shutdown_connections 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f8f00076300 0x7f8f000787c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f20144560 0x7f8f201449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f201f36d0 0x7f8f201f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 --2- 172.21.15.100:0/1430985563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f20156990 0x7f8f2009cdc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 >> 172.21.15.100:0/1430985563 conn(0x7f8f200b31e0 msgr2=0x7f8f20073960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 shutdown_connections 2024-05-09T05:05:33.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.323+0000 7f8f27c00640 1 -- 172.21.15.100:0/1430985563 wait complete. 2024-05-09T05:05:33.343 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:33.583 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:33.584 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:33.584 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-05-09T05:05:33.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.685+0000 7f7d2652af40 1 Processor -- start 2024-05-09T05:05:33.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.685+0000 7f7d2652af40 1 -- start start 2024-05-09T05:05:33.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.686+0000 7f7d2652af40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2be3a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.686+0000 7f7d2652af40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 0x55bb2be44130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.686+0000 7f7d2652af40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb72c0 0x55bb2bd997b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.686+0000 7f7d2652af40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bb2bdb58c0 con 0x55bb2bdb6e40 2024-05-09T05:05:33.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.686+0000 7f7d2652af40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bb2bd12f50 con 0x7f7d080023c0 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.686+0000 7f7d2652af40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55bb2bdb3d80 con 0x55bb2bdb72c0 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 0x55bb2be44130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 0x55bb2be44130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38352/0 (socket says 172.21.15.100:38352) 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 -- 172.21.15.100:0/1576595449 learned_addr learned my addr 172.21.15.100:0/1576595449 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22c00640 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2be3a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d23600640 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb72c0 0x55bb2bd997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 -- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb72c0 msgr2=0x55bb2bd997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb72c0 0x55bb2bd997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 -- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 msgr2=0x55bb2be3a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2be3a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 -- 172.21.15.100:0/1576595449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2bc95b30 con 0x55bb2bdb6e40 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22c00640 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2be3a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.687+0000 7f7d22200640 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 0x55bb2be44130 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009730 tx=0x7f7d10009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9d4e4b4289f877 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d20e00640 1 -- 172.21.15.100:0/1576595449 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10007830 con 0x55bb2bdb6e40 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d20e00640 1 -- 172.21.15.100:0/1576595449 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d100079f0 con 0x55bb2bdb6e40 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d20e00640 1 -- 172.21.15.100:0/1576595449 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10007de0 con 0x55bb2bdb6e40 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 -- 172.21.15.100:0/1576595449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 msgr2=0x55bb2be44130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 0x55bb2be44130 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009730 tx=0x7f7d10009760 comp rx=0 tx=0).stop 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 -- 172.21.15.100:0/1576595449 shutdown_connections 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb72c0 0x55bb2bd997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb6e40 0x55bb2be44130 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 --2- 172.21.15.100:0/1576595449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2be3a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 -- 172.21.15.100:0/1576595449 >> 172.21.15.100:0/1576595449 conn(0x55bb2bdb5e20 msgr2=0x55bb2bd98670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 -- 172.21.15.100:0/1576595449 shutdown_connections 2024-05-09T05:05:33.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.688+0000 7f7d2652af40 1 -- 172.21.15.100:0/1576595449 wait complete. 2024-05-09T05:05:33.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.689+0000 7f7d2652af40 1 Processor -- start 2024-05-09T05:05:33.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.689+0000 7f7d2652af40 1 -- start start 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.690+0000 7f7d2652af40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb6e40 0x55bb2bd9cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.690+0000 7f7d2652af40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb72c0 0x55bb2be34020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.690+0000 7f7d2652af40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2bd99790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.690+0000 7f7d2652af40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55bb2bdb6600 con 0x55bb2bdb72c0 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.690+0000 7f7d2652af40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55bb2be3af50 con 0x7f7d080023c0 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.690+0000 7f7d2652af40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55bb2bdb4760 con 0x55bb2bdb6e40 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb72c0 0x55bb2be34020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb72c0 0x55bb2be34020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38356/0 (socket says 172.21.15.100:38356) 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 -- 172.21.15.100:0/4130965734 learned_addr learned my addr 172.21.15.100:0/4130965734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d23600640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2bd99790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22c00640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb6e40 0x55bb2bd9cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 -- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb6e40 msgr2=0x55bb2bd9cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb6e40 0x55bb2bd9cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 -- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 msgr2=0x55bb2bd99790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2bd99790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 -- 172.21.15.100:0/4130965734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb2bd98890 con 0x55bb2bdb72c0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d23600640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d080023c0 0x55bb2bd99790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22c00640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55bb2bdb6e40 0x55bb2bd9cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.691+0000 7f7d22200640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb72c0 0x55bb2be34020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d10005740 tx=0x7f7d10005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.692+0000 7f7d1b400640 1 -- 172.21.15.100:0/4130965734 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10024020 con 0x55bb2bdb72c0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.692+0000 7f7d1b400640 1 -- 172.21.15.100:0/4130965734 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d100206a0 con 0x55bb2bdb72c0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.692+0000 7f7d1b400640 1 -- 172.21.15.100:0/4130965734 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10020a90 con 0x55bb2bdb72c0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.692+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb2be39b00 con 0x55bb2bdb72c0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.692+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb2bdb8440 con 0x55bb2bdb72c0 2024-05-09T05:05:33.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.694+0000 7f7d1b400640 1 -- 172.21.15.100:0/4130965734 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d10027020 con 0x55bb2bdb72c0 2024-05-09T05:05:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.695+0000 7f7d1b400640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7d04074cb0 0x7f7d04077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.695+0000 7f7d1b400640 1 -- 172.21.15.100:0/4130965734 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7d10097ef0 con 0x55bb2bdb72c0 2024-05-09T05:05:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.695+0000 7f7d22c00640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7d04074cb0 0x7f7d04077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.696+0000 7f7d2652af40 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55bb2be34560 0x55bb2bdae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.696+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb2be37450 con 0x55bb2be34560 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.696+0000 7f7d23600640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55bb2be34560 0x55bb2bdae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.696+0000 7f7d22c00640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7d04074cb0 0x7f7d04077170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d14055000 tx=0x7f7d14006000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d23600640 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55bb2be34560 0x55bb2bdae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d23600640 1 -- 172.21.15.100:0/4130965734 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f7d1c0073f0 con 0x55bb2be34560 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55bb2be34560 msgr2=0x55bb2bdae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55bb2be34560 0x55bb2bdae900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7d04074cb0 msgr2=0x7f7d04077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7d04074cb0 0x7f7d04077170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d14055000 tx=0x7f7d14006000 comp rx=0 tx=0).stop 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb72c0 msgr2=0x55bb2be34020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 --2- 172.21.15.100:0/4130965734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bb2bdb72c0 0x55bb2be34020 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d10005740 tx=0x7f7d10005a00 comp rx=0 tx=0).stop 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d23600640 1 -- 172.21.15.100:0/4130965734 reap_dead start 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 shutdown_connections 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 >> 172.21.15.100:0/4130965734 conn(0x55bb2bdb5e20 msgr2=0x55bb2bd6bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:33.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 shutdown_connections 2024-05-09T05:05:33.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.697+0000 7f7d2652af40 1 -- 172.21.15.100:0/4130965734 wait complete. 2024-05-09T05:05:33.703 INFO:teuthology.orchestra.run.smithi100.stdout:Y��alphaparent_a 2024-05-09T05:05:33.703 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-09T05:05:33.804 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:33.804 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 1099511628283, 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "ancestors": [ 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1099511628282, 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "alpha", 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 2 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1, 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "parent_a", 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 18 2024-05-09T05:05:33.805 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:33.806 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-05-09T05:05:33.806 INFO:teuthology.orchestra.run.smithi100.stdout: "pool": 5, 2024-05-09T05:05:33.806 INFO:teuthology.orchestra.run.smithi100.stdout: "old_pools": [] 2024-05-09T05:05:33.806 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:33.806 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:33.812 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2024-05-09T05:05:33.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.916+0000 7ff4eb2cbf40 1 Processor -- start 2024-05-09T05:05:33.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.916+0000 7ff4eb2cbf40 1 -- start start 2024-05-09T05:05:33.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4eb2cbf40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 0x555b9b6ea920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4eb2cbf40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b78cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4eb2cbf40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b78b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4eb2cbf40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555b9b662f50 con 0x555b9b6ec020 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4eb2cbf40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x555b9b666f90 con 0x555b9b783d00 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4eb2cbf40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x555b9b7058c0 con 0x7ff4cc003680 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e7a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b78cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e7a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b78cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38366/0 (socket says 172.21.15.100:38366) 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e7a00640 1 -- 172.21.15.100:0/2879361772 learned_addr learned my addr 172.21.15.100:0/2879361772 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e8400640 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 0x555b9b6ea920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e8e00640 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b78b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e7a00640 1 -- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 msgr2=0x555b9b6ea920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.917+0000 7ff4e7a00640 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 0x555b9b6ea920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e7a00640 1 -- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 msgr2=0x555b9b78b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e7a00640 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b78b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e7a00640 1 -- 172.21.15.100:0/2879361772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9b708080 con 0x555b9b6ec020 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e7a00640 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b78cd30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c440 tx=0x7ff4d000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993e8d7bce7dc294 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e6600640 1 -- 172.21.15.100:0/2879361772 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000e600 con 0x555b9b6ec020 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e6600640 1 -- 172.21.15.100:0/2879361772 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d000e7a0 con 0x555b9b6ec020 2024-05-09T05:05:33.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.918+0000 7ff4e6600640 1 -- 172.21.15.100:0/2879361772 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000e950 con 0x555b9b6ec020 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/2879361772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 msgr2=0x555b9b78cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b78cd30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c440 tx=0x7ff4d000c900 comp rx=0 tx=0).stop 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/2879361772 shutdown_connections 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b78b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b78cd30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/2879361772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 0x555b9b6ea920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/2879361772 >> 172.21.15.100:0/2879361772 conn(0x555b9b705e20 msgr2=0x555b9b704760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:33.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/2879361772 shutdown_connections 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.919+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/2879361772 wait complete. 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.920+0000 7ff4eb2cbf40 1 Processor -- start 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.920+0000 7ff4eb2cbf40 1 -- start start 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4eb2cbf40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b77f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4eb2cbf40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b7046f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4eb2cbf40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 0x555b9b704c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4eb2cbf40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555b9b78d270 con 0x555b9b6ec020 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4eb2cbf40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x555b9b795bf0 con 0x555b9b783d00 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4eb2cbf40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x555b9b707000 con 0x7ff4cc003680 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b77f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b77f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38382/0 (socket says 172.21.15.100:38382) 2024-05-09T05:05:33.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 -- 172.21.15.100:0/4111335702 learned_addr learned my addr 172.21.15.100:0/4111335702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e7a00640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b7046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 -- 172.21.15.100:0/4111335702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 msgr2=0x555b9b704c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4cc003680 0x555b9b704c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 -- 172.21.15.100:0/4111335702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 msgr2=0x555b9b7046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x555b9b783d00 0x555b9b7046f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.921+0000 7ff4e8400640 1 -- 172.21.15.100:0/4111335702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b9b795960 con 0x555b9b6ec020 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.922+0000 7ff4e8400640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b77f890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800d4d0 tx=0x7ff4d800d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.922+0000 7ff4e5200640 1 -- 172.21.15.100:0/4111335702 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d800e040 con 0x555b9b6ec020 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.922+0000 7ff4e5200640 1 -- 172.21.15.100:0/4111335702 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d8013800 con 0x555b9b6ec020 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.922+0000 7ff4e5200640 1 -- 172.21.15.100:0/4111335702 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8013bd0 con 0x555b9b6ec020 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.922+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b9b78a760 con 0x555b9b6ec020 2024-05-09T05:05:33.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.922+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b9b78ace0 con 0x555b9b6ec020 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.924+0000 7ff4e5200640 1 -- 172.21.15.100:0/4111335702 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4d801a3b0 con 0x555b9b6ec020 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.925+0000 7ff4e5200640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4c4074cb0 0x7ff4c4077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.925+0000 7ff4e5200640 1 -- 172.21.15.100:0/4111335702 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff4d8096540 con 0x555b9b6ec020 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.926+0000 7ff4e7a00640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4c4074cb0 0x7ff4c4077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.926+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x555b9b7943d0 0x555b9b82a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.926+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555b9b82a9c0 con 0x555b9b7943d0 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.926+0000 7ff4e8e00640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x555b9b7943d0 0x555b9b82a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:33.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.926+0000 7ff4e7a00640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4c4074cb0 0x7ff4c4077170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c440 tx=0x7ff4d0002000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4e8e00640 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x555b9b7943d0 0x555b9b82a480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4e8e00640 1 -- 172.21.15.100:0/4111335702 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7ff4e00014f0 con 0x555b9b7943d0 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x555b9b7943d0 msgr2=0x555b9b82a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x555b9b7943d0 0x555b9b82a480 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4c4074cb0 msgr2=0x7ff4c4077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4c4074cb0 0x7ff4c4077170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000c440 tx=0x7ff4d0002000 comp rx=0 tx=0).stop 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 msgr2=0x555b9b77f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4eb2cbf40 1 --2- 172.21.15.100:0/4111335702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b9b6ec020 0x555b9b77f890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff4d800d4d0 tx=0x7ff4d800d8d0 comp rx=0 tx=0).stop 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.927+0000 7ff4e8e00640 1 -- 172.21.15.100:0/4111335702 reap_dead start 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.928+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 shutdown_connections 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.928+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 >> 172.21.15.100:0/4111335702 conn(0x555b9b705e20 msgr2=0x555b9b794d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.928+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 shutdown_connections 2024-05-09T05:05:33.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:33.928+0000 7ff4eb2cbf40 1 -- 172.21.15.100:0/4111335702 wait complete. 2024-05-09T05:05:33.933 INFO:teuthology.orchestra.run.smithi100.stdout:@@ 2024-05-09T05:05:33.934 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type file_layout_t import - decode dump_json 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_unit": 4194304, 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_count": 1, 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout: "object_size": 4194304, 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_id": 5, 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ns": "" 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:34.024 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:34.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:34.029 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_b) 2024-05-09T05:05:34.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:34.084 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_a/alpha parent_b/alpha) 2024-05-09T05:05:34.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.337+0000 7f60ff200640 1 Processor -- start 2024-05-09T05:05:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.337+0000 7f60ff200640 1 -- start start 2024-05-09T05:05:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.338+0000 7f60ff200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61000d3660 0x7f61000d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.338+0000 7f60ff200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61000d1a10 0x7f61000d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.338+0000 7f60ff200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61000d2f80 con 0x7f61000b4530 2024-05-09T05:05:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.338+0000 7f60ff200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f61000d4010 con 0x7f61000d1a10 2024-05-09T05:05:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.338+0000 7f60ff200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f61000d2360 con 0x7f61000d3660 2024-05-09T05:05:34.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fe800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61000d1a10 0x7f61000d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fde00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f61000b4530 0x7f61000b5c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33958/0 (socket says 172.21.15.100:33958) 2024-05-09T05:05:34.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fde00640 1 -- 172.21.15.100:0/244749767 learned_addr learned my addr 172.21.15.100:0/244749767 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:34.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fd400640 1 --2- 172.21.15.100:0/244749767 >> v2:172.21.15.133:3300/0 conn(0x7f61000d3660 0x7f61000d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fe800640 1 -- 172.21.15.100:0/244749767 >> v2:172.21.15.133:3300/0 conn(0x7f61000d3660 msgr2=0x7f61000d3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:34.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fe800640 1 --2- 172.21.15.100:0/244749767 >> v2:172.21.15.133:3300/0 conn(0x7f61000d3660 0x7f61000d3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fe800640 1 -- 172.21.15.100:0/244749767 >> v1:172.21.15.100:6789/0 conn(0x7f61000b4530 legacy=0x7f61000b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fe800640 1 -- 172.21.15.100:0/244749767 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61000b51e0 con 0x7f61000d1a10 2024-05-09T05:05:34.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.339+0000 7f60fca00640 1 -- 172.21.15.100:0/244749767 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068667386 0 0) 0x7f61000d2f80 con 0x7f61000b4530 2024-05-09T05:05:34.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.340+0000 7f60fe800640 1 --2- 172.21.15.100:0/244749767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d1a10 0x7f61000d1e20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f61000d2ba0 tx=0x7f60f802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eefcbeca6ada815 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60fca00640 1 -- 172.21.15.100:0/244749767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8007740 con 0x7f61000d1a10 2024-05-09T05:05:34.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60fca00640 1 -- 172.21.15.100:0/244749767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f80078e0 con 0x7f61000d1a10 2024-05-09T05:05:34.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60fca00640 1 -- 172.21.15.100:0/244749767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8007cb0 con 0x7f61000d1a10 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 -- 172.21.15.100:0/244749767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d1a10 msgr2=0x7f61000d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 --2- 172.21.15.100:0/244749767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d1a10 0x7f61000d1e20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f61000d2ba0 tx=0x7f60f802a680 comp rx=0 tx=0).stop 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 -- 172.21.15.100:0/244749767 shutdown_connections 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 --2- 172.21.15.100:0/244749767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d1a10 0x7f61000d1e20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 --2- 172.21.15.100:0/244749767 >> v2:172.21.15.133:3300/0 conn(0x7f61000d3660 0x7f61000d3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 -- 172.21.15.100:0/244749767 >> 172.21.15.100:0/244749767 conn(0x7f610008eb30 msgr2=0x7f610009e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 -- 172.21.15.100:0/244749767 shutdown_connections 2024-05-09T05:05:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.341+0000 7f60ff200640 1 -- 172.21.15.100:0/244749767 wait complete. 2024-05-09T05:05:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.343+0000 7f60ff200640 1 Processor -- start 2024-05-09T05:05:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.343+0000 7f60ff200640 1 -- start start 2024-05-09T05:05:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60ff200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61000b4530 0x7f61001f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60ff200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61000d1a10 0x7f61000cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60ff200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 0x7f61000ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60ff200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f61000b5730 con 0x7f61000d3660 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60ff200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f61000b5450 con 0x7f61000b4530 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60ff200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f61000d28d0 con 0x7f61000d1a10 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60fe800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 0x7f61000ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60fe800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 0x7f61000ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38396/0 (socket says 172.21.15.100:38396) 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.344+0000 7f60fe800640 1 -- 172.21.15.100:0/3807848650 learned_addr learned my addr 172.21.15.100:0/3807848650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fde00640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61000b4530 0x7f61001f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fe800640 1 -- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61000d1a10 msgr2=0x7f61000cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fe800640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61000d1a10 0x7f61000cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fe800640 1 -- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61000b4530 msgr2=0x7f61001f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fe800640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61000b4530 0x7f61001f4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fe800640 1 -- 172.21.15.100:0/3807848650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61001e9020 con 0x7f61000d3660 2024-05-09T05:05:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fde00640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61000b4530 0x7f61001f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:34.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.345+0000 7f60fe800640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 0x7f61000ccc50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009e50 tx=0x7f60f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.346+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8040070 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.346+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8031bf0 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.346+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8045460 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.346+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61001e9300 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.346+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61001e98c0 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.347+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61001e9ac0 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.348+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f60f8039040 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.349+0000 7f60f6000640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60e00762d0 0x7f60e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.349+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f60f80b8cf0 con 0x7f61000d3660 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.349+0000 7f60fde00640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60e00762d0 0x7f60e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.350+0000 7f60fde00640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60e00762d0 0x7f60e0078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f60 tx=0x7f60f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.354+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f61001e9ac0 con 0x7f61000d3660 2024-05-09T05:05:34.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.600+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f610006a550 con 0x7f61000d3660 2024-05-09T05:05:34.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.601+0000 7f60f6000640 1 -- 172.21.15.100:0/3807848650 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5193 (secure 0 0 0) 0x7f60f804c030 con 0x7f61000d3660 2024-05-09T05:05:34.602 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:34.602 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:23.198643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:34.602 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.603+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60e00762d0 msgr2=0x7f60e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.603+0000 7f60ff200640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60e00762d0 0x7f60e0078790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f60 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.603+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 msgr2=0x7f61000ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 0x7f61000ccc50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009e50 tx=0x7f60f8004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 shutdown_connections 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f60e00762d0 0x7f60e0078790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61000d3660 0x7f61000ccc50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f61000d1a10 0x7f61000cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 --2- 172.21.15.100:0/3807848650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61000b4530 0x7f61001f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 >> 172.21.15.100:0/3807848650 conn(0x7f610008eb30 msgr2=0x7f61000d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 shutdown_connections 2024-05-09T05:05:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.604+0000 7f60ff200640 1 -- 172.21.15.100:0/3807848650 wait complete. 2024-05-09T05:05:34.623 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:34.860 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:34.860 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:34.860 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-05-09T05:05:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.961+0000 7ff471249f40 1 Processor -- start 2024-05-09T05:05:34.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.961+0000 7ff471249f40 1 -- start start 2024-05-09T05:05:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff471249f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56118772f960 0x5611877f8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff471249f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 0x56118772d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff471249f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187807190 0x56118772de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff471249f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561187777d80 con 0x561187762a90 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff471249f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5611877798c0 con 0x56118772f960 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff471249f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x561187807df0 con 0x561187807190 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 0x56118772d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 0x56118772d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38410/0 (socket says 172.21.15.100:38410) 2024-05-09T05:05:34.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 -- 172.21.15.100:0/2810704257 learned_addr learned my addr 172.21.15.100:0/2810704257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 -- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187807190 msgr2=0x56118772de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff46e400640 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56118772f960 0x5611877f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187807190 0x56118772de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 -- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56118772f960 msgr2=0x5611877f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56118772f960 0x5611877f8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.962+0000 7ff467e00640 1 -- 172.21.15.100:0/2810704257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56118767f300 con 0x561187762a90 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.963+0000 7ff467e00640 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 0x56118772d930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff4580095d0 tx=0x7ff458009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad90d28747b3d0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.963+0000 7ff46d000640 1 -- 172.21.15.100:0/2810704257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458017070 con 0x561187762a90 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.963+0000 7ff46d000640 1 -- 172.21.15.100:0/2810704257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458006680 con 0x561187762a90 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.963+0000 7ff46d000640 1 -- 172.21.15.100:0/2810704257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458006a30 con 0x561187762a90 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 -- 172.21.15.100:0/2810704257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 msgr2=0x56118772d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 0x56118772d930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff4580095d0 tx=0x7ff458009a90 comp rx=0 tx=0).stop 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 -- 172.21.15.100:0/2810704257 shutdown_connections 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187807190 0x56118772de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561187762a90 0x56118772d930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 --2- 172.21.15.100:0/2810704257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56118772f960 0x5611877f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 -- 172.21.15.100:0/2810704257 >> 172.21.15.100:0/2810704257 conn(0x561187779e20 msgr2=0x56118777a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 -- 172.21.15.100:0/2810704257 shutdown_connections 2024-05-09T05:05:34.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.964+0000 7ff471249f40 1 -- 172.21.15.100:0/2810704257 wait complete. 2024-05-09T05:05:34.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.965+0000 7ff471249f40 1 Processor -- start 2024-05-09T05:05:34.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.965+0000 7ff471249f40 1 -- start start 2024-05-09T05:05:34.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff471249f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56118772f960 0x56118777b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff471249f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187762a90 0x5611878a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff471249f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561187807190 0x5611878a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff471249f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561187808100 con 0x56118772f960 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff471249f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5611878086c0 con 0x561187807190 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff471249f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x561187762120 con 0x561187762a90 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff46e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56118772f960 0x56118777b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff46e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56118772f960 0x56118777b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38414/0 (socket says 172.21.15.100:38414) 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.966+0000 7ff46e400640 1 -- 172.21.15.100:0/3566098244 learned_addr learned my addr 172.21.15.100:0/3566098244 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff467e00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187762a90 0x5611878a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46ee00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561187807190 0x5611878a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46e400640 1 -- 172.21.15.100:0/3566098244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187762a90 msgr2=0x5611878a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46e400640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x561187762a90 0x5611878a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46e400640 1 -- 172.21.15.100:0/3566098244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561187807190 msgr2=0x5611878a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46e400640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x561187807190 0x5611878a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46e400640 1 -- 172.21.15.100:0/3566098244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561187659b30 con 0x56118772f960 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff46e400640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56118772f960 0x56118777b5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff460007dd0 tx=0x7ff460006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff466a00640 1 -- 172.21.15.100:0/3566098244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460017070 con 0x56118772f960 2024-05-09T05:05:34.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.967+0000 7ff466a00640 1 -- 172.21.15.100:0/3566098244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460010730 con 0x56118772f960 2024-05-09T05:05:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.968+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56118772e190 con 0x56118772f960 2024-05-09T05:05:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.968+0000 7ff466a00640 1 -- 172.21.15.100:0/3566098244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460006e60 con 0x56118772f960 2024-05-09T05:05:34.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.968+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56118772dbd0 con 0x56118772f960 2024-05-09T05:05:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.970+0000 7ff466a00640 1 -- 172.21.15.100:0/3566098244 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff46001a070 con 0x56118772f960 2024-05-09T05:05:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.971+0000 7ff466a00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff44c074cb0 0x7ff44c077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.971+0000 7ff466a00640 1 -- 172.21.15.100:0/3566098244 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff4600957a0 con 0x56118772f960 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.971+0000 7ff467e00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff44c074cb0 0x7ff44c077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.971+0000 7ff471249f40 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5611878007c0 0x561187802090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.971+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611877f5000 con 0x5611878007c0 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.972+0000 7ff46ee00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5611878007c0 0x561187802090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.972+0000 7ff467e00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff44c074cb0 0x7ff44c077170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x561187800690 tx=0x7ff45800f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.972+0000 7ff46ee00640 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5611878007c0 0x561187802090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff46ee00640 1 -- 172.21.15.100:0/3566098244 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (95) out=95b] v0'0 uv2 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7ff468056030 con 0x5611878007c0 2024-05-09T05:05:34.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5611878007c0 msgr2=0x561187802090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5611878007c0 0x561187802090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff44c074cb0 msgr2=0x7ff44c077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff44c074cb0 0x7ff44c077170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x561187800690 tx=0x7ff45800f000 comp rx=0 tx=0).stop 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56118772f960 msgr2=0x56118777b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 --2- 172.21.15.100:0/3566098244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56118772f960 0x56118777b5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff460007dd0 tx=0x7ff460006750 comp rx=0 tx=0).stop 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff46ee00640 1 -- 172.21.15.100:0/3566098244 reap_dead start 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 shutdown_connections 2024-05-09T05:05:34.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 >> 172.21.15.100:0/3566098244 conn(0x561187779e20 msgr2=0x56118777a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 shutdown_connections 2024-05-09T05:05:34.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:34.973+0000 7ff471249f40 1 -- 172.21.15.100:0/3566098244 wait complete. 2024-05-09T05:05:34.978 INFO:teuthology.orchestra.run.smithi100.stdout:Y��alphaparent_b 2024-05-09T05:05:34.978 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-09T05:05:35.070 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 1099511628283, 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ancestors": [ 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1099511628284, 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "alpha", 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 3 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1, 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "parent_b", 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 25 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:35.071 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-05-09T05:05:35.072 INFO:teuthology.orchestra.run.smithi100.stdout: "pool": 5, 2024-05-09T05:05:35.072 INFO:teuthology.orchestra.run.smithi100.stdout: "old_pools": [] 2024-05-09T05:05:35.072 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:35.072 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:35.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2024-05-09T05:05:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.273+0000 7fb704c00640 1 Processor -- start 2024-05-09T05:05:35.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.273+0000 7fb704c00640 1 -- start start 2024-05-09T05:05:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.275+0000 7fb704c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb7000ce4b0 0x7fb7000d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.275+0000 7fb704c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.275+0000 7fb704c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb700160ae0 0x7fb700160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.275+0000 7fb704c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb7000b5c10 con 0x7fb7000ce4b0 2024-05-09T05:05:35.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.275+0000 7fb704c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb7000cedd0 con 0x7fb700160ae0 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.275+0000 7fb704c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb7000b5000 con 0x7fb70015df40 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb7000ce4b0 0x7fb7000d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb7000ce4b0 0x7fb7000d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38424/0 (socket says 172.21.15.100:38424) 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 -- 172.21.15.100:0/2396072818 learned_addr learned my addr 172.21.15.100:0/2396072818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6f7e00640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ffe00640 1 --2- 172.21.15.100:0/2396072818 >> v2:172.21.15.133:3300/0 conn(0x7fb700160ae0 0x7fb700160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 -- 172.21.15.100:0/2396072818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 msgr2=0x7fb7000ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 -- 172.21.15.100:0/2396072818 >> v2:172.21.15.133:3300/0 conn(0x7fb700160ae0 msgr2=0x7fb700160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 --2- 172.21.15.100:0/2396072818 >> v2:172.21.15.133:3300/0 conn(0x7fb700160ae0 0x7fb700160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6ff400640 1 -- 172.21.15.100:0/2396072818 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7000b52e0 con 0x7fb7000ce4b0 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.276+0000 7fb6f7e00640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.277+0000 7fb6ff400640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb7000d0730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb700072060 tx=0x7fb6f002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37885fff568c3a9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.277+0000 7fb6fea00640 1 -- 172.21.15.100:0/2396072818 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0037070 con 0x7fb7000ce4b0 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb6fea00640 1 -- 172.21.15.100:0/2396072818 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f0032440 con 0x7fb7000ce4b0 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb6fea00640 1 -- 172.21.15.100:0/2396072818 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0032810 con 0x7fb7000ce4b0 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 -- 172.21.15.100:0/2396072818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 msgr2=0x7fb7000d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb7000d0730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb700072060 tx=0x7fb6f002a140 comp rx=0 tx=0).stop 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 -- 172.21.15.100:0/2396072818 shutdown_connections 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 --2- 172.21.15.100:0/2396072818 >> v2:172.21.15.133:3300/0 conn(0x7fb700160ae0 0x7fb700160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 --2- 172.21.15.100:0/2396072818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb7000d0730 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.278+0000 7fb704c00640 1 -- 172.21.15.100:0/2396072818 >> 172.21.15.100:0/2396072818 conn(0x7fb70006c5b0 msgr2=0x7fb70006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.279+0000 7fb704c00640 1 -- 172.21.15.100:0/2396072818 shutdown_connections 2024-05-09T05:05:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.279+0000 7fb704c00640 1 -- 172.21.15.100:0/2396072818 wait complete. 2024-05-09T05:05:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.280+0000 7fb704c00640 1 Processor -- start 2024-05-09T05:05:35.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.280+0000 7fb704c00640 1 -- start start 2024-05-09T05:05:35.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.281+0000 7fb704c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb70014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.281+0000 7fb704c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.281+0000 7fb704c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb700160ae0 0x7fb7000ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.281+0000 7fb704c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb70015e3c0 con 0x7fb7000ce4b0 2024-05-09T05:05:35.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.281+0000 7fb704c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb7000b58a0 con 0x7fb700160ae0 2024-05-09T05:05:35.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.281+0000 7fb704c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb70015ad20 con 0x7fb70015df40 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb70014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb70014a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38438/0 (socket says 172.21.15.100:38438) 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 -- 172.21.15.100:0/2965321121 learned_addr learned my addr 172.21.15.100:0/2965321121 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ffe00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb700160ae0 0x7fb7000ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 -- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 msgr2=0x7fb7000acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6f7e00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 -- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb700160ae0 msgr2=0x7fb7000ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb700160ae0 0x7fb7000ad290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 -- 172.21.15.100:0/2965321121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7000aa610 con 0x7fb7000ce4b0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.282+0000 7fb6ff400640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb70014a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6f002a180 tx=0x7fb6f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.283+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0041020 con 0x7fb7000ce4b0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.283+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f00306c0 con 0x7fb7000ce4b0 2024-05-09T05:05:35.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.283+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0037040 con 0x7fb7000ce4b0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.283+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7000aa8f0 con 0x7fb7000ce4b0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.283+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7000aaeb0 con 0x7fb7000ce4b0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.284+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70006a630 con 0x7fb7000ce4b0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.285+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6f0044020 con 0x7fb7000ce4b0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.287+0000 7fb6f7400640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb6dc0762d0 0x7fb6dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.287+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f00b7e40 con 0x7fb7000ce4b0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.287+0000 7fb6f7e00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb6dc0762d0 0x7fb6dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:35.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.287+0000 7fb6f7e00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb6dc0762d0 0x7fb6dc078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:35.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.291+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6f004b030 con 0x7fb7000ce4b0 2024-05-09T05:05:35.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.498+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) -- 0x7fb7000d0910 con 0x7fb7000ce4b0 2024-05-09T05:05:35.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.798+0000 7fb6f7400640 1 -- 172.21.15.100:0/2965321121 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v33) ==== 124+0+0 (secure 0 0 0) 0x7fb6f0081700 con 0x7fb7000ce4b0 2024-05-09T05:05:35.799 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'data_new' created 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb6dc0762d0 msgr2=0x7fb6dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb6dc0762d0 0x7fb6dc078790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8006fd0 tx=0x7fb6e8008040 comp rx=0 tx=0).stop 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 msgr2=0x7fb70014a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb70014a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6f002a180 tx=0x7fb6f00046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 shutdown_connections 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb6dc0762d0 0x7fb6dc078790 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb700160ae0 0x7fb7000ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb70015df40 0x7fb7000acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 --2- 172.21.15.100:0/2965321121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7000ce4b0 0x7fb70014a7a0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6f002a180 tx=0x7fb6f00046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:35.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.802+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 >> 172.21.15.100:0/2965321121 conn(0x7fb70006c5b0 msgr2=0x7fb700073820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:35.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.803+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 shutdown_connections 2024-05-09T05:05:35.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:35.803+0000 7fb704c00640 1 -- 172.21.15.100:0/2965321121 wait complete. 2024-05-09T05:05:35.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2024-05-09T05:05:36.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.023+0000 7f235d600640 1 Processor -- start 2024-05-09T05:05:36.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.023+0000 7f235d600640 1 -- start start 2024-05-09T05:05:36.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f235d600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23580d3700 0x7f23580d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:36.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f235d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23580d5c40 0x7f23580cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:36.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f235d600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f235815fdc0 con 0x7f235815f860 2024-05-09T05:05:36.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f235d600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f23581600a0 con 0x7f23580d3700 2024-05-09T05:05:36.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f235d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2358160380 con 0x7f23580d5c40 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f2357e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23580d3700 0x7f23580d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f234fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f235815f860 0x7f23580d3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33970/0 (socket says 172.21.15.100:33970) 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.025+0000 7f234fe00640 1 -- 172.21.15.100:0/3697446898 learned_addr learned my addr 172.21.15.100:0/3697446898 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f235cc00640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23580d5c40 0x7f23580cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f2357e00640 1 -- 172.21.15.100:0/3697446898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23580d5c40 msgr2=0x7f23580cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f2357e00640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23580d5c40 0x7f23580cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f2357e00640 1 -- 172.21.15.100:0/3697446898 >> v1:172.21.15.100:6789/0 conn(0x7f235815f860 legacy=0x7f23580d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f2357400640 1 -- 172.21.15.100:0/3697446898 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157509177 0 0) 0x7f235815fdc0 con 0x7f235815f860 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f2357e00640 1 -- 172.21.15.100:0/3697446898 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2358160660 con 0x7f23580d3700 2024-05-09T05:05:36.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.026+0000 7f235cc00640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23580d5c40 0x7f23580cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:05:36.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.027+0000 7f2357e00640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d3700 0x7f23580d2f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23480097a0 tx=0x7f234802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cb6be5c307515a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:36.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.028+0000 7f2357400640 1 -- 172.21.15.100:0/3697446898 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348037070 con 0x7f23580d3700 2024-05-09T05:05:36.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.028+0000 7f2357400640 1 -- 172.21.15.100:0/3697446898 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2348032440 con 0x7f23580d3700 2024-05-09T05:05:36.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.028+0000 7f2357400640 1 -- 172.21.15.100:0/3697446898 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348032810 con 0x7f23580d3700 2024-05-09T05:05:36.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.028+0000 7f235d600640 1 -- 172.21.15.100:0/3697446898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d3700 msgr2=0x7f23580d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:36.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.028+0000 7f235d600640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d3700 0x7f23580d2f00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23480097a0 tx=0x7f234802a210 comp rx=0 tx=0).stop 2024-05-09T05:05:36.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.029+0000 7f235d600640 1 -- 172.21.15.100:0/3697446898 shutdown_connections 2024-05-09T05:05:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.029+0000 7f235d600640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23580d5c40 0x7f23580cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.029+0000 7f235d600640 1 --2- 172.21.15.100:0/3697446898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d3700 0x7f23580d2f00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.029+0000 7f235d600640 1 -- 172.21.15.100:0/3697446898 >> 172.21.15.100:0/3697446898 conn(0x7f23580d5120 msgr2=0x7f23580d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.029+0000 7f235d600640 1 -- 172.21.15.100:0/3697446898 shutdown_connections 2024-05-09T05:05:36.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.029+0000 7f235d600640 1 -- 172.21.15.100:0/3697446898 wait complete. 2024-05-09T05:05:36.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.030+0000 7f235d600640 1 Processor -- start 2024-05-09T05:05:36.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.031+0000 7f235d600640 1 -- start start 2024-05-09T05:05:36.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.031+0000 7f235d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23580d3700 0x7f2358156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:36.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.031+0000 7f235d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 0x7f235815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:36.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f235d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f235815f860 0x7f235815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:36.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f235d600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23580d0460 con 0x7f23580d5c40 2024-05-09T05:05:36.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f235d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f23580d02e0 con 0x7f23580d3700 2024-05-09T05:05:36.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f235d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f23580d05e0 con 0x7f235815f860 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 0x7f235815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 0x7f235815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38452/0 (socket says 172.21.15.100:38452) 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 -- 172.21.15.100:0/3473498067 learned_addr learned my addr 172.21.15.100:0/3473498067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f2357e00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23580d3700 0x7f2358156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f235cc00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f235815f860 0x7f235815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 -- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f235815f860 msgr2=0x7f235815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f235815f860 0x7f235815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 -- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23580d3700 msgr2=0x7f2358156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:36.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23580d3700 0x7f2358156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.032+0000 7f234fe00640 1 -- 172.21.15.100:0/3473498067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2358156f60 con 0x7f23580d5c40 2024-05-09T05:05:36.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.033+0000 7f234fe00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 0x7f235815af20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f234000c3c0 tx=0x7f234000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:36.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.033+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23400074e0 con 0x7f23580d5c40 2024-05-09T05:05:36.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.033+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23400047e0 con 0x7f23580d5c40 2024-05-09T05:05:36.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.033+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2340004bd0 con 0x7f23580d5c40 2024-05-09T05:05:36.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.033+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23581f4f80 con 0x7f23580d5c40 2024-05-09T05:05:36.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.033+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23581f5540 con 0x7f23580d5c40 2024-05-09T05:05:36.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.034+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235806a550 con 0x7f23580d5c40 2024-05-09T05:05:36.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.036+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2340011070 con 0x7f23580d5c40 2024-05-09T05:05:36.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.037+0000 7f2354c00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f23340762d0 0x7f2334078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:36.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.037+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6072+0+0 (secure 0 0 0) 0x7f23400979b0 con 0x7f23580d5c40 2024-05-09T05:05:36.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.037+0000 7f2357e00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f23340762d0 0x7f2334078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:36.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.038+0000 7f2357e00640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f23340762d0 0x7f2334078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2348034000 tx=0x7f234802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:36.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.041+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2340061180 con 0x7f23580d5c40 2024-05-09T05:05:36.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.291+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) -- 0x7f2358068c90 con 0x7f23580d5c40 2024-05-09T05:05:36.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.841+0000 7f2354c00640 1 -- 172.21.15.100:0/3473498067 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v19) ==== 131+0+0 (secure 0 0 0) 0x7f2340060a80 con 0x7f23580d5c40 2024-05-09T05:05:36.843 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 6 to fsmap 2024-05-09T05:05:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.848+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f23340762d0 msgr2=0x7f2334078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:36.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.848+0000 7f235d600640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f23340762d0 0x7f2334078790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2348034000 tx=0x7f234802e000 comp rx=0 tx=0).stop 2024-05-09T05:05:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.848+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 msgr2=0x7f235815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:36.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.848+0000 7f235d600640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 0x7f235815af20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f234000c3c0 tx=0x7f234000c880 comp rx=0 tx=0).stop 2024-05-09T05:05:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.849+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 shutdown_connections 2024-05-09T05:05:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.849+0000 7f235d600640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f23340762d0 0x7f2334078790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.849+0000 7f235d600640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f235815f860 0x7f235815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.849+0000 7f235d600640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23580d5c40 0x7f235815af20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.849+0000 7f235d600640 1 --2- 172.21.15.100:0/3473498067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23580d3700 0x7f2358156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:36.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.849+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 >> 172.21.15.100:0/3473498067 conn(0x7f23580d5120 msgr2=0x7f23580d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:36.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.850+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 shutdown_connections 2024-05-09T05:05:36.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:36.850+0000 7f235d600640 1 -- 172.21.15.100:0/3473498067 wait complete. 2024-05-09T05:05:36.875 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.051+0000 7f7a78600640 1 Processor -- start 2024-05-09T05:05:37.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.051+0000 7f7a78600640 1 -- start start 2024-05-09T05:05:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.052+0000 7f7a78600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a7006fd60 0x7f7a70070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.052+0000 7f7a78600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a70073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.052+0000 7f7a78600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a70070680 con 0x7f7a7015fc70 2024-05-09T05:05:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.052+0000 7f7a78600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7006f390 con 0x7f7a7006fd60 2024-05-09T05:05:37.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.052+0000 7f7a78600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7006e810 con 0x7f7a70073840 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.053+0000 7f7a76600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7a7015fc70 0x7f7a70160100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33976/0 (socket says 172.21.15.100:33976) 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.053+0000 7f7a76600640 1 -- 172.21.15.100:0/1468360026 learned_addr learned my addr 172.21.15.100:0/1468360026 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.053+0000 7f7a75200640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a70073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.053+0000 7f7a75c00640 1 --2- 172.21.15.100:0/1468360026 >> v2:172.21.15.133:3300/0 conn(0x7f7a7006fd60 0x7f7a70070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.053+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302271032 0 0) 0x7f7a70070680 con 0x7f7a7015fc70 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.053+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a58003520 con 0x7f7a7015fc70 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2386067231 0 0) 0x7f7a58003520 con 0x7f7a7015fc70 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 msgr2=0x7f7a70073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a70073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 >> v2:172.21.15.133:3300/0 conn(0x7f7a7006fd60 msgr2=0x7f7a70070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 --2- 172.21.15.100:0/1468360026 >> v2:172.21.15.133:3300/0 conn(0x7f7a7006fd60 0x7f7a70070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7006eaf0 con 0x7f7a7015fc70 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f7a68001a70 con 0x7f7a7015fc70 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 >> v1:172.21.15.100:6789/0 conn(0x7f7a7015fc70 legacy=0x7f7a70160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a58003a00 0x7f7a58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a58004800 0x7f7a58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7006f390 con 0x7f7a58003a00 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7006e810 con 0x7f7a58004800 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5800b9c0 con 0x7f7a70073840 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.054+0000 7f7a75c00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a58003a00 0x7f7a58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a76600640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a75200640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a58004800 0x7f7a58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a75c00640 1 -- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 msgr2=0x7f7a580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a75c00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a75c00640 1 -- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a58004800 msgr2=0x7f7a58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a75c00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a58004800 0x7f7a58004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a75c00640 1 -- 172.21.15.100:0/1468360026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a58003520 con 0x7f7a58003a00 2024-05-09T05:05:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.055+0000 7f7a76600640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a70073840 0x7f7a580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.056+0000 7f7a75c00640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a58003a00 0x7f7a58003e20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009af0 tx=0x7f7a58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260a68ebd2b380e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.056+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64036070 con 0x7f7a58003a00 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.056+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a64031400 con 0x7f7a58003a00 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.056+0000 7f7a6fe00640 1 -- 172.21.15.100:0/1468360026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64009690 con 0x7f7a58003a00 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a78600640 1 -- 172.21.15.100:0/1468360026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a58003a00 msgr2=0x7f7a58003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a78600640 1 --2- 172.21.15.100:0/1468360026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a58003a00 0x7f7a58003e20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009af0 tx=0x7f7a58005830 comp rx=0 tx=0).stop 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a76600640 1 -- 172.21.15.100:0/1468360026 reap_dead start 2024-05-09T05:05:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a78600640 1 -- 172.21.15.100:0/1468360026 shutdown_connections 2024-05-09T05:05:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a78600640 1 -- 172.21.15.100:0/1468360026 >> 172.21.15.100:0/1468360026 conn(0x7f7a700b31e0 msgr2=0x7f7a700d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a78600640 1 -- 172.21.15.100:0/1468360026 shutdown_connections 2024-05-09T05:05:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.057+0000 7f7a78600640 1 -- 172.21.15.100:0/1468360026 wait complete. 2024-05-09T05:05:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.059+0000 7f7a78600640 1 Processor -- start 2024-05-09T05:05:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.059+0000 7f7a78600640 1 -- start start 2024-05-09T05:05:37.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a78600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a58003a00 0x7f7a70148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a78600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 0x7f7a700b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a78600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70157b70 0x7f7a70157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a78600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7006e4a0 con 0x7f7a700b26d0 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a78600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7006f0b0 con 0x7f7a70157b70 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a78600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f7a70159f00 con 0x7f7a58003a00 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 0x7f7a700b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 0x7f7a700b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38474/0 (socket says 172.21.15.100:38474) 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 -- 172.21.15.100:0/3792479229 learned_addr learned my addr 172.21.15.100:0/3792479229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 -- 172.21.15.100:0/3792479229 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a58003a00 msgr2=0x7f7a70148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a58003a00 0x7f7a70148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 -- 172.21.15.100:0/3792479229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70157b70 msgr2=0x7f7a70157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70157b70 0x7f7a70157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.060+0000 7f7a75200640 1 -- 172.21.15.100:0/3792479229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a70148e70 con 0x7f7a700b26d0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.061+0000 7f7a75200640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 0x7f7a700b0920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0108f0 tx=0x7f7a5c010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.061+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00f040 con 0x7f7a700b26d0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.061+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00eb40 con 0x7f7a700b26d0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.061+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c01c400 con 0x7f7a700b26d0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.061+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a700b1290 con 0x7f7a700b26d0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.061+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a700b1850 con 0x7f7a700b26d0 2024-05-09T05:05:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.062+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a70076070 con 0x7f7a700b26d0 2024-05-09T05:05:37.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.063+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a5c0143f0 con 0x7f7a700b26d0 2024-05-09T05:05:37.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.064+0000 7f7a6d600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a50076270 0x7f7a50078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.065+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7f7a5c097ef0 con 0x7f7a700b26d0 2024-05-09T05:05:37.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.065+0000 7f7a75c00640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a50076270 0x7f7a50078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.066+0000 7f7a75c00640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a50076270 0x7f7a50078730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a64033000 tx=0x7f7a6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:37.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.069+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a70148e70 con 0x7f7a700b26d0 2024-05-09T05:05:37.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.317+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a700aec60 con 0x7f7a700b26d0 2024-05-09T05:05:37.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.318+0000 7f7a6d600640 1 -- 172.21.15.100:0/3792479229 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7f7a700aec60 con 0x7f7a700b26d0 2024-05-09T05:05:37.319 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:37.319 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:37.319 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:37.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.321+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a50076270 msgr2=0x7f7a50078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.321+0000 7f7a78600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a50076270 0x7f7a50078730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a64033000 tx=0x7f7a6402e000 comp rx=0 tx=0).stop 2024-05-09T05:05:37.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.321+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 msgr2=0x7f7a700b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.321+0000 7f7a78600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 0x7f7a700b0920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0108f0 tx=0x7f7a5c010db0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 shutdown_connections 2024-05-09T05:05:37.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7a50076270 0x7f7a50078730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70157b70 0x7f7a70157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a700b26d0 0x7f7a700b0920 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 --2- 172.21.15.100:0/3792479229 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a58003a00 0x7f7a70148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 >> 172.21.15.100:0/3792479229 conn(0x7f7a700b31e0 msgr2=0x7f7a700afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:37.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 shutdown_connections 2024-05-09T05:05:37.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.322+0000 7f7a78600640 1 -- 172.21.15.100:0/3792479229 wait complete. 2024-05-09T05:05:37.341 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.538+0000 7fb0b6600640 1 Processor -- start 2024-05-09T05:05:37.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.539+0000 7fb0b6600640 1 -- start start 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b6600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0b015f330 0x7fb0b00d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b6600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0b00d5790 0x7fb0b00d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b6600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b00d2980 con 0x7fb0b00b5f10 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b6600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b00b4e70 con 0x7fb0b00d5790 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b6600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb0b00b5150 con 0x7fb0b015f330 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b5c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0b00d5790 0x7fb0b00d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b5c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0b00d5790 0x7fb0b00d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38478/0 (socket says 172.21.15.100:38478) 2024-05-09T05:05:37.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.540+0000 7fb0b5c00640 1 -- 172.21.15.100:0/3125346531 learned_addr learned my addr 172.21.15.100:0/3125346531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:37.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.541+0000 7fb0b5200640 1 --2- 172.21.15.100:0/3125346531 >> v2:172.21.15.133:3300/0 conn(0x7fb0b015f330 0x7fb0b00d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.541+0000 7fb0b5c00640 1 -- 172.21.15.100:0/3125346531 >> v2:172.21.15.133:3300/0 conn(0x7fb0b015f330 msgr2=0x7fb0b00d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:37.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.541+0000 7fb0b5c00640 1 --2- 172.21.15.100:0/3125346531 >> v2:172.21.15.133:3300/0 conn(0x7fb0b015f330 0x7fb0b00d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.541+0000 7fb0b5c00640 1 -- 172.21.15.100:0/3125346531 >> v1:172.21.15.133:6789/0 conn(0x7fb0b00b5f10 legacy=0x7fb0b00d5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:37.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.541+0000 7fb0b5c00640 1 -- 172.21.15.100:0/3125346531 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b00b5430 con 0x7fb0b00d5790 2024-05-09T05:05:37.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.541+0000 7fb0b5200640 1 --2- 172.21.15.100:0/3125346531 >> v2:172.21.15.133:3300/0 conn(0x7fb0b015f330 0x7fb0b00d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:37.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.542+0000 7fb0b5c00640 1 --2- 172.21.15.100:0/3125346531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00d5790 0x7fb0b00d2cf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00d2c20 tx=0x7fb0a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb71462fa5d90c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:37.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.542+0000 7fb0af400640 1 -- 172.21.15.100:0/3125346531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8037070 con 0x7fb0b00d5790 2024-05-09T05:05:37.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.542+0000 7fb0af400640 1 -- 172.21.15.100:0/3125346531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a8032440 con 0x7fb0b00d5790 2024-05-09T05:05:37.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.542+0000 7fb0af400640 1 -- 172.21.15.100:0/3125346531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8032810 con 0x7fb0b00d5790 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 -- 172.21.15.100:0/3125346531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00d5790 msgr2=0x7fb0b00d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 --2- 172.21.15.100:0/3125346531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00d5790 0x7fb0b00d2cf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00d2c20 tx=0x7fb0a802a1e0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 -- 172.21.15.100:0/3125346531 shutdown_connections 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 --2- 172.21.15.100:0/3125346531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00d5790 0x7fb0b00d2cf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 --2- 172.21.15.100:0/3125346531 >> v2:172.21.15.133:3300/0 conn(0x7fb0b015f330 0x7fb0b00d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 -- 172.21.15.100:0/3125346531 >> 172.21.15.100:0/3125346531 conn(0x7fb0b008ebb0 msgr2=0x7fb0b009e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:37.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 -- 172.21.15.100:0/3125346531 shutdown_connections 2024-05-09T05:05:37.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.543+0000 7fb0b6600640 1 -- 172.21.15.100:0/3125346531 wait complete. 2024-05-09T05:05:37.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.545+0000 7fb0b6600640 1 Processor -- start 2024-05-09T05:05:37.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.545+0000 7fb0b6600640 1 -- start start 2024-05-09T05:05:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 0x7fb0b015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b6600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b00d5790 0x7fb0b0160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b6600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0b015f330 0x7fb0b00b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b6600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b015f710 con 0x7fb0b00b5f10 2024-05-09T05:05:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b6600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b00b59f0 con 0x7fb0b00d5790 2024-05-09T05:05:37.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b6600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b015f890 con 0x7fb0b015f330 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 0x7fb0b015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 0x7fb0b015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38492/0 (socket says 172.21.15.100:38492) 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.546+0000 7fb0b5200640 1 -- 172.21.15.100:0/2562602050 learned_addr learned my addr 172.21.15.100:0/2562602050 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b5200640 1 -- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0b015f330 msgr2=0x7fb0b00b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b5200640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0b015f330 0x7fb0b00b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b5200640 1 -- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b00d5790 msgr2=0x7fb0b0160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0afe00640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b00d5790 0x7fb0b0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b5200640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b00d5790 0x7fb0b0160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b5200640 1 -- 172.21.15.100:0/2562602050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b00a2890 con 0x7fb0b00b5f10 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0afe00640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b00d5790 0x7fb0b0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b5200640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 0x7fb0b015e520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c820 tx=0x7fb0a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0015070 con 0x7fb0b00b5f10 2024-05-09T05:05:37.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a0007a30 con 0x7fb0b00b5f10 2024-05-09T05:05:37.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007de0 con 0x7fb0b00b5f10 2024-05-09T05:05:37.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.547+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b00a2b70 con 0x7fb0b00b5f10 2024-05-09T05:05:37.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.548+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b0160880 con 0x7fb0b00b5f10 2024-05-09T05:05:37.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.549+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b006a550 con 0x7fb0b00b5f10 2024-05-09T05:05:37.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.550+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb0a0018070 con 0x7fb0b00b5f10 2024-05-09T05:05:37.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.551+0000 7fb0acc00640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb08c076300 0x7fb08c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:37.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.551+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6104+0+0 (secure 0 0 0) 0x7fb0a00975b0 con 0x7fb0b00b5f10 2024-05-09T05:05:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.551+0000 7fb0afe00640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb08c076300 0x7fb08c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:37.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.552+0000 7fb0afe00640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb08c076300 0x7fb08c0787c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0161b10 tx=0x7fb098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:37.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.556+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb0a0060e10 con 0x7fb0b00b5f10 2024-05-09T05:05:37.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.764+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0b00a2d40 con 0x7fb0b00b5f10 2024-05-09T05:05:37.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.766+0000 7fb0acc00640 1 -- 172.21.15.100:0/2562602050 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+18518 (secure 0 0 0) 0x7fb0a0060710 con 0x7fb0b00b5f10 2024-05-09T05:05:37.768 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:37.768 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":34,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:36.293164+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:18.083878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:19.108109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-05-09T05:05:35.515359+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb08c076300 msgr2=0x7fb08c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb08c076300 0x7fb08c0787c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0161b10 tx=0x7fb098009040 comp rx=0 tx=0).stop 2024-05-09T05:05:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 msgr2=0x7fb0b015e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 0x7fb0b015e520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c820 tx=0x7fb0a000cce0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 shutdown_connections 2024-05-09T05:05:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb08c076300 0x7fb08c0787c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb0b015f330 0x7fb0b00b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b00d5790 0x7fb0b0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 --2- 172.21.15.100:0/2562602050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0b00b5f10 0x7fb0b015e520 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.769+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 >> 172.21.15.100:0/2562602050 conn(0x7fb0b008ebb0 msgr2=0x7fb0b00754c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.770+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 shutdown_connections 2024-05-09T05:05:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:37.770+0000 7fb0b6600640 1 -- 172.21.15.100:0/2562602050 wait complete. 2024-05-09T05:05:37.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:37.791 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new ./parent_b/alpha) 2024-05-09T05:05:37.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:38.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.069+0000 7feb0da00640 1 Processor -- start 2024-05-09T05:05:38.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.069+0000 7feb0da00640 1 -- start start 2024-05-09T05:05:38.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.070+0000 7feb0da00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb08161730 0x7feb080cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feb0da00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb080ce580 con 0x7feb08143710 2024-05-09T05:05:38.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feb0da00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb08143af0 con 0x7feb080ce160 2024-05-09T05:05:38.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feb0da00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7feb08160ce0 con 0x7feb08161730 2024-05-09T05:05:38.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feb07e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7feb08143710 0x7feb0815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33988/0 (socket says 172.21.15.100:33988) 2024-05-09T05:05:38.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feb07e00640 1 -- 172.21.15.100:0/3959309514 learned_addr learned my addr 172.21.15.100:0/3959309514 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:38.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feaff400640 1 --2- 172.21.15.100:0/3959309514 >> v2:172.21.15.133:3300/0 conn(0x7feb08161730 0x7feb080cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.071+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006702510 0 0) 0x7feb080ce580 con 0x7feb08143710 2024-05-09T05:05:38.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaec003520 con 0x7feb08143710 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2247775432 0 0) 0x7feaec003520 con 0x7feb08143710 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 >> v2:172.21.15.133:3300/0 conn(0x7feb08161730 msgr2=0x7feb080cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 --2- 172.21.15.100:0/3959309514 >> v2:172.21.15.133:3300/0 conn(0x7feb08161730 0x7feb080cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 >> v1:172.21.15.133:6789/0 conn(0x7feb080ce160 legacy=0x7feb080cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0815e240 con 0x7feb08143710 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7feaf80016f0 con 0x7feb08143710 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 >> v1:172.21.15.100:6789/0 conn(0x7feb08143710 legacy=0x7feb0815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feaec003a50 0x7feaec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feaec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaec0052e0 0x7feaec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb08160ce0 con 0x7feaec004800 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7feaec00c1b0 con 0x7feaec0052e0 2024-05-09T05:05:38.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7feaec00c3b0 con 0x7feaec003a50 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.072+0000 7feaff400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feaec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feb07e00640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feaec003a50 0x7feaec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feaff400640 1 -- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feaec003a50 msgr2=0x7feaec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feaff400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feaec003a50 0x7feaec003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feaff400640 1 -- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaec0052e0 msgr2=0x7feaec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feb0d000640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaec0052e0 0x7feaec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feaff400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaec0052e0 0x7feaec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feaff400640 1 -- 172.21.15.100:0/3959309514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaec003520 con 0x7feaec004800 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feb0d000640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaec0052e0 0x7feaec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.073+0000 7feb0d000640 1 -- 172.21.15.100:0/3959309514 reap_dead start 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.074+0000 7feaff400640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feaec004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009a90 tx=0x7feaec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f7104612bfd28c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.074+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0036070 con 0x7feaec004800 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.074+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf0031400 con 0x7feaec004800 2024-05-09T05:05:38.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.074+0000 7feb07400640 1 -- 172.21.15.100:0/3959309514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0009690 con 0x7feaec004800 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 -- 172.21.15.100:0/3959309514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 msgr2=0x7feaec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feaec004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009a90 tx=0x7feaec005830 comp rx=0 tx=0).stop 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 -- 172.21.15.100:0/3959309514 shutdown_connections 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 --2- 172.21.15.100:0/3959309514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feaec004c80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 -- 172.21.15.100:0/3959309514 >> 172.21.15.100:0/3959309514 conn(0x7feb0806c7f0 msgr2=0x7feb0806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 -- 172.21.15.100:0/3959309514 shutdown_connections 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.075+0000 7feb0da00640 1 -- 172.21.15.100:0/3959309514 wait complete. 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.077+0000 7feb0da00640 1 Processor -- start 2024-05-09T05:05:38.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.077+0000 7feb0da00640 1 -- start start 2024-05-09T05:05:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb0da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feb0815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb0da00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb080cced0 0x7feb081e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb0da00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb081e9ad0 0x7feb080cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb0da00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb08161210 con 0x7feaec004800 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb0da00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7feb08160f30 con 0x7feb080cced0 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb0da00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7feb08072490 con 0x7feb081e9ad0 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb07e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feb0815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb07e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feb0815cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38504/0 (socket says 172.21.15.100:38504) 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb07e00640 1 -- 172.21.15.100:0/4141565150 learned_addr learned my addr 172.21.15.100:0/4141565150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb07e00640 1 -- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb081e9ad0 msgr2=0x7feb080cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.078+0000 7feb07e00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb081e9ad0 0x7feb080cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb07e00640 1 -- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb080cced0 msgr2=0x7feb081e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feaff400640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb080cced0 0x7feb081e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb07e00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb080cced0 0x7feb081e9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb07e00640 1 -- 172.21.15.100:0/4141565150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb080cbe30 con 0x7feaec004800 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb07e00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feb0815cbd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feaf800d7c0 tx=0x7feaf800dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80074e0 con 0x7feaec004800 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf80047e0 con 0x7feaec004800 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8004bb0 con 0x7feaec004800 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb080cc110 con 0x7feaec004800 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.079+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb080cc6d0 con 0x7feaec004800 2024-05-09T05:05:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.081+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb0806a550 con 0x7feaec004800 2024-05-09T05:05:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.082+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feaf801b020 con 0x7feaec004800 2024-05-09T05:05:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.083+0000 7feb04c00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feae40762d0 0x7feae4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.083+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7feaf80976d0 con 0x7feaec004800 2024-05-09T05:05:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.083+0000 7feaff400640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feae40762d0 0x7feae4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.084+0000 7feaff400640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feae40762d0 0x7feae4078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feaf0033000 tx=0x7feaf0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.088+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feaf8060ea0 con 0x7feaec004800 2024-05-09T05:05:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.341+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb080b2820 con 0x7feaec004800 2024-05-09T05:05:38.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.342+0000 7feb04c00640 1 -- 172.21.15.100:0/4141565150 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7feaf80607a0 con 0x7feaec004800 2024-05-09T05:05:38.343 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:38.343 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:38.343 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feae40762d0 msgr2=0x7feae4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feae40762d0 0x7feae4078790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feaf0033000 tx=0x7feaf0008030 comp rx=0 tx=0).stop 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 msgr2=0x7feb0815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feb0815cbd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feaf800d7c0 tx=0x7feaf800dc80 comp rx=0 tx=0).stop 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 shutdown_connections 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7feae40762d0 0x7feae4078790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb081e9ad0 0x7feb080cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb080cced0 0x7feb081e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 --2- 172.21.15.100:0/4141565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaec004800 0x7feb0815cbd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 >> 172.21.15.100:0/4141565150 conn(0x7feb0806c7f0 msgr2=0x7feb0815fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.345+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 shutdown_connections 2024-05-09T05:05:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.346+0000 7feb0da00640 1 -- 172.21.15.100:0/4141565150 wait complete. 2024-05-09T05:05:38.365 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:38.600 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:38.600 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:38.601 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-05-09T05:05:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.706+0000 7fa87dd33f40 1 Processor -- start 2024-05-09T05:05:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.706+0000 7fa87dd33f40 1 -- start start 2024-05-09T05:05:38.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87dd33f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40cec960 0x560d40dbc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87dd33f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40d1fa90 0x560d40db4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87dd33f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40db5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87dd33f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560d40d34d80 con 0x560d40dc4190 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87dd33f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560d40d368c0 con 0x560d40d1fa90 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87dd33f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x560d40dc4df0 con 0x560d40cec960 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40db5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40db5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38512/0 (socket says 172.21.15.100:38512) 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.707+0000 7fa87ba00640 1 -- 172.21.15.100:0/832442682 learned_addr learned my addr 172.21.15.100:0/832442682 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87a600640 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40d1fa90 0x560d40db4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87ba00640 1 -- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40cec960 msgr2=0x560d40dbc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87ba00640 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40cec960 0x560d40dbc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87ba00640 1 -- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40d1fa90 msgr2=0x560d40db4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87ba00640 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40d1fa90 0x560d40db4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87ba00640 1 -- 172.21.15.100:0/832442682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d40c3c300 con 0x560d40dc4190 2024-05-09T05:05:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa87ba00640 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40db5270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c490 tx=0x7fa87400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69667526659244fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa879200640 1 -- 172.21.15.100:0/832442682 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8740115f0 con 0x560d40dc4190 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa879200640 1 -- 172.21.15.100:0/832442682 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874017070 con 0x560d40dc4190 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.708+0000 7fa879200640 1 -- 172.21.15.100:0/832442682 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8740119f0 con 0x560d40dc4190 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 -- 172.21.15.100:0/832442682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 msgr2=0x560d40db5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40db5270 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c490 tx=0x7fa87400c950 comp rx=0 tx=0).stop 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 -- 172.21.15.100:0/832442682 shutdown_connections 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40db5270 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40d1fa90 0x560d40db4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/832442682 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40cec960 0x560d40dbc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 -- 172.21.15.100:0/832442682 >> 172.21.15.100:0/832442682 conn(0x560d40d36e20 msgr2=0x560d40cecdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 -- 172.21.15.100:0/832442682 shutdown_connections 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.709+0000 7fa87dd33f40 1 -- 172.21.15.100:0/832442682 wait complete. 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.710+0000 7fa87dd33f40 1 Processor -- start 2024-05-09T05:05:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.710+0000 7fa87dd33f40 1 -- start start 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87dd33f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40cec960 0x560d40db4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87dd33f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40d1fa90 0x560d40db5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87dd33f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40dc6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87dd33f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560d40ceabc0 con 0x560d40dc4190 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87dd33f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x560d40d37440 con 0x560d40cec960 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87dd33f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x560d40cea950 con 0x560d40d1fa90 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40dc6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40dc6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38524/0 (socket says 172.21.15.100:38524) 2024-05-09T05:05:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.711+0000 7fa87ba00640 1 -- 172.21.15.100:0/875906298 learned_addr learned my addr 172.21.15.100:0/875906298 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87ba00640 1 -- 172.21.15.100:0/875906298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40d1fa90 msgr2=0x560d40db5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87ba00640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x560d40d1fa90 0x560d40db5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87ba00640 1 -- 172.21.15.100:0/875906298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40cec960 msgr2=0x560d40db4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87b000640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40cec960 0x560d40db4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87ba00640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560d40cec960 0x560d40db4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87ba00640 1 -- 172.21.15.100:0/875906298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d40c16b30 con 0x560d40dc4190 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87ba00640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40dc6120 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa874014040 tx=0x7fa8740033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa873400640 1 -- 172.21.15.100:0/875906298 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874012a30 con 0x560d40dc4190 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa873400640 1 -- 172.21.15.100:0/875906298 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874022070 con 0x560d40dc4190 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa873400640 1 -- 172.21.15.100:0/875906298 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874012e10 con 0x560d40dc4190 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560d40d38c70 con 0x560d40dc4190 2024-05-09T05:05:38.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.712+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d40d38400 con 0x560d40dc4190 2024-05-09T05:05:38.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.714+0000 7fa873400640 1 -- 172.21.15.100:0/875906298 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa87401c400 con 0x560d40dc4190 2024-05-09T05:05:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.715+0000 7fa873400640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa858074cb0 0x7fa858077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.716+0000 7fa873400640 1 -- 172.21.15.100:0/875906298 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7fa8740986e0 con 0x560d40dc4190 2024-05-09T05:05:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.716+0000 7fa87b000640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa858074cb0 0x7fa858077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.716+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x560d40d1b7a0 0x560d40dc6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.716+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560d40d1ef60 con 0x560d40d1b7a0 2024-05-09T05:05:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.716+0000 7fa87a600640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x560d40d1b7a0 0x560d40dc6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87b000640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa858074cb0 0x7fa858077170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa86c057000 tx=0x7fa86c051000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87a600640 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x560d40d1b7a0 0x560d40dc6b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87a600640 1 -- 172.21.15.100:0/875906298 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv3 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7fa86400b680 con 0x560d40d1b7a0 2024-05-09T05:05:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x560d40d1b7a0 msgr2=0x560d40dc6b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x560d40d1b7a0 0x560d40dc6b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa858074cb0 msgr2=0x7fa858077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.717+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa858074cb0 0x7fa858077170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa86c057000 tx=0x7fa86c051000 comp rx=0 tx=0).stop 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 msgr2=0x560d40dc6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87dd33f40 1 --2- 172.21.15.100:0/875906298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d40dc4190 0x560d40dc6120 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa874014040 tx=0x7fa8740033a0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87ba00640 1 -- 172.21.15.100:0/875906298 reap_dead start 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 shutdown_connections 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 >> 172.21.15.100:0/875906298 conn(0x560d40d36e20 msgr2=0x560d40dbca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 shutdown_connections 2024-05-09T05:05:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.718+0000 7fa87dd33f40 1 -- 172.21.15.100:0/875906298 wait complete. 2024-05-09T05:05:38.723 INFO:teuthology.orchestra.run.smithi100.stdout:a��alpha parent_b  2024-05-09T05:05:38.723 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-09T05:05:38.825 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 1099511628283, 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "ancestors": [ 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1099511628284, 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "alpha", 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 9 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1, 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "parent_b", 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 32 2024-05-09T05:05:38.826 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout: "pool": 6, 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout: "old_pools": [ 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout: 5 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:38.827 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:38.833 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 parent 2024-05-09T05:05:38.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.930+0000 7ff0f3b21f40 1 Processor -- start 2024-05-09T05:05:38.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.930+0000 7ff0f3b21f40 1 -- start start 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f3b21f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e12fd960 0x55b2e1344720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f3b21f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e1330a90 0x55b2e13d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f3b21f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f3b21f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b2e13478c0 con 0x55b2e13d5190 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f3b21f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b2e12a4f50 con 0x55b2e12fd960 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f3b21f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55b2e1345d80 con 0x55b2e1330a90 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38546/0 (socket says 172.21.15.100:38546) 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.931+0000 7ff0f0c00640 1 -- 172.21.15.100:0/737667199 learned_addr learned my addr 172.21.15.100:0/737667199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0c00640 1 -- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e1330a90 msgr2=0x55b2e13d60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0ef800640 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e1330a90 0x55b2e13d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0c00640 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e1330a90 0x55b2e13d60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0c00640 1 -- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e12fd960 msgr2=0x55b2e1344720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0200640 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e12fd960 0x55b2e1344720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0c00640 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e12fd960 0x55b2e1344720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0c00640 1 -- 172.21.15.100:0/737667199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e1227b30 con 0x55b2e13d5190 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0ef800640 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e1330a90 0x55b2e13d60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0f0c00640 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13cddf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8045fe0 tx=0x7ff0e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4d94f50ba8ca4e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0ee400640 1 -- 172.21.15.100:0/737667199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8056070 con 0x55b2e13d5190 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0ee400640 1 -- 172.21.15.100:0/737667199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e80528c0 con 0x55b2e13d5190 2024-05-09T05:05:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.932+0000 7ff0ee400640 1 -- 172.21.15.100:0/737667199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8052cb0 con 0x55b2e13d5190 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/737667199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 msgr2=0x55b2e13cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13cddf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8045fe0 tx=0x7ff0e8051000 comp rx=0 tx=0).stop 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/737667199 shutdown_connections 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13cddf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e1330a90 0x55b2e13d60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/737667199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e12fd960 0x55b2e1344720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/737667199 >> 172.21.15.100:0/737667199 conn(0x55b2e1347e20 msgr2=0x55b2e13d55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/737667199 shutdown_connections 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.933+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/737667199 wait complete. 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.934+0000 7ff0f3b21f40 1 Processor -- start 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.934+0000 7ff0f3b21f40 1 -- start start 2024-05-09T05:05:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f3b21f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e12fd960 0x55b2e132bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f3b21f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e1330a90 0x55b2e1340110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f3b21f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f3b21f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b2e13ce900 con 0x55b2e13d5190 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f3b21f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55b2e1344c60 con 0x55b2e1330a90 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f3b21f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55b2e13ceb50 con 0x55b2e12fd960 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13436d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38560/0 (socket says 172.21.15.100:38560) 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 -- 172.21.15.100:0/3903045897 learned_addr learned my addr 172.21.15.100:0/3903045897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 -- 172.21.15.100:0/3903045897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e12fd960 msgr2=0x55b2e132bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55b2e12fd960 0x55b2e132bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 -- 172.21.15.100:0/3903045897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e1330a90 msgr2=0x55b2e1340110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b2e1330a90 0x55b2e1340110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.935+0000 7ff0f0c00640 1 -- 172.21.15.100:0/3903045897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e13ca580 con 0x55b2e13d5190 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.936+0000 7ff0f0c00640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13436d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55b2e12fb480 tx=0x7ff0e8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.936+0000 7ff0ed000640 1 -- 172.21.15.100:0/3903045897 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8056040 con 0x55b2e13d5190 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.936+0000 7ff0ed000640 1 -- 172.21.15.100:0/3903045897 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e8065440 con 0x55b2e13d5190 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.936+0000 7ff0ed000640 1 -- 172.21.15.100:0/3903045897 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8065630 con 0x55b2e13d5190 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.936+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e1349f40 con 0x55b2e13d5190 2024-05-09T05:05:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.936+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e13cae20 con 0x55b2e13d5190 2024-05-09T05:05:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.938+0000 7ff0ed000640 1 -- 172.21.15.100:0/3903045897 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff0e8059020 con 0x55b2e13d5190 2024-05-09T05:05:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.939+0000 7ff0ed000640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff0d0074cb0 0x7ff0d0077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.939+0000 7ff0ed000640 1 -- 172.21.15.100:0/3903045897 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7ff0e80dafb0 con 0x55b2e13d5190 2024-05-09T05:05:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.939+0000 7ff0f0200640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff0d0074cb0 0x7ff0d0077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.940+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55b2e132c2e0 0x55b2e146ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.940+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55b2e132b1a0 con 0x55b2e132c2e0 2024-05-09T05:05:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.940+0000 7ff0ef800640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55b2e132c2e0 0x55b2e146ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.940+0000 7ff0f0200640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff0d0074cb0 0x7ff0d0077170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005380 tx=0x7ff0e0005310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.940+0000 7ff0ef800640 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55b2e132c2e0 0x55b2e146ea00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0ef800640 1 -- 172.21.15.100:0/3903045897 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv1 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7ff0dc00e440 con 0x55b2e132c2e0 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55b2e132c2e0 msgr2=0x55b2e146ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55b2e132c2e0 0x55b2e146ea00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff0d0074cb0 msgr2=0x7ff0d0077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff0d0074cb0 0x7ff0d0077170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0005380 tx=0x7ff0e0005310 comp rx=0 tx=0).stop 2024-05-09T05:05:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 msgr2=0x55b2e13436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 --2- 172.21.15.100:0/3903045897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2e13d5190 0x55b2e13436d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x55b2e12fb480 tx=0x7ff0e8003330 comp rx=0 tx=0).stop 2024-05-09T05:05:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f0c00640 1 -- 172.21.15.100:0/3903045897 reap_dead start 2024-05-09T05:05:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 shutdown_connections 2024-05-09T05:05:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 >> 172.21.15.100:0/3903045897 conn(0x55b2e1347e20 msgr2=0x55b2e13d55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 shutdown_connections 2024-05-09T05:05:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:38.941+0000 7ff0f3b21f40 1 -- 172.21.15.100:0/3903045897 wait complete. 2024-05-09T05:05:38.946 INFO:teuthology.orchestra.run.smithi100.stdout:a��alpha parent_b  2024-05-09T05:05:38.947 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-09T05:05:39.033 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:39.033 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 1099511628283, 2024-05-09T05:05:39.033 INFO:teuthology.orchestra.run.smithi100.stdout: "ancestors": [ 2024-05-09T05:05:39.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:39.033 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1099511628284, 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "alpha", 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 9 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1, 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "parent_b", 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 32 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "pool": 6, 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: "old_pools": [ 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: 5 2024-05-09T05:05:39.034 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:05:39.035 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:39.035 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:39.038 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 layout 2024-05-09T05:05:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.180+0000 7fdf38b1bf40 1 Processor -- start 2024-05-09T05:05:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.180+0000 7fdf38b1bf40 1 -- start start 2024-05-09T05:05:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf38b1bf40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 0x55e90dfd49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf38b1bf40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90df2c510 0x55e90dfd55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf38b1bf40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df48920 0x55e90dfd2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf38b1bf40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e90df47e40 con 0x55e90deffa30 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf38b1bf40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e90dea4f50 con 0x55e90df48920 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf38b1bf40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55e90df48120 con 0x55e90df2c510 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf35200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 0x55e90dfd49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf35200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 0x55e90dfd49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38578/0 (socket says 172.21.15.100:38578) 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.181+0000 7fdf35200640 1 -- 172.21.15.100:0/2495484085 learned_addr learned my addr 172.21.15.100:0/2495484085 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf35200640 1 -- 172.21.15.100:0/2495484085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90df2c510 msgr2=0x55e90dfd55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf35200640 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90df2c510 0x55e90dfd55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf35200640 1 -- 172.21.15.100:0/2495484085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df48920 msgr2=0x55e90dfd2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf35200640 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df48920 0x55e90dfd2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf35200640 1 -- 172.21.15.100:0/2495484085 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90de27b30 con 0x55e90deffa30 2024-05-09T05:05:39.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf35200640 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 0x55e90dfd49e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdf28046000 tx=0x7fdf28051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e80cba7197789c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf33400640 1 -- 172.21.15.100:0/2495484085 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28056070 con 0x55e90deffa30 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf33400640 1 -- 172.21.15.100:0/2495484085 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf28052890 con 0x55e90deffa30 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.182+0000 7fdf33400640 1 -- 172.21.15.100:0/2495484085 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28052c80 con 0x55e90deffa30 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/2495484085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 msgr2=0x55e90dfd49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 0x55e90dfd49e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdf28046000 tx=0x7fdf28051000 comp rx=0 tx=0).stop 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/2495484085 shutdown_connections 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df48920 0x55e90dfd2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90df2c510 0x55e90dfd55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/2495484085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90deffa30 0x55e90dfd49e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/2495484085 >> 172.21.15.100:0/2495484085 conn(0x55e90defb600 msgr2=0x55e90df2c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/2495484085 shutdown_connections 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.183+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/2495484085 wait complete. 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.184+0000 7fdf38b1bf40 1 Processor -- start 2024-05-09T05:05:39.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.184+0000 7fdf38b1bf40 1 -- start start 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf38b1bf40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90deffa30 0x55e90dfd5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf38b1bf40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df2c510 0x55e90dfc6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf38b1bf40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90df48920 0x55e90dfce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf38b1bf40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e90df2d300 con 0x55e90df48920 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf38b1bf40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e90dfd4f20 con 0x55e90df2c510 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf38b1bf40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55e90dfd1db0 con 0x55e90deffa30 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf35c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90df48920 0x55e90dfce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf35c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90df48920 0x55e90dfce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38590/0 (socket says 172.21.15.100:38590) 2024-05-09T05:05:39.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.185+0000 7fdf35c00640 1 -- 172.21.15.100:0/3366807780 learned_addr learned my addr 172.21.15.100:0/3366807780 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35200640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90deffa30 0x55e90dfd5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf34800640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df2c510 0x55e90dfc6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35c00640 1 -- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90deffa30 msgr2=0x55e90dfd5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35c00640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90deffa30 0x55e90dfd5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35c00640 1 -- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df2c510 msgr2=0x55e90dfc6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35c00640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e90df2c510 0x55e90dfc6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35c00640 1 -- 172.21.15.100:0/3366807780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e90defd800 con 0x55e90df48920 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35200640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e90deffa30 0x55e90dfd5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:39.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf35c00640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90df48920 0x55e90dfce4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00bb70 tx=0x7fdf2c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf32000640 1 -- 172.21.15.100:0/3366807780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c012070 con 0x55e90df48920 2024-05-09T05:05:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf32000640 1 -- 172.21.15.100:0/3366807780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c00e670 con 0x55e90df48920 2024-05-09T05:05:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf32000640 1 -- 172.21.15.100:0/3366807780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00ea40 con 0x55e90df48920 2024-05-09T05:05:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e90dfd21e0 con 0x55e90df48920 2024-05-09T05:05:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.186+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e90defd240 con 0x55e90df48920 2024-05-09T05:05:39.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.189+0000 7fdf32000640 1 -- 172.21.15.100:0/3366807780 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf2c015070 con 0x55e90df48920 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.189+0000 7fdf32000640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf14074cb0 0x7fdf14077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.190+0000 7fdf32000640 1 -- 172.21.15.100:0/3366807780 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7fdf2c096380 con 0x55e90df48920 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.190+0000 7fdf35200640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf14074cb0 0x7fdf14077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.190+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e90e06b8c0 0x55e90e06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.190+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e90e06c200 con 0x55e90e06b8c0 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.190+0000 7fdf34800640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e90e06b8c0 0x55e90e06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf35200640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf14074cb0 0x7fdf14077170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf28046000 tx=0x7fdf28052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf34800640 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e90e06b8c0 0x55e90e06bcc0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf34800640 1 -- 172.21.15.100:0/3366807780 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv1 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7fdf200096f0 con 0x55e90e06b8c0 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e90e06b8c0 msgr2=0x55e90e06bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e90e06b8c0 0x55e90e06bcc0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf14074cb0 msgr2=0x7fdf14077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf14074cb0 0x7fdf14077170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf28046000 tx=0x7fdf28052000 comp rx=0 tx=0).stop 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90df48920 msgr2=0x55e90dfce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf38b1bf40 1 --2- 172.21.15.100:0/3366807780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e90df48920 0x55e90dfce4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00bb70 tx=0x7fdf2c009640 comp rx=0 tx=0).stop 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.191+0000 7fdf35c00640 1 -- 172.21.15.100:0/3366807780 reap_dead start 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.192+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 shutdown_connections 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.192+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 >> 172.21.15.100:0/3366807780 conn(0x55e90defb600 msgr2=0x55e90df2c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.192+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 shutdown_connections 2024-05-09T05:05:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.192+0000 7fdf38b1bf40 1 -- 172.21.15.100:0/3366807780 wait complete. 2024-05-09T05:05:39.196 INFO:teuthology.orchestra.run.smithi100.stdout:@@ 2024-05-09T05:05:39.197 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type file_layout_t import - decode dump_json 2024-05-09T05:05:39.292 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:39.292 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_unit": 4194304, 2024-05-09T05:05:39.292 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_count": 1, 2024-05-09T05:05:39.292 INFO:teuthology.orchestra.run.smithi100.stdout: "object_size": 4194304, 2024-05-09T05:05:39.293 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_id": 6, 2024-05-09T05:05:39.293 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ns": "" 2024-05-09T05:05:39.293 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:39.293 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:39.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:39.298 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_c) 2024-05-09T05:05:39.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:39.351 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mv parent_b/alpha parent_c/alpha) 2024-05-09T05:05:39.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:39.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.607+0000 7f1921e00640 1 Processor -- start 2024-05-09T05:05:39.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.607+0000 7f1921e00640 1 -- start start 2024-05-09T05:05:39.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.608+0000 7f1921e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f191c161730 0x7f191c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.608+0000 7f1921e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f191c0ce160 0x7f191c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.608+0000 7f1921e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c0ce580 con 0x7f191c143710 2024-05-09T05:05:39.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.608+0000 7f1921e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f191c160ce0 con 0x7f191c161730 2024-05-09T05:05:39.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.608+0000 7f1921e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f191c143af0 con 0x7f191c0ce160 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f1920a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f191c143710 0x7f191c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34028/0 (socket says 172.21.15.100:34028) 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f1920a00640 1 -- 172.21.15.100:0/2805426179 learned_addr learned my addr 172.21.15.100:0/2805426179 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f191be00640 1 --2- 172.21.15.100:0/2805426179 >> v2:172.21.15.100:3300/0 conn(0x7f191c161730 0x7f191c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f1921400640 1 --2- 172.21.15.100:0/2805426179 >> v2:172.21.15.133:3300/0 conn(0x7f191c0ce160 0x7f191c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f191be00640 1 -- 172.21.15.100:0/2805426179 >> v2:172.21.15.133:3300/0 conn(0x7f191c0ce160 msgr2=0x7f191c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f191be00640 1 --2- 172.21.15.100:0/2805426179 >> v2:172.21.15.133:3300/0 conn(0x7f191c0ce160 0x7f191c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f191be00640 1 -- 172.21.15.100:0/2805426179 >> v1:172.21.15.100:6789/0 conn(0x7f191c143710 legacy=0x7f191c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.609+0000 7f191be00640 1 -- 172.21.15.100:0/2805426179 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c15e240 con 0x7f191c161730 2024-05-09T05:05:39.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.610+0000 7f191be00640 1 --2- 172.21.15.100:0/2805426179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c161730 0x7f191c0cdc20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f191c0d06a0 tx=0x7f190402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedec0e2c91b4f4e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.610+0000 7f191b400640 1 -- 172.21.15.100:0/2805426179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904037070 con 0x7f191c161730 2024-05-09T05:05:39.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.610+0000 7f191b400640 1 -- 172.21.15.100:0/2805426179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1904032440 con 0x7f191c161730 2024-05-09T05:05:39.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.610+0000 7f191b400640 1 -- 172.21.15.100:0/2805426179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190402ae60 con 0x7f191c161730 2024-05-09T05:05:39.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 -- 172.21.15.100:0/2805426179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c161730 msgr2=0x7f191c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 --2- 172.21.15.100:0/2805426179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c161730 0x7f191c0cdc20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f191c0d06a0 tx=0x7f190402a110 comp rx=0 tx=0).stop 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 -- 172.21.15.100:0/2805426179 shutdown_connections 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 --2- 172.21.15.100:0/2805426179 >> v2:172.21.15.133:3300/0 conn(0x7f191c0ce160 0x7f191c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 --2- 172.21.15.100:0/2805426179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c161730 0x7f191c0cdc20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 -- 172.21.15.100:0/2805426179 >> 172.21.15.100:0/2805426179 conn(0x7f191c06c7f0 msgr2=0x7f191c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 -- 172.21.15.100:0/2805426179 shutdown_connections 2024-05-09T05:05:39.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.611+0000 7f1921e00640 1 -- 172.21.15.100:0/2805426179 wait complete. 2024-05-09T05:05:39.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.614+0000 7f1921e00640 1 Processor -- start 2024-05-09T05:05:39.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.614+0000 7f1921e00640 1 -- start start 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1921e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 0x7f191c13dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1921e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f191c143710 0x7f191c1e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1921e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f191c161730 0x7f191c146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1921e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f191c161210 con 0x7f191c0ce160 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1921e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f191c160f30 con 0x7f191c161730 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1921e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f191c072490 con 0x7f191c143710 2024-05-09T05:05:39.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1920a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 0x7f191c13dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1920a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 0x7f191c13dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38594/0 (socket says 172.21.15.100:38594) 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.615+0000 7f1920a00640 1 -- 172.21.15.100:0/1263662497 learned_addr learned my addr 172.21.15.100:0/1263662497 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f191be00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f191c143710 0x7f191c1e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1920a00640 1 -- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f191c143710 msgr2=0x7f191c1e7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1921400640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f191c161730 0x7f191c146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1920a00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f191c143710 0x7f191c1e7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1920a00640 1 -- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f191c161730 msgr2=0x7f191c146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1920a00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f191c161730 0x7f191c146640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1920a00640 1 -- 172.21.15.100:0/1263662497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c13ec00 con 0x7f191c0ce160 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1920a00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 0x7f191c13dd60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c4d0 tx=0x7f190c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c017070 con 0x7f191c0ce160 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c005d00 con 0x7f191c0ce160 2024-05-09T05:05:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.616+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c0072b0 con 0x7f191c0ce160 2024-05-09T05:05:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.617+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c13e360 con 0x7f191c0ce160 2024-05-09T05:05:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.617+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c144c30 con 0x7f191c0ce160 2024-05-09T05:05:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.618+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c161bc0 con 0x7f191c0ce160 2024-05-09T05:05:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.619+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f190c01a070 con 0x7f191c0ce160 2024-05-09T05:05:39.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.620+0000 7f1918c00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18f80762d0 0x7f18f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.620+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f190c096b90 con 0x7f191c0ce160 2024-05-09T05:05:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.620+0000 7f191be00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18f80762d0 0x7f18f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.621+0000 7f191be00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18f80762d0 0x7f18f8078790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1904034000 tx=0x7f190402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:39.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.625+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f191c161bc0 con 0x7f191c0ce160 2024-05-09T05:05:39.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.869+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f191c06a550 con 0x7f191c0ce160 2024-05-09T05:05:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.876+0000 7f1918c00640 1 -- 172.21.15.100:0/1263662497 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7f190c0602c0 con 0x7f191c0ce160 2024-05-09T05:05:39.877 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:39.877 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:39.877 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.878+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18f80762d0 msgr2=0x7f18f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18f80762d0 0x7f18f8078790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1904034000 tx=0x7f190402e000 comp rx=0 tx=0).stop 2024-05-09T05:05:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 msgr2=0x7f191c13dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 0x7f191c13dd60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c4d0 tx=0x7f190c00c990 comp rx=0 tx=0).stop 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 shutdown_connections 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18f80762d0 0x7f18f8078790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f191c161730 0x7f191c146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f191c143710 0x7f191c1e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 --2- 172.21.15.100:0/1263662497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191c0ce160 0x7f191c13dd60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 >> 172.21.15.100:0/1263662497 conn(0x7f191c06c7f0 msgr2=0x7f191c15f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 shutdown_connections 2024-05-09T05:05:39.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:39.879+0000 7f1921e00640 1 -- 172.21.15.100:0/1263662497 wait complete. 2024-05-09T05:05:39.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:40.132 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:40.133 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:40.133 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 parent 2024-05-09T05:05:40.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.231+0000 7f763ace9f40 1 Processor -- start 2024-05-09T05:05:40.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.231+0000 7f763ace9f40 1 -- start start 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.232+0000 7f763ace9f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f529240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.232+0000 7f763ace9f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f48ba90 0x55ca3f532d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.232+0000 7f763ace9f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f5308a0 0x55ca3f5311e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.232+0000 7f763ace9f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ca3f3fff50 con 0x55ca3f458960 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.232+0000 7f763ace9f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ca3f403f90 con 0x55ca3f48ba90 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.232+0000 7f763ace9f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55ca3f4a28c0 con 0x55ca3f5308a0 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f529240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f529240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38612/0 (socket says 172.21.15.100:38612) 2024-05-09T05:05:40.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 -- 172.21.15.100:0/1479100387 learned_addr learned my addr 172.21.15.100:0/1479100387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 -- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f5308a0 msgr2=0x55ca3f5311e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f5308a0 0x55ca3f5311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 -- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f48ba90 msgr2=0x55ca3f532d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637400640 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f48ba90 0x55ca3f532d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f48ba90 0x55ca3f532d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 -- 172.21.15.100:0/1479100387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3f52a9d0 con 0x55ca3f458960 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.233+0000 7f7637e00640 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f529240 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f762800b290 tx=0x7f762800b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ba57f97ae5823d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f7636000640 1 -- 172.21.15.100:0/1479100387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628008070 con 0x55ca3f458960 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f7636000640 1 -- 172.21.15.100:0/1479100387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762800d500 con 0x55ca3f458960 2024-05-09T05:05:40.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f7636000640 1 -- 172.21.15.100:0/1479100387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762800d8b0 con 0x55ca3f458960 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 -- 172.21.15.100:0/1479100387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 msgr2=0x55ca3f529240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f529240 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f762800b290 tx=0x7f762800b750 comp rx=0 tx=0).stop 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 -- 172.21.15.100:0/1479100387 shutdown_connections 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f5308a0 0x55ca3f5311e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f48ba90 0x55ca3f532d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 --2- 172.21.15.100:0/1479100387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f529240 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 -- 172.21.15.100:0/1479100387 >> 172.21.15.100:0/1479100387 conn(0x55ca3f4a2e20 msgr2=0x55ca3f486c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 -- 172.21.15.100:0/1479100387 shutdown_connections 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.234+0000 7f763ace9f40 1 -- 172.21.15.100:0/1479100387 wait complete. 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.235+0000 7f763ace9f40 1 Processor -- start 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.235+0000 7f763ace9f40 1 -- start start 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.236+0000 7f763ace9f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f516bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.236+0000 7f763ace9f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f48ba90 0x55ca3f529240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.236+0000 7f763ace9f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f5308a0 0x55ca3f529780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.236+0000 7f763ace9f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ca3f4873a0 con 0x55ca3f458960 2024-05-09T05:05:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.236+0000 7f763ace9f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55ca3f4875f0 con 0x55ca3f5308a0 2024-05-09T05:05:40.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.236+0000 7f763ace9f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55ca3f458f50 con 0x55ca3f48ba90 2024-05-09T05:05:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f516bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f516bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38620/0 (socket says 172.21.15.100:38620) 2024-05-09T05:05:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 -- 172.21.15.100:0/4234249129 learned_addr learned my addr 172.21.15.100:0/4234249129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637400640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f48ba90 0x55ca3f529240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 -- 172.21.15.100:0/4234249129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f48ba90 msgr2=0x55ca3f529240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ca3f48ba90 0x55ca3f529240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 -- 172.21.15.100:0/4234249129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f5308a0 msgr2=0x55ca3f529780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ca3f5308a0 0x55ca3f529780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.237+0000 7f7637e00640 1 -- 172.21.15.100:0/4234249129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3f5170f0 con 0x55ca3f458960 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.238+0000 7f7637e00640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f516bb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f762800b790 tx=0x7f7628000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.238+0000 7f7634c00640 1 -- 172.21.15.100:0/4234249129 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628021030 con 0x55ca3f458960 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.238+0000 7f7634c00640 1 -- 172.21.15.100:0/4234249129 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76280012f0 con 0x55ca3f458960 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.238+0000 7f7634c00640 1 -- 172.21.15.100:0/4234249129 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762801c650 con 0x55ca3f458960 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.238+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca3f528d80 con 0x55ca3f458960 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.238+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3f52d2d0 con 0x55ca3f458960 2024-05-09T05:05:40.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.240+0000 7f7634c00640 1 -- 172.21.15.100:0/4234249129 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7628024070 con 0x55ca3f458960 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.241+0000 7f7634c00640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7618074cb0 0x7f7618077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.241+0000 7f7634c00640 1 -- 172.21.15.100:0/4234249129 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f7628097740 con 0x55ca3f458960 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.242+0000 7f7637400640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7618074cb0 0x7f7618077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.242+0000 7f763ace9f40 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55ca3f5316f0 0x55ca3f52e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.242+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca3f52eae0 con 0x55ca3f5316f0 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.242+0000 7f7638800640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55ca3f5316f0 0x55ca3f52e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.242+0000 7f7637400640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7618074cb0 0x7f7618077170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7624057000 tx=0x7f7624052000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f7638800640 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55ca3f5316f0 0x55ca3f52e5a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f7638800640 1 -- 172.21.15.100:0/4234249129 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv3 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7f763000a3b0 con 0x55ca3f5316f0 2024-05-09T05:05:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55ca3f5316f0 msgr2=0x55ca3f52e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55ca3f5316f0 0x55ca3f52e5a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7618074cb0 msgr2=0x7f7618077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f7618074cb0 0x7f7618077170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7624057000 tx=0x7f7624052000 comp rx=0 tx=0).stop 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 msgr2=0x55ca3f516bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 --2- 172.21.15.100:0/4234249129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca3f458960 0x55ca3f516bb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f762800b790 tx=0x7f7628000ed0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f7638800640 1 -- 172.21.15.100:0/4234249129 reap_dead start 2024-05-09T05:05:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 shutdown_connections 2024-05-09T05:05:40.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 >> 172.21.15.100:0/4234249129 conn(0x55ca3f4a2e20 msgr2=0x55ca3f486c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:40.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.243+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 shutdown_connections 2024-05-09T05:05:40.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.244+0000 7f763ace9f40 1 -- 172.21.15.100:0/4234249129 wait complete. 2024-05-09T05:05:40.249 INFO:teuthology.orchestra.run.smithi100.stdout:a��alpha parent_b  2024-05-09T05:05:40.249 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-09T05:05:40.348 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 1099511628283, 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "ancestors": [ 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1099511628284, 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "alpha", 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 9 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1, 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "parent_b", 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 32 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:40.349 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-05-09T05:05:40.350 INFO:teuthology.orchestra.run.smithi100.stdout: "pool": 6, 2024-05-09T05:05:40.350 INFO:teuthology.orchestra.run.smithi100.stdout: "old_pools": [ 2024-05-09T05:05:40.350 INFO:teuthology.orchestra.run.smithi100.stdout: 5 2024-05-09T05:05:40.350 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:05:40.350 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:40.350 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:40.354 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 parent 2024-05-09T05:05:40.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.461+0000 7f2c75472f40 1 Processor -- start 2024-05-09T05:05:40.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.461+0000 7f2c75472f40 1 -- start start 2024-05-09T05:05:40.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c75472f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230c85960 0x55e230cb2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c75472f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230cb8a90 0x55e230d55f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c75472f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230deb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c75472f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e230ccf8c0 con 0x55e230d5d8a0 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c75472f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e230c2cf50 con 0x55e230c85960 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c75472f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55e230ccdd80 con 0x55e230cb8a90 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c73000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230deb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c73000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230deb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38628/0 (socket says 172.21.15.100:38628) 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.462+0000 7f2c73000640 1 -- 172.21.15.100:0/2372539537 learned_addr learned my addr 172.21.15.100:0/2372539537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c72600640 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230c85960 0x55e230cb2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c71c00640 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230cb8a90 0x55e230d55f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c73000640 1 -- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230cb8a90 msgr2=0x55e230d55f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c73000640 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230cb8a90 0x55e230d55f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c73000640 1 -- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230c85960 msgr2=0x55e230cb2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c73000640 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230c85960 0x55e230cb2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c73000640 1 -- 172.21.15.100:0/2372539537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e230bafb30 con 0x55e230d5d8a0 2024-05-09T05:05:40.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.463+0000 7f2c73000640 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230deb840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0259f0 tx=0x7f2c6c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3bdbdbcad18d65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c6be00640 1 -- 172.21.15.100:0/2372539537 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c055030 con 0x55e230d5d8a0 2024-05-09T05:05:40.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c6be00640 1 -- 172.21.15.100:0/2372539537 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c051ba0 con 0x55e230d5d8a0 2024-05-09T05:05:40.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c6be00640 1 -- 172.21.15.100:0/2372539537 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c05b430 con 0x55e230d5d8a0 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 -- 172.21.15.100:0/2372539537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 msgr2=0x55e230deb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230deb840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0259f0 tx=0x7f2c6c050000 comp rx=0 tx=0).stop 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 -- 172.21.15.100:0/2372539537 shutdown_connections 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230deb840 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230cb8a90 0x55e230d55f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 --2- 172.21.15.100:0/2372539537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230c85960 0x55e230cb2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 -- 172.21.15.100:0/2372539537 >> 172.21.15.100:0/2372539537 conn(0x55e230ccfe20 msgr2=0x55e230d5ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:40.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 -- 172.21.15.100:0/2372539537 shutdown_connections 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.464+0000 7f2c75472f40 1 -- 172.21.15.100:0/2372539537 wait complete. 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.465+0000 7f2c75472f40 1 Processor -- start 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.465+0000 7f2c75472f40 1 -- start start 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c75472f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230c85960 0x55e230d5e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c75472f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230cb8a90 0x55e230d49b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c75472f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230d54420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c75472f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e230ccf130 con 0x55e230d5d8a0 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c75472f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55e230cceee0 con 0x55e230cb8a90 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c75472f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55e230d57080 con 0x55e230c85960 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c73000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230d54420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c73000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230d54420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38638/0 (socket says 172.21.15.100:38638) 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.466+0000 7f2c73000640 1 -- 172.21.15.100:0/1544656501 learned_addr learned my addr 172.21.15.100:0/1544656501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:40.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c73000640 1 -- 172.21.15.100:0/1544656501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230c85960 msgr2=0x55e230d5e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c72600640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230c85960 0x55e230d5e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c71c00640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230cb8a90 0x55e230d49b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c73000640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55e230c85960 0x55e230d5e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c73000640 1 -- 172.21.15.100:0/1544656501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230cb8a90 msgr2=0x55e230d49b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c73000640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e230cb8a90 0x55e230d49b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c73000640 1 -- 172.21.15.100:0/1544656501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e230cb3f30 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c73000640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230d54420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c051560 tx=0x7f2c6c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c6aa00640 1 -- 172.21.15.100:0/1544656501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0519a0 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.467+0000 7f2c6aa00640 1 -- 172.21.15.100:0/1544656501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6c051d50 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.468+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e230d55420 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.468+0000 7f2c6aa00640 1 -- 172.21.15.100:0/1544656501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c067bc0 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.468+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e230dedf40 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.470+0000 7f2c6aa00640 1 -- 172.21.15.100:0/1544656501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c6c058020 con 0x55e230d5d8a0 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.471+0000 7f2c6aa00640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2c50074cb0 0x7f2c50077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.471+0000 7f2c6aa00640 1 -- 172.21.15.100:0/1544656501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f2c6c0db6b0 con 0x55e230d5d8a0 2024-05-09T05:05:40.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.471+0000 7f2c72600640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2c50074cb0 0x7f2c50077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.471+0000 7f2c75472f40 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e230ccb670 0x55e230ccbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.471+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e230ccbfe0 con 0x55e230ccb670 2024-05-09T05:05:40.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.472+0000 7f2c71c00640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e230ccb670 0x55e230ccbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.472+0000 7f2c72600640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2c50074cb0 0x7f2c50077170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e380 tx=0x7f2c64003530 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.472+0000 7f2c71c00640 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e230ccb670 0x55e230ccbaa0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c71c00640 1 -- 172.21.15.100:0/1544656501 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (103) out=103b] v0'0 uv2 ondisk = 0) ==== 164+0+103 (crc 0 0 0) 0x7f2c5c009690 con 0x55e230ccb670 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e230ccb670 msgr2=0x55e230ccbaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55e230ccb670 0x55e230ccbaa0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2c50074cb0 msgr2=0x7f2c50077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2c50074cb0 0x7f2c50077170 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400e380 tx=0x7f2c64003530 comp rx=0 tx=0).stop 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 msgr2=0x55e230d54420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 --2- 172.21.15.100:0/1544656501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e230d5d8a0 0x55e230d54420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c051560 tx=0x7f2c6c003330 comp rx=0 tx=0).stop 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c73000640 1 -- 172.21.15.100:0/1544656501 reap_dead start 2024-05-09T05:05:40.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 shutdown_connections 2024-05-09T05:05:40.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 >> 172.21.15.100:0/1544656501 conn(0x55e230ccfe20 msgr2=0x55e230d5ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:40.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 shutdown_connections 2024-05-09T05:05:40.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.473+0000 7f2c75472f40 1 -- 172.21.15.100:0/1544656501 wait complete. 2024-05-09T05:05:40.476 INFO:teuthology.orchestra.run.smithi100.stdout:a��alpha 2024-05-09T05:05:40.478 INFO:teuthology.orchestra.run.smithi100.stdout:parent_c' 2024-05-09T05:05:40.478 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-05-09T05:05:40.576 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:40.576 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 1099511628283, 2024-05-09T05:05:40.576 INFO:teuthology.orchestra.run.smithi100.stdout: "ancestors": [ 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1099511628285, 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "alpha", 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 10 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dirino": 1, 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dname": "parent_c", 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "version": 39 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "pool": 6, 2024-05-09T05:05:40.577 INFO:teuthology.orchestra.run.smithi100.stdout: "old_pools": [ 2024-05-09T05:05:40.578 INFO:teuthology.orchestra.run.smithi100.stdout: 5 2024-05-09T05:05:40.578 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:05:40.578 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:40.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:40.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:40.582 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.object_size -v 8388608 ./parent_c/alpha) 2024-05-09T05:05:40.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:40.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.841+0000 7f52ff200640 1 Processor -- start 2024-05-09T05:05:40.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.841+0000 7f52ff200640 1 -- start start 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52ff200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 0x7f53000d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52ff200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53000d1a10 0x7f53000d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52ff200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53000d2f80 con 0x7f53000b4530 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52ff200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f53000d3fe0 con 0x7f53000d1a10 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52ff200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f53000d23a0 con 0x7f53000d3660 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52fde00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f53000b4530 0x7f53000b5c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34044/0 (socket says 172.21.15.100:34044) 2024-05-09T05:05:40.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.843+0000 7f52fde00640 1 -- 172.21.15.100:0/1873211622 learned_addr learned my addr 172.21.15.100:0/1873211622 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:40.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fd400640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 0x7f53000d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fe800640 1 --2- 172.21.15.100:0/1873211622 >> v2:172.21.15.133:3300/0 conn(0x7f53000d1a10 0x7f53000d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831870705 0 0) 0x7f53000d2f80 con 0x7f53000b4530 2024-05-09T05:05:40.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e4003520 con 0x7f53000b4530 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1657005007 0 0) 0x7f52e4003520 con 0x7f53000b4530 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 msgr2=0x7f53000d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 0x7f53000d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 >> v2:172.21.15.133:3300/0 conn(0x7f53000d1a10 msgr2=0x7f53000d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 --2- 172.21.15.100:0/1873211622 >> v2:172.21.15.133:3300/0 conn(0x7f53000d1a10 0x7f53000d1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53000b51e0 con 0x7f53000b4530 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f52f00016f0 con 0x7f53000b4530 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 >> v1:172.21.15.100:6789/0 conn(0x7f53000b4530 legacy=0x7f53000b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f52e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52e4004800 0x7f52e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 0x7f52e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53000d3fe0 con 0x7f52e4003a50 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f53000d23a0 con 0x7f52e4004800 2024-05-09T05:05:40.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.844+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f52e400ba10 con 0x7f53000d3660 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fde00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f52e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fd400640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52e4004800 0x7f52e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fe800640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 0x7f52e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fde00640 1 -- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 msgr2=0x7f52e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fde00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53000d3660 0x7f52e40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fde00640 1 -- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52e4004800 msgr2=0x7f52e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fde00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52e4004800 0x7f52e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.845+0000 7f52fde00640 1 -- 172.21.15.100:0/1873211622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e4003520 con 0x7f52e4003a50 2024-05-09T05:05:40.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.846+0000 7f52fde00640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f52e4003e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c1c0 tx=0x7f52e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e209b890d0450543 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.847+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0007cc0 con 0x7f52e4003a50 2024-05-09T05:05:40.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.847+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f0005ad0 con 0x7f52e4003a50 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.847+0000 7f52fca00640 1 -- 172.21.15.100:0/1873211622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0007070 con 0x7f52e4003a50 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.847+0000 7f52ff200640 1 -- 172.21.15.100:0/1873211622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 msgr2=0x7f52e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.847+0000 7f52ff200640 1 --2- 172.21.15.100:0/1873211622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f52e4003e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c1c0 tx=0x7f52e4005830 comp rx=0 tx=0).stop 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.847+0000 7f52fe800640 1 -- 172.21.15.100:0/1873211622 reap_dead start 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.848+0000 7f52ff200640 1 -- 172.21.15.100:0/1873211622 shutdown_connections 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.848+0000 7f52ff200640 1 -- 172.21.15.100:0/1873211622 >> 172.21.15.100:0/1873211622 conn(0x7f530008eb30 msgr2=0x7f530009e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.848+0000 7f52ff200640 1 -- 172.21.15.100:0/1873211622 shutdown_connections 2024-05-09T05:05:40.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.848+0000 7f52ff200640 1 -- 172.21.15.100:0/1873211622 wait complete. 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.849+0000 7f52ff200640 1 Processor -- start 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.850+0000 7f52ff200640 1 -- start start 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.850+0000 7f52ff200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f53001571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.850+0000 7f52ff200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53000cec60 0x7f530015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52ff200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f530015dc30 0x7f53000c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52ff200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53000b5730 con 0x7f52e4003a50 2024-05-09T05:05:40.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52ff200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f53000b5450 con 0x7f53000cec60 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52ff200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f53000d28d0 con 0x7f530015dc30 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f53001571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f53001571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38662/0 (socket says 172.21.15.100:38662) 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 -- 172.21.15.100:0/1293464367 learned_addr learned my addr 172.21.15.100:0/1293464367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fe800640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f530015dc30 0x7f53000c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fd400640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53000cec60 0x7f530015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 -- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f530015dc30 msgr2=0x7f53000c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f530015dc30 0x7f53000c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 -- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53000cec60 msgr2=0x7f530015d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53000cec60 0x7f530015d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fde00640 1 -- 172.21.15.100:0/1293464367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53000ccdd0 con 0x7f52e4003a50 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.851+0000 7f52fd400640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53000cec60 0x7f530015d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.852+0000 7f52fde00640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f53001571a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c1c0 tx=0x7f52f0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.852+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f00016b0 con 0x7f52e4003a50 2024-05-09T05:05:40.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.852+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f0042070 con 0x7f52e4003a50 2024-05-09T05:05:40.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.852+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0007290 con 0x7f52e4003a50 2024-05-09T05:05:40.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.852+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53000cd0b0 con 0x7f52e4003a50 2024-05-09T05:05:40.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.852+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53000cd670 con 0x7f52e4003a50 2024-05-09T05:05:40.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.853+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53000cda50 con 0x7f52e4003a50 2024-05-09T05:05:40.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.855+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f52f0007430 con 0x7f52e4003a50 2024-05-09T05:05:40.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.856+0000 7f52f6000640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52dc076300 0x7f52dc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:40.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.856+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f52f00b76f0 con 0x7f52e4003a50 2024-05-09T05:05:40.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.857+0000 7f52fd400640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52dc076300 0x7f52dc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:40.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.857+0000 7f52fd400640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52dc076300 0x7f52dc0787c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5300162cf0 tx=0x7f52e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:40.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:40.862+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f53000cda50 con 0x7f52e4003a50 2024-05-09T05:05:41.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.117+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f530015e040 con 0x7f52e4003a50 2024-05-09T05:05:41.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.118+0000 7f52f6000640 1 -- 172.21.15.100:0/1293464367 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7f530015e040 con 0x7f52e4003a50 2024-05-09T05:05:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:41.119 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:41.119 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52dc076300 msgr2=0x7f52dc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52dc076300 0x7f52dc0787c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5300162cf0 tx=0x7f52e8008040 comp rx=0 tx=0).stop 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 msgr2=0x7f53001571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f53001571a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c1c0 tx=0x7f52f0001930 comp rx=0 tx=0).stop 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 shutdown_connections 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f52dc076300 0x7f52dc0787c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f530015dc30 0x7f53000c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53000cec60 0x7f530015d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 --2- 172.21.15.100:0/1293464367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e4003a50 0x7f53001571a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 >> 172.21.15.100:0/1293464367 conn(0x7f530008eb30 msgr2=0x7f530006e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 shutdown_connections 2024-05-09T05:05:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.121+0000 7f52ff200640 1 -- 172.21.15.100:0/1293464367 wait complete. 2024-05-09T05:05:41.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-05-09T05:05:41.212 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:05:41.220 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:05:41.372 INFO:teuthology.orchestra.run.smithi100.stdout:{"message":"","return_code":0} 2024-05-09T05:05:41.372 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-05-09T05:05:41.372 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool data_new getxattr 100000001fb.00000000 layout 2024-05-09T05:05:41.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.518+0000 7f1cbd11ff40 1 Processor -- start 2024-05-09T05:05:41.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.518+0000 7f1cbd11ff40 1 -- start start 2024-05-09T05:05:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.519+0000 7f1cbd11ff40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c5791a30 0x5588c585e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.519+0000 7f1cbd11ff40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 0x5588c585e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.519+0000 7f1cbd11ff40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57da920 0x5588c585eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.519+0000 7f1cbd11ff40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5588c57d9e40 con 0x5588c57be6e0 2024-05-09T05:05:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.519+0000 7f1cbd11ff40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5588c5736f50 con 0x5588c57da920 2024-05-09T05:05:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.519+0000 7f1cbd11ff40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x5588c57da120 con 0x5588c5791a30 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 0x5588c585e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 0x5588c585e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38686/0 (socket says 172.21.15.100:38686) 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 -- 172.21.15.100:0/1660781180 learned_addr learned my addr 172.21.15.100:0/1660781180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9a00640 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c5791a30 0x5588c585e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cba400640 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57da920 0x5588c585eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 -- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c5791a30 msgr2=0x5588c585e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c5791a30 0x5588c585e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 -- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57da920 msgr2=0x5588c585eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57da920 0x5588c585eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.520+0000 7f1cb9000640 1 -- 172.21.15.100:0/1660781180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c56b9b30 con 0x5588c57be6e0 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.521+0000 7f1cb9000640 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 0x5588c585e560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400a440 tx=0x7f1ca400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf763b86d8d0ad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.521+0000 7f1cb3400640 1 -- 172.21.15.100:0/1660781180 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400c910 con 0x5588c57be6e0 2024-05-09T05:05:41.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.521+0000 7f1cb3400640 1 -- 172.21.15.100:0/1660781180 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ca400cab0 con 0x5588c57be6e0 2024-05-09T05:05:41.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.521+0000 7f1cb3400640 1 -- 172.21.15.100:0/1660781180 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400b430 con 0x5588c57be6e0 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/1660781180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 msgr2=0x5588c585e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 0x5588c585e560 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400a440 tx=0x7f1ca400a900 comp rx=0 tx=0).stop 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/1660781180 shutdown_connections 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57da920 0x5588c585eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c57be6e0 0x5588c585e560 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/1660781180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c5791a30 0x5588c585e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/1660781180 >> 172.21.15.100:0/1660781180 conn(0x5588c578d600 msgr2=0x5588c58675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/1660781180 shutdown_connections 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.522+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/1660781180 wait complete. 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.523+0000 7f1cbd11ff40 1 Processor -- start 2024-05-09T05:05:41.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.523+0000 7f1cbd11ff40 1 -- start start 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cbd11ff40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c5791a30 0x5588c58542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cbd11ff40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57be6e0 0x5588c5858ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cbd11ff40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c57da920 0x5588c5859000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cbd11ff40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5588c585efe0 con 0x5588c5791a30 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cbd11ff40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x5588c58599b0 con 0x5588c57be6e0 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cbd11ff40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x5588c57bca60 con 0x5588c57da920 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c5791a30 0x5588c58542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c5791a30 0x5588c58542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38696/0 (socket says 172.21.15.100:38696) 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 -- 172.21.15.100:0/162597893 learned_addr learned my addr 172.21.15.100:0/162597893 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 -- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c57da920 msgr2=0x5588c5859000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cba400640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c57da920 0x5588c5859000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c57da920 0x5588c5859000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9000640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57be6e0 0x5588c5858ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 -- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57be6e0 msgr2=0x5588c5858ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.524+0000 7f1cb9a00640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588c57be6e0 0x5588c5858ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cb9a00640 1 -- 172.21.15.100:0/162597893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588c5854800 con 0x5588c5791a30 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cba400640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588c57da920 0x5588c5859000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cb9a00640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c5791a30 0x5588c58542c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00a190 tx=0x7f1cac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cb2000640 1 -- 172.21.15.100:0/162597893 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac054040 con 0x5588c5791a30 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cb2000640 1 -- 172.21.15.100:0/162597893 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cac059670 con 0x5588c5791a30 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588c5856ea0 con 0x5588c5791a30 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cb2000640 1 -- 172.21.15.100:0/162597893 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac059a60 con 0x5588c5791a30 2024-05-09T05:05:41.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.525+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588c5855fd0 con 0x5588c5791a30 2024-05-09T05:05:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.528+0000 7f1cb2000640 1 -- 172.21.15.100:0/162597893 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1cac057070 con 0x5588c5791a30 2024-05-09T05:05:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.528+0000 7f1cb2000640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c98074cb0 0x7f1c98077170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.529+0000 7f1cb2000640 1 -- 172.21.15.100:0/162597893 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f1cac0da640 con 0x5588c5791a30 2024-05-09T05:05:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.529+0000 7f1cb9000640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c98074cb0 0x7f1c98077170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.529+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5588c585e6a0 0x5588c5865d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.529+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 6.13 6:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5588c585eb20 con 0x5588c585e6a0 2024-05-09T05:05:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.529+0000 7f1cba400640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5588c585e6a0 0x5588c5865d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cb9000640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c98074cb0 0x7f1c98077170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5588c58f6b10 tx=0x7f1ca4017040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cba400640 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5588c585e6a0 0x5588c5865d80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cba400640 1 -- 172.21.15.100:0/162597893 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f1cb4009670 con 0x5588c585e6a0 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5588c585e6a0 msgr2=0x5588c5865d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x5588c585e6a0 0x5588c5865d80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c98074cb0 msgr2=0x7f1c98077170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c98074cb0 0x7f1c98077170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5588c58f6b10 tx=0x7f1ca4017040 comp rx=0 tx=0).stop 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c5791a30 msgr2=0x5588c58542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cbd11ff40 1 --2- 172.21.15.100:0/162597893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5588c5791a30 0x5588c58542c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00a190 tx=0x7f1cac003330 comp rx=0 tx=0).stop 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.530+0000 7f1cba400640 1 -- 172.21.15.100:0/162597893 reap_dead start 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.531+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 shutdown_connections 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.531+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 >> 172.21.15.100:0/162597893 conn(0x5588c578d600 msgr2=0x5588c57bdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.531+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 shutdown_connections 2024-05-09T05:05:41.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.531+0000 7f1cbd11ff40 1 -- 172.21.15.100:0/162597893 wait complete. 2024-05-09T05:05:41.535 INFO:teuthology.orchestra.run.smithi100.stdout:@� 2024-05-09T05:05:41.536 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type file_layout_t import - decode dump_json 2024-05-09T05:05:41.636 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_unit": 4194304, 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_count": 1, 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout: "object_size": 8388608, 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_id": 6, 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ns": "" 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:41.637 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:41.642 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001fb.00000000 layout 2024-05-09T05:05:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.749+0000 7f6706e23f40 1 Processor -- start 2024-05-09T05:05:41.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.749+0000 7f6706e23f40 1 -- start start 2024-05-09T05:05:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6706e23f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 0x55eacdd036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6706e23f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 0x55eacdd03be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6706e23f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdd0b8a0 0x55eacdc615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6706e23f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eacdc7d8c0 con 0x55eacdc33960 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6706e23f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eacdbdaf50 con 0x55eacdd0b8a0 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6706e23f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55eacdc7bd80 con 0x55eacdc66a90 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 0x55eacdd036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 0x55eacdd036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38712/0 (socket says 172.21.15.100:38712) 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 -- 172.21.15.100:0/2289715227 learned_addr learned my addr 172.21.15.100:0/2289715227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 -- 172.21.15.100:0/2289715227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 msgr2=0x55eacdd03be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 0x55eacdd03be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 -- 172.21.15.100:0/2289715227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdd0b8a0 msgr2=0x55eacdc615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdd0b8a0 0x55eacdc615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.750+0000 7f6704000640 1 -- 172.21.15.100:0/2289715227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eacdb5db30 con 0x55eacdc33960 2024-05-09T05:05:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.751+0000 7f6704000640 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 0x55eacdd036a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f66f4002740 tx=0x7f66f4002c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e5e46b8c5763bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.751+0000 7f6702200640 1 -- 172.21.15.100:0/2289715227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4010790 con 0x55eacdc33960 2024-05-09T05:05:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.751+0000 7f6702200640 1 -- 172.21.15.100:0/2289715227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f4016070 con 0x55eacdc33960 2024-05-09T05:05:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.751+0000 7f6702200640 1 -- 172.21.15.100:0/2289715227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4010b50 con 0x55eacdc33960 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 -- 172.21.15.100:0/2289715227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 msgr2=0x55eacdd036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 0x55eacdd036a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f66f4002740 tx=0x7f66f4002c00 comp rx=0 tx=0).stop 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 -- 172.21.15.100:0/2289715227 shutdown_connections 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdd0b8a0 0x55eacdc615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 0x55eacdd03be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 --2- 172.21.15.100:0/2289715227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdc33960 0x55eacdd036a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 -- 172.21.15.100:0/2289715227 >> 172.21.15.100:0/2289715227 conn(0x55eacdc7de20 msgr2=0x55eacdc7e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 -- 172.21.15.100:0/2289715227 shutdown_connections 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.752+0000 7f6706e23f40 1 -- 172.21.15.100:0/2289715227 wait complete. 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.753+0000 7f6706e23f40 1 Processor -- start 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.753+0000 7f6706e23f40 1 -- start start 2024-05-09T05:05:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6706e23f40 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdc33960 0x55eacdcf8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6706e23f40 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 0x55eacdcfe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6706e23f40 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdd0b8a0 0x55eacdcfad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6706e23f40 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eacdcfff00 con 0x55eacdd0b8a0 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6706e23f40 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55eacdc7ed20 con 0x55eacdc33960 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6706e23f40 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55eacdc627f0 con 0x55eacdc66a90 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdd0b8a0 0x55eacdcfad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdd0b8a0 0x55eacdcfad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38714/0 (socket says 172.21.15.100:38714) 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 -- 172.21.15.100:0/593039259 learned_addr learned my addr 172.21.15.100:0/593039259 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704000640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdc33960 0x55eacdcf8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 -- 172.21.15.100:0/593039259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 msgr2=0x55eacdcfe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55eacdc66a90 0x55eacdcfe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 -- 172.21.15.100:0/593039259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdc33960 msgr2=0x55eacdcf8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55eacdc33960 0x55eacdcf8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.754+0000 7f6704a00640 1 -- 172.21.15.100:0/593039259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eacdcf8fc0 con 0x55eacdd0b8a0 2024-05-09T05:05:41.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.755+0000 7f6704a00640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdd0b8a0 0x55eacdcfad90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009d70 tx=0x7f66fc006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.755+0000 7f6700e00640 1 -- 172.21.15.100:0/593039259 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc017070 con 0x55eacdd0b8a0 2024-05-09T05:05:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.755+0000 7f6700e00640 1 -- 172.21.15.100:0/593039259 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc012410 con 0x55eacdd0b8a0 2024-05-09T05:05:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.755+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eacdc60790 con 0x55eacdd0b8a0 2024-05-09T05:05:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.755+0000 7f6700e00640 1 -- 172.21.15.100:0/593039259 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc009e60 con 0x55eacdd0b8a0 2024-05-09T05:05:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.755+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eacdcf8ba0 con 0x55eacdd0b8a0 2024-05-09T05:05:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.757+0000 7f6700e00640 1 -- 172.21.15.100:0/593039259 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f66fc01a070 con 0x55eacdd0b8a0 2024-05-09T05:05:41.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.758+0000 7f6700e00640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f66e0074ce0 0x7f66e00771a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.758+0000 7f6700e00640 1 -- 172.21.15.100:0/593039259 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f66fc0954b0 con 0x55eacdd0b8a0 2024-05-09T05:05:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.759+0000 7f6704000640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f66e0074ce0 0x7f66e00771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.759+0000 7f6706e23f40 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55eacdd0dfc0 0x55eacdd00840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.759+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- osd_op(unknown.0.0:1 5.13 5:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eacdc65ec0 con 0x55eacdd0dfc0 2024-05-09T05:05:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.759+0000 7f6703600640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55eacdd0dfc0 0x55eacdd00840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.759+0000 7f6704000640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f66e0074ce0 0x7f66e00771a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55eacdda4860 tx=0x7f66f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6703600640 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55eacdd0dfc0 0x55eacdd00840 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6703600640 1 -- 172.21.15.100:0/593039259 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== osd_op_reply(1 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) ==== 164+0+30 (crc 0 0 0) 0x7f66ec053500 con 0x55eacdd0dfc0 2024-05-09T05:05:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55eacdd0dfc0 msgr2=0x55eacdd00840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6706e23f40 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x55eacdd0dfc0 0x55eacdd00840 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f66e0074ce0 msgr2=0x7f66e00771a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6706e23f40 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f66e0074ce0 0x7f66e00771a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55eacdda4860 tx=0x7f66f4008030 comp rx=0 tx=0).stop 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdd0b8a0 msgr2=0x55eacdcfad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6706e23f40 1 --2- 172.21.15.100:0/593039259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eacdd0b8a0 0x55eacdcfad90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009d70 tx=0x7f66fc006750 comp rx=0 tx=0).stop 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.760+0000 7f6704a00640 1 -- 172.21.15.100:0/593039259 reap_dead start 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.761+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 shutdown_connections 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.761+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 >> 172.21.15.100:0/593039259 conn(0x55eacdc7de20 msgr2=0x55eacdc7e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.761+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 shutdown_connections 2024-05-09T05:05:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:41.761+0000 7f6706e23f40 1 -- 172.21.15.100:0/593039259 wait complete. 2024-05-09T05:05:41.766 INFO:teuthology.orchestra.run.smithi100.stdout:@@ 2024-05-09T05:05:41.766 DEBUG:teuthology.orchestra.run.smithi100:> ceph-dencoder type file_layout_t import - decode dump_json 2024-05-09T05:05:41.863 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_unit": 4194304, 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout: "stripe_count": 1, 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout: "object_size": 4194304, 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_id": 5, 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ns": "" 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:41.864 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:41.871 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-09T05:05:41.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:05:41.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:05:42.104 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-09T05:05:42.104 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:05:42.104 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:05:42.104 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:42.162 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:05:42.162 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:42.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:05:42.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.418+0000 7fc44d200640 1 Processor -- start 2024-05-09T05:05:42.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.418+0000 7fc44d200640 1 -- start start 2024-05-09T05:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc44d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc44815d5a0 0x7fc448073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc44d200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44806e520 con 0x7fc4480d0110 2024-05-09T05:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc44d200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4480cf440 con 0x7fc448074490 2024-05-09T05:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc44d200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc44815d980 con 0x7fc44815d5a0 2024-05-09T05:05:42.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc445e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc44815d5a0 0x7fc448073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc446800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc4480d0110 0x7fc44806ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51938/0 (socket says 172.21.15.100:51938) 2024-05-09T05:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc446800640 1 -- 172.21.15.100:0/404996892 learned_addr learned my addr 172.21.15.100:0/404996892 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.420+0000 7fc445e00640 1 -- 172.21.15.100:0/404996892 >> v1:172.21.15.133:6789/0 conn(0x7fc448074490 legacy=0x7fc4480cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.421+0000 7fc445e00640 1 -- 172.21.15.100:0/404996892 >> v1:172.21.15.100:6789/0 conn(0x7fc4480d0110 legacy=0x7fc44806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:42.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.421+0000 7fc445e00640 1 -- 172.21.15.100:0/404996892 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480cf720 con 0x7fc44815d5a0 2024-05-09T05:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.421+0000 7fc445400640 1 -- 172.21.15.100:0/404996892 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485632893 0 0) 0x7fc44806e520 con 0x7fc4480d0110 2024-05-09T05:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.422+0000 7fc445e00640 1 --2- 172.21.15.100:0/404996892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44815d5a0 0x7fc448073f50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097a0 tx=0x7fc43802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e68a0dc548fb615 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.422+0000 7fc445400640 1 -- 172.21.15.100:0/404996892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438037070 con 0x7fc44815d5a0 2024-05-09T05:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.422+0000 7fc445400640 1 -- 172.21.15.100:0/404996892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43802ae50 con 0x7fc44815d5a0 2024-05-09T05:05:42.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.422+0000 7fc445400640 1 -- 172.21.15.100:0/404996892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438032660 con 0x7fc44815d5a0 2024-05-09T05:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.422+0000 7fc44d200640 1 -- 172.21.15.100:0/404996892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44815d5a0 msgr2=0x7fc448073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.422+0000 7fc44d200640 1 --2- 172.21.15.100:0/404996892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44815d5a0 0x7fc448073f50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097a0 tx=0x7fc43802a100 comp rx=0 tx=0).stop 2024-05-09T05:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.423+0000 7fc44d200640 1 -- 172.21.15.100:0/404996892 shutdown_connections 2024-05-09T05:05:42.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.423+0000 7fc44d200640 1 --2- 172.21.15.100:0/404996892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc44815d5a0 0x7fc448073f50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.423+0000 7fc44d200640 1 -- 172.21.15.100:0/404996892 >> 172.21.15.100:0/404996892 conn(0x7fc4480b2c90 msgr2=0x7fc4480b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.423+0000 7fc44d200640 1 -- 172.21.15.100:0/404996892 shutdown_connections 2024-05-09T05:05:42.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.423+0000 7fc44d200640 1 -- 172.21.15.100:0/404996892 wait complete. 2024-05-09T05:05:42.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.424+0000 7fc44d200640 1 Processor -- start 2024-05-09T05:05:42.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.424+0000 7fc44d200640 1 -- start start 2024-05-09T05:05:42.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.425+0000 7fc44d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 0x7fc44815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:42.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.425+0000 7fc44d200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4480d0110 0x7fc448150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:42.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.425+0000 7fc44d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc44815d5a0 0x7fc44809d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:42.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.425+0000 7fc44d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc44809ede0 con 0x7fc448074490 2024-05-09T05:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.425+0000 7fc44d200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc4480d0520 con 0x7fc44815d5a0 2024-05-09T05:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.425+0000 7fc44d200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc44809ef60 con 0x7fc4480d0110 2024-05-09T05:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 0x7fc44815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 0x7fc44815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51344/0 (socket says 172.21.15.100:51344) 2024-05-09T05:05:42.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 -- 172.21.15.100:0/3246123095 learned_addr learned my addr 172.21.15.100:0/3246123095 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 -- 172.21.15.100:0/3246123095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4480d0110 msgr2=0x7fc448150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4480d0110 0x7fc448150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 -- 172.21.15.100:0/3246123095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc44815d5a0 msgr2=0x7fc44809d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:42.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc44815d5a0 0x7fc44809d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 -- 172.21.15.100:0/3246123095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44815ea80 con 0x7fc448074490 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.426+0000 7fc445e00640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 0x7fc44815bfb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc438000c00 tx=0x7fc4380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.427+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438042070 con 0x7fc448074490 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.427+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43803e670 con 0x7fc448074490 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.427+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438037040 con 0x7fc448074490 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.427+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc448160180 con 0x7fc448074490 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.427+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44815dfa0 con 0x7fc448074490 2024-05-09T05:05:42.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.428+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4480727a0 con 0x7fc448074490 2024-05-09T05:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.429+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc438045070 con 0x7fc448074490 2024-05-09T05:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.430+0000 7fc43ea00640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc4240762d0 0x7fc424078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:42.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.430+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7fc4380b7ff0 con 0x7fc448074490 2024-05-09T05:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.430+0000 7fc43d400640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc4240762d0 0x7fc424078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:42.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.431+0000 7fc43d400640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc4240762d0 0x7fc424078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc44809dfb0 tx=0x7fc430007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.435+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc4480727a0 con 0x7fc448074490 2024-05-09T05:05:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.658+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc44815c890 con 0x7fc448074490 2024-05-09T05:05:42.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.659+0000 7fc43ea00640 1 -- 172.21.15.100:0/3246123095 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) ==== 80+0+0 (secure 0 0 0) 0x7fc438081720 con 0x7fc448074490 2024-05-09T05:05:42.660 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.662+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc4240762d0 msgr2=0x7fc424078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc4240762d0 0x7fc424078790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc44809dfb0 tx=0x7fc430007990 comp rx=0 tx=0).stop 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 msgr2=0x7fc44815bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 0x7fc44815bfb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc438000c00 tx=0x7fc4380046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 shutdown_connections 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc4240762d0 0x7fc424078790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc44815d5a0 0x7fc44809d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc4480d0110 0x7fc448150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 --2- 172.21.15.100:0/3246123095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc448074490 0x7fc44815bfb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 >> 172.21.15.100:0/3246123095 conn(0x7fc4480b2c90 msgr2=0x7fc4480b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 shutdown_connections 2024-05-09T05:05:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:42.663+0000 7fc44d200640 1 -- 172.21.15.100:0/3246123095 wait complete. 2024-05-09T05:05:42.681 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T05:05:42.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:42.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T05:05:42.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:05:42.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:05:42.795 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T05:05:42.859 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:05:42.860 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:05:42.860 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:42.900 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:05:42.901 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:05:42.901 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:05:42.901 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:42.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052691,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248964k,nr_inodes=812241,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-09T05:05:42.940 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:05:42.940 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:05:42.940 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:42.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:05:42.987 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.171+0000 7f6c1a200640 1 Processor -- start 2024-05-09T05:05:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.171+0000 7f6c1a200640 1 -- start start 2024-05-09T05:05:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.173+0000 7f6c1a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 0x7f6c14073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.173+0000 7f6c1a200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1406ead0 con 0x7f6c140739a0 2024-05-09T05:05:43.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.173+0000 7f6c1a200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1406ed40 con 0x7f6c140b45c0 2024-05-09T05:05:43.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.173+0000 7f6c1a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1406f390 con 0x7f6c14145900 2024-05-09T05:05:43.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.173+0000 7f6c12a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6c140739a0 0x7f6c140b3eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51954/0 (socket says 172.21.15.100:51954) 2024-05-09T05:05:43.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.173+0000 7f6c12a00640 1 -- 172.21.15.100:0/2403103230 learned_addr learned my addr 172.21.15.100:0/2403103230 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c13400640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 0x7f6c14073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268860764 0 0) 0x7f6c1406ead0 con 0x7f6c140739a0 2024-05-09T05:05:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bf8003520 con 0x7f6c140739a0 2024-05-09T05:05:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 612599827 0 0) 0x7f6bf8003520 con 0x7f6c140739a0 2024-05-09T05:05:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 msgr2=0x7f6c14073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 0x7f6c14073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 >> v1:172.21.15.133:6789/0 conn(0x7f6c140b45c0 legacy=0x7f6c1406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1406f020 con 0x7f6c140739a0 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f6c000016f0 con 0x7f6c140739a0 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 >> v1:172.21.15.100:6789/0 conn(0x7f6c140739a0 legacy=0x7f6c140b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bf8003a80 0x7f6bf8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 0x7f6bf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf8004d40 0x7f6bf80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1406f390 con 0x7f6bf8004d40 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf800bb50 con 0x7f6bf8003a80 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.174+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf800bd50 con 0x7f6c14145900 2024-05-09T05:05:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13e00640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf8004d40 0x7f6bf80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13400640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bf8003a80 0x7f6bf8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c12a00640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 0x7f6bf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13e00640 1 -- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 msgr2=0x7f6bf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13e00640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6c14145900 0x7f6bf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13e00640 1 -- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bf8003a80 msgr2=0x7f6bf8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13e00640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bf8003a80 0x7f6bf8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.175+0000 7f6c13e00640 1 -- 172.21.15.100:0/2403103230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8003520 con 0x7f6bf8004d40 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.177+0000 7f6c13e00640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf8004d40 0x7f6bf80051a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c001e90 tx=0x7f6bf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a05e15a080594f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.177+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c001ab0 con 0x7f6bf8004d40 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.177+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c02ae50 con 0x7f6bf8004d40 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.177+0000 7f6c12000640 1 -- 172.21.15.100:0/2403103230 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c003b70 con 0x7f6bf8004d40 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c1a200640 1 -- 172.21.15.100:0/2403103230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf8004d40 msgr2=0x7f6bf80051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c1a200640 1 --2- 172.21.15.100:0/2403103230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf8004d40 0x7f6bf80051a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c001e90 tx=0x7f6bf8005830 comp rx=0 tx=0).stop 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c13e00640 1 -- 172.21.15.100:0/2403103230 reap_dead start 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c1a200640 1 -- 172.21.15.100:0/2403103230 shutdown_connections 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c1a200640 1 -- 172.21.15.100:0/2403103230 >> 172.21.15.100:0/2403103230 conn(0x7f6c140b31e0 msgr2=0x7f6c140d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c1a200640 1 -- 172.21.15.100:0/2403103230 shutdown_connections 2024-05-09T05:05:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.178+0000 7f6c1a200640 1 -- 172.21.15.100:0/2403103230 wait complete. 2024-05-09T05:05:43.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.180+0000 7f6c1a200640 1 Processor -- start 2024-05-09T05:05:43.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.180+0000 7f6c1a200640 1 -- start start 2024-05-09T05:05:43.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c1a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bf8004d40 0x7f6c1409cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c1a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 0x7f6c1415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c1a200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c141487a0 0x7f6c14148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c1a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6c14145ce0 con 0x7f6c1409bc70 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c1a200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140ade90 con 0x7f6c141487a0 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c1a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6c14145e60 con 0x7f6bf8004d40 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c12a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 0x7f6c1415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c12a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 0x7f6c1415ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51364/0 (socket says 172.21.15.100:51364) 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.181+0000 7f6c12a00640 1 -- 172.21.15.100:0/3146190210 learned_addr learned my addr 172.21.15.100:0/3146190210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c12a00640 1 -- 172.21.15.100:0/3146190210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bf8004d40 msgr2=0x7f6c1409cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c12a00640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bf8004d40 0x7f6c1409cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c12a00640 1 -- 172.21.15.100:0/3146190210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c141487a0 msgr2=0x7f6c14148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c12a00640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c141487a0 0x7f6c14148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c12a00640 1 -- 172.21.15.100:0/3146190210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1409d3e0 con 0x7f6c1409bc70 2024-05-09T05:05:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c12a00640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 0x7f6c1415ed30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e780 tx=0x7f6c0000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000c6c0 con 0x7f6c1409bc70 2024-05-09T05:05:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c00018070 con 0x7f6c1409bc70 2024-05-09T05:05:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000cae0 con 0x7f6c1409bc70 2024-05-09T05:05:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.182+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c14146110 con 0x7f6c1409bc70 2024-05-09T05:05:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.183+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c141466d0 con 0x7f6c1409bc70 2024-05-09T05:05:43.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.184+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c14076070 con 0x7f6c1409bc70 2024-05-09T05:05:43.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.185+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c0000cc80 con 0x7f6c1409bc70 2024-05-09T05:05:43.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.186+0000 7f6c0b400640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bf40762d0 0x7f6bf4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.187+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f6c000974d0 con 0x7f6c1409bc70 2024-05-09T05:05:43.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.187+0000 7f6c13400640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bf40762d0 0x7f6bf4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.187+0000 7f6c13400640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bf40762d0 0x7f6bf4078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009910 tx=0x7f6c04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:43.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.191+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c00060c90 con 0x7f6c1409bc70 2024-05-09T05:05:43.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.431+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c140d1ad0 con 0x7f6c1409bc70 2024-05-09T05:05:43.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.432+0000 7f6c0b400640 1 -- 172.21.15.100:0/3146190210 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7f6c140d1ad0 con 0x7f6c1409bc70 2024-05-09T05:05:43.433 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:43.433 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:43.433 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:43.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.434+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bf40762d0 msgr2=0x7f6bf4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.434+0000 7f6c1a200640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bf40762d0 0x7f6bf4078790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009910 tx=0x7f6c04008040 comp rx=0 tx=0).stop 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.434+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 msgr2=0x7f6c1415ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.434+0000 7f6c1a200640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 0x7f6c1415ed30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000e780 tx=0x7f6c0000ec40 comp rx=0 tx=0).stop 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 shutdown_connections 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bf40762d0 0x7f6bf4078790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c141487a0 0x7f6c14148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c1409bc70 0x7f6c1415ed30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 --2- 172.21.15.100:0/3146190210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bf8004d40 0x7f6c1409cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 >> 172.21.15.100:0/3146190210 conn(0x7f6c140b31e0 msgr2=0x7f6c140ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 shutdown_connections 2024-05-09T05:05:43.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.435+0000 7f6c1a200640 1 -- 172.21.15.100:0/3146190210 wait complete. 2024-05-09T05:05:43.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:43.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.648+0000 7fb932800640 1 Processor -- start 2024-05-09T05:05:43.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.648+0000 7fb932800640 1 -- start start 2024-05-09T05:05:43.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb932800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb92c0afb70 0x7fb92c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb932800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c0ae3a0 con 0x7fb92c0d0a70 2024-05-09T05:05:43.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb932800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c0b4590 con 0x7fb92c0ade90 2024-05-09T05:05:43.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb932800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb92c0b4870 con 0x7fb92c0afb70 2024-05-09T05:05:43.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb92be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb92c0afb70 0x7fb92c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb92b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb92c0d0a70 0x7fb92c15e240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51964/0 (socket says 172.21.15.100:51964) 2024-05-09T05:05:43.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.650+0000 7fb92b400640 1 -- 172.21.15.100:0/2324171225 learned_addr learned my addr 172.21.15.100:0/2324171225 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:43.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.651+0000 7fb92be00640 1 -- 172.21.15.100:0/2324171225 >> v1:172.21.15.133:6789/0 conn(0x7fb92c0ade90 legacy=0x7fb92c0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:43.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.651+0000 7fb92be00640 1 -- 172.21.15.100:0/2324171225 >> v1:172.21.15.100:6789/0 conn(0x7fb92c0d0a70 legacy=0x7fb92c15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.651+0000 7fb92be00640 1 -- 172.21.15.100:0/2324171225 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c0b4b50 con 0x7fb92c0afb70 2024-05-09T05:05:43.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.652+0000 7fb92be00640 1 --2- 172.21.15.100:0/2324171225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0afb70 0x7fb92c0affa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d9f28f0021b3b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.652+0000 7fb92a000640 1 -- 172.21.15.100:0/2324171225 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924007740 con 0x7fb92c0afb70 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.652+0000 7fb92a000640 1 -- 172.21.15.100:0/2324171225 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9240078e0 con 0x7fb92c0afb70 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.652+0000 7fb92a000640 1 -- 172.21.15.100:0/2324171225 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924007cb0 con 0x7fb92c0afb70 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.652+0000 7fb932800640 1 -- 172.21.15.100:0/2324171225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0afb70 msgr2=0x7fb92c0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.652+0000 7fb932800640 1 --2- 172.21.15.100:0/2324171225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0afb70 0x7fb92c0affa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb924009d90 tx=0x7fb92402a660 comp rx=0 tx=0).stop 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.653+0000 7fb932800640 1 -- 172.21.15.100:0/2324171225 shutdown_connections 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.653+0000 7fb932800640 1 --2- 172.21.15.100:0/2324171225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0afb70 0x7fb92c0affa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.653+0000 7fb932800640 1 -- 172.21.15.100:0/2324171225 >> 172.21.15.100:0/2324171225 conn(0x7fb92c0b31e0 msgr2=0x7fb92c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.653+0000 7fb932800640 1 -- 172.21.15.100:0/2324171225 shutdown_connections 2024-05-09T05:05:43.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.653+0000 7fb932800640 1 -- 172.21.15.100:0/2324171225 wait complete. 2024-05-09T05:05:43.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.654+0000 7fb932800640 1 Processor -- start 2024-05-09T05:05:43.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.654+0000 7fb932800640 1 -- start start 2024-05-09T05:05:43.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.655+0000 7fb932800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 0x7fb92c149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.655+0000 7fb932800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb92c0afb70 0x7fb92c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.655+0000 7fb932800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb92c0d0a70 0x7fb92c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.655+0000 7fb932800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c072570 con 0x7fb92c0ade90 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.655+0000 7fb932800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c0b04e0 con 0x7fb92c0d0a70 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.655+0000 7fb932800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c0726f0 con 0x7fb92c0afb70 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 0x7fb92c149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 0x7fb92c149a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51394/0 (socket says 172.21.15.100:51394) 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 -- 172.21.15.100:0/3702424074 learned_addr learned my addr 172.21.15.100:0/3702424074 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 -- 172.21.15.100:0/3702424074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb92c0afb70 msgr2=0x7fb92c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb92c0afb70 0x7fb92c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 -- 172.21.15.100:0/3702424074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb92c0d0a70 msgr2=0x7fb92c15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb92c0d0a70 0x7fb92c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 -- 172.21.15.100:0/3702424074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c157060 con 0x7fb92c0ade90 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.656+0000 7fb92b400640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 0x7fb92c149a40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb91c001eb0 tx=0x7fb91c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.657+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c017070 con 0x7fb92c0ade90 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.657+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c005d00 con 0x7fb92c0ade90 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.657+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c007310 con 0x7fb92c0ade90 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.657+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c155fc0 con 0x7fb92c0ade90 2024-05-09T05:05:43.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.657+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c156580 con 0x7fb92c0ade90 2024-05-09T05:05:43.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.658+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c076070 con 0x7fb92c0ade90 2024-05-09T05:05:43.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.659+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb91c01a070 con 0x7fb92c0ade90 2024-05-09T05:05:43.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.660+0000 7fb923400640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb90c0762d0 0x7fb90c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:43.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.660+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7fb91c096af0 con 0x7fb92c0ade90 2024-05-09T05:05:43.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.660+0000 7fb92aa00640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb90c0762d0 0x7fb90c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:43.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.661+0000 7fb92aa00640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb90c0762d0 0x7fb90c078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0b0c90 tx=0x7fb918007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:43.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.664+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb91c0602c0 con 0x7fb92c0ade90 2024-05-09T05:05:43.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.909+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb92c0b0cc0 con 0x7fb92c0ade90 2024-05-09T05:05:43.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.910+0000 7fb923400640 1 -- 172.21.15.100:0/3702424074 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7fb91c05fbc0 con 0x7fb92c0ade90 2024-05-09T05:05:43.911 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:43.911 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:43.911 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:43.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.912+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb90c0762d0 msgr2=0x7fb90c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.912+0000 7fb932800640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb90c0762d0 0x7fb90c078790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0b0c90 tx=0x7fb918007990 comp rx=0 tx=0).stop 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 msgr2=0x7fb92c149a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 0x7fb92c149a40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb91c001eb0 tx=0x7fb91c00c890 comp rx=0 tx=0).stop 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 shutdown_connections 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb90c0762d0 0x7fb90c078790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb92c0d0a70 0x7fb92c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb92c0afb70 0x7fb92c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 --2- 172.21.15.100:0/3702424074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb92c0ade90 0x7fb92c149a40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 >> 172.21.15.100:0/3702424074 conn(0x7fb92c0b31e0 msgr2=0x7fb92c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:43.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 shutdown_connections 2024-05-09T05:05:43.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:43.913+0000 7fb932800640 1 -- 172.21.15.100:0/3702424074 wait complete. 2024-05-09T05:05:43.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:44.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.126+0000 7f1c2e800640 1 Processor -- start 2024-05-09T05:05:44.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.126+0000 7f1c2e800640 1 -- start start 2024-05-09T05:05:44.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.127+0000 7f1c2e800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2806fd60 0x7f1c28070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.127+0000 7f1c2e800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c280afe20 0x7f1c28073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c2e800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c28070680 con 0x7f1c28073840 2024-05-09T05:05:44.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c2e800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2806f390 con 0x7f1c280afe20 2024-05-09T05:05:44.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c2e800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2806e810 con 0x7f1c2806fd60 2024-05-09T05:05:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c27400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2806fd60 0x7f1c28070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c27e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c280afe20 0x7f1c28073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c26a00640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c28073840 0x7f1c2815fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:51704/0 (socket says 172.21.15.100:51704) 2024-05-09T05:05:44.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.128+0000 7f1c26a00640 1 -- 172.21.15.100:0/2034790401 learned_addr learned my addr 172.21.15.100:0/2034790401 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.129+0000 7f1c27e00640 1 -- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2806fd60 msgr2=0x7f1c28070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.129+0000 7f1c27e00640 1 --2- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2806fd60 0x7f1c28070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.129+0000 7f1c27e00640 1 -- 172.21.15.100:0/2034790401 >> v1:172.21.15.133:6789/0 conn(0x7f1c28073840 legacy=0x7f1c2815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.129+0000 7f1c27e00640 1 -- 172.21.15.100:0/2034790401 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2806eaf0 con 0x7f1c280afe20 2024-05-09T05:05:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.129+0000 7f1c27400640 1 --2- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2806fd60 0x7f1c28070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:05:44.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.129+0000 7f1c26000640 1 -- 172.21.15.100:0/2034790401 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508779454 0 0) 0x7f1c28070680 con 0x7f1c28073840 2024-05-09T05:05:44.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.131+0000 7f1c27e00640 1 --2- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c28073ca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009d90 tx=0x7f1c2002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c75996e4793626 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:44.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.131+0000 7f1c26000640 1 -- 172.21.15.100:0/2034790401 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20007740 con 0x7f1c280afe20 2024-05-09T05:05:44.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.131+0000 7f1c26000640 1 -- 172.21.15.100:0/2034790401 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c200078e0 con 0x7f1c280afe20 2024-05-09T05:05:44.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.131+0000 7f1c26000640 1 -- 172.21.15.100:0/2034790401 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20007cb0 con 0x7f1c280afe20 2024-05-09T05:05:44.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 -- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 msgr2=0x7f1c28073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 --2- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c28073ca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c20009d90 tx=0x7f1c2002a660 comp rx=0 tx=0).stop 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 -- 172.21.15.100:0/2034790401 shutdown_connections 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 --2- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c28073ca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 --2- 172.21.15.100:0/2034790401 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c2806fd60 0x7f1c28070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 -- 172.21.15.100:0/2034790401 >> 172.21.15.100:0/2034790401 conn(0x7f1c280b31e0 msgr2=0x7f1c280d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 -- 172.21.15.100:0/2034790401 shutdown_connections 2024-05-09T05:05:44.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.132+0000 7f1c2e800640 1 -- 172.21.15.100:0/2034790401 wait complete. 2024-05-09T05:05:44.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.133+0000 7f1c2e800640 1 Processor -- start 2024-05-09T05:05:44.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 -- start start 2024-05-09T05:05:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 0x7f1c28156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c28073840 0x7f1c28156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c281f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2806e4a0 con 0x7f1c2806fd60 2024-05-09T05:05:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2806f0b0 con 0x7f1c280afe20 2024-05-09T05:05:44.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.134+0000 7f1c2e800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1c28159f00 con 0x7f1c28073840 2024-05-09T05:05:44.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 0x7f1c28156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 0x7f1c28156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51402/0 (socket says 172.21.15.100:51402) 2024-05-09T05:05:44.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 -- 172.21.15.100:0/505318624 learned_addr learned my addr 172.21.15.100:0/505318624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:44.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c26a00640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c28073840 0x7f1c28156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 -- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c28073840 msgr2=0x7f1c28156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c28073840 0x7f1c28156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 -- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 msgr2=0x7f1c281f8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27e00640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c281f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c281f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.135+0000 7f1c27400640 1 -- 172.21.15.100:0/505318624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c281f5460 con 0x7f1c2806fd60 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.136+0000 7f1c27400640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 0x7f1c28156850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800ebe0 tx=0x7f1c1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.136+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18017070 con 0x7f1c2806fd60 2024-05-09T05:05:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.136+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1800cc30 con 0x7f1c2806fd60 2024-05-09T05:05:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.136+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c281f5740 con 0x7f1c2806fd60 2024-05-09T05:05:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.136+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18013470 con 0x7f1c2806fd60 2024-05-09T05:05:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.136+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281f5d00 con 0x7f1c2806fd60 2024-05-09T05:05:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.137+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c281f5f40 con 0x7f1c2806fd60 2024-05-09T05:05:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.138+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c1801a070 con 0x7f1c2806fd60 2024-05-09T05:05:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.139+0000 7f1c1f400640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c080762d0 0x7f1c08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.139+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f1c18097b40 con 0x7f1c2806fd60 2024-05-09T05:05:44.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.139+0000 7f1c26a00640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c080762d0 0x7f1c08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.140+0000 7f1c26a00640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c080762d0 0x7f1c08078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c280b2ac0 tx=0x7f1c14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:44.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.144+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c18061270 con 0x7f1c2806fd60 2024-05-09T05:05:44.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.350+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c280b0920 con 0x7f1c2806fd60 2024-05-09T05:05:44.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.352+0000 7f1c1f400640 1 -- 172.21.15.100:0/505318624 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+18505 (secure 0 0 0) 0x7f1c18060b70 con 0x7f1c2806fd60 2024-05-09T05:05:44.353 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:44.353 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:37.841238+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:18.083878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:19.108109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-05-09T05:05:35.515359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c080762d0 msgr2=0x7f1c08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c080762d0 0x7f1c08078790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c280b2ac0 tx=0x7f1c14009040 comp rx=0 tx=0).stop 2024-05-09T05:05:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 msgr2=0x7f1c28156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 0x7f1c28156850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800ebe0 tx=0x7f1c1800c520 comp rx=0 tx=0).stop 2024-05-09T05:05:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 shutdown_connections 2024-05-09T05:05:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c080762d0 0x7f1c08078790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280afe20 0x7f1c281f8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c28073840 0x7f1c28156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 --2- 172.21.15.100:0/505318624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c2806fd60 0x7f1c28156850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 >> 172.21.15.100:0/505318624 conn(0x7f1c280b31e0 msgr2=0x7f1c280d1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 shutdown_connections 2024-05-09T05:05:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.355+0000 7f1c2e800640 1 -- 172.21.15.100:0/505318624 wait complete. 2024-05-09T05:05:44.374 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T05:05:44.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.572+0000 7f1d67e00640 1 Processor -- start 2024-05-09T05:05:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.572+0000 7f1d67e00640 1 -- start start 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.573+0000 7f1d67e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1d681456c0 0x7f1d6815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.573+0000 7f1d67e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d6806f570 0x7f1d6806f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.573+0000 7f1d67e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6815d730 con 0x7f1d6815fb60 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.573+0000 7f1d67e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1d680cfb40 con 0x7f1d681456c0 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.573+0000 7f1d67e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f1d6815d530 con 0x7f1d6806f570 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1d681456c0 0x7f1d6815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1d681456c0 0x7f1d6815cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51410/0 (socket says 172.21.15.100:51410) 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 -- 172.21.15.100:0/1405532187 learned_addr learned my addr 172.21.15.100:0/1405532187 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d5fe00640 1 --2- 172.21.15.100:0/1405532187 >> v2:172.21.15.133:3300/0 conn(0x7f1d6806f570 0x7f1d6806f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 -- 172.21.15.100:0/1405532187 >> v2:172.21.15.133:3300/0 conn(0x7f1d6806f570 msgr2=0x7f1d6806f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 --2- 172.21.15.100:0/1405532187 >> v2:172.21.15.133:3300/0 conn(0x7f1d6806f570 0x7f1d6806f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 -- 172.21.15.100:0/1405532187 >> v1:172.21.15.133:6789/0 conn(0x7f1d6815fb60 legacy=0x7f1d6815ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:44.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d66a00640 1 -- 172.21.15.100:0/1405532187 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d680cef30 con 0x7f1d681456c0 2024-05-09T05:05:44.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.574+0000 7f1d5fe00640 1 --2- 172.21.15.100:0/1405532187 >> v2:172.21.15.133:3300/0 conn(0x7f1d6806f570 0x7f1d6806f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.575+0000 7f1d66a00640 1 --2- 172.21.15.100:0/1405532187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d6815cff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d68073180 tx=0x7f1d5802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d82a22220d4697 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d66000640 1 -- 172.21.15.100:0/1405532187 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58032790 con 0x7f1d681456c0 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d66000640 1 -- 172.21.15.100:0/1405532187 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58038070 con 0x7f1d681456c0 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d66000640 1 -- 172.21.15.100:0/1405532187 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58032b50 con 0x7f1d681456c0 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d67e00640 1 -- 172.21.15.100:0/1405532187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 msgr2=0x7f1d6815cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1405532187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d6815cff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1d68073180 tx=0x7f1d5802c890 comp rx=0 tx=0).stop 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d67e00640 1 -- 172.21.15.100:0/1405532187 shutdown_connections 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1405532187 >> v2:172.21.15.133:3300/0 conn(0x7f1d6806f570 0x7f1d6806f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1405532187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d6815cff0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.576+0000 7f1d67e00640 1 -- 172.21.15.100:0/1405532187 >> 172.21.15.100:0/1405532187 conn(0x7f1d6806c7f0 msgr2=0x7f1d6806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.577+0000 7f1d67e00640 1 -- 172.21.15.100:0/1405532187 shutdown_connections 2024-05-09T05:05:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.577+0000 7f1d67e00640 1 -- 172.21.15.100:0/1405532187 wait complete. 2024-05-09T05:05:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.578+0000 7f1d67e00640 1 Processor -- start 2024-05-09T05:05:44.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.578+0000 7f1d67e00640 1 -- start start 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d67e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d6806f570 0x7f1d6815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d67e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d680b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d67e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6815fb60 0x7f1d6813f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d67e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680cf7d0 con 0x7f1d681456c0 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d67e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680cf4f0 con 0x7f1d6815fb60 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d67e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1d680cec00 con 0x7f1d6806f570 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.579+0000 7f1d5fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d680b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d680b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51414/0 (socket says 172.21.15.100:51414) 2024-05-09T05:05:44.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 -- 172.21.15.100:0/1507460827 learned_addr learned my addr 172.21.15.100:0/1507460827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:44.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 -- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d6806f570 msgr2=0x7f1d6815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d66a00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d6806f570 0x7f1d6815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d67400640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6815fb60 0x7f1d6813f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d6806f570 0x7f1d6815f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 -- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6815fb60 msgr2=0x7f1d6813f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6815fb60 0x7f1d6813f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 -- 172.21.15.100:0/1507460827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d680b4e00 con 0x7f1d681456c0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d67400640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6815fb60 0x7f1d6813f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5fe00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d680b48c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000c820 tx=0x7f1d5000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.580+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50015070 con 0x7f1d681456c0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.581+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d50007a30 con 0x7f1d681456c0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.581+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50007de0 con 0x7f1d681456c0 2024-05-09T05:05:44.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.581+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d680b50d0 con 0x7f1d681456c0 2024-05-09T05:05:44.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.581+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d680aef60 con 0x7f1d681456c0 2024-05-09T05:05:44.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.582+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d68069f00 con 0x7f1d681456c0 2024-05-09T05:05:44.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.583+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d50018070 con 0x7f1d681456c0 2024-05-09T05:05:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.584+0000 7f1d5ea00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1d440762d0 0x7f1d44078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.584+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f1d50097650 con 0x7f1d681456c0 2024-05-09T05:05:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.584+0000 7f1d66a00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1d440762d0 0x7f1d44078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:44.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.585+0000 7f1d66a00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1d440762d0 0x7f1d44078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1d58037000 tx=0x7f1d58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:44.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.588+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1d68069f00 con 0x7f1d681456c0 2024-05-09T05:05:44.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.842+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d6806a550 con 0x7f1d681456c0 2024-05-09T05:05:44.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.843+0000 7f1d5ea00640 1 -- 172.21.15.100:0/1507460827 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7f1d50060e10 con 0x7f1d681456c0 2024-05-09T05:05:44.844 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:44.844 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:44.845 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1d440762d0 msgr2=0x7f1d44078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1d440762d0 0x7f1d44078790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1d58037000 tx=0x7f1d58008040 comp rx=0 tx=0).stop 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 msgr2=0x7f1d680b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d680b48c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000c820 tx=0x7f1d5000cce0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 shutdown_connections 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1d440762d0 0x7f1d44078790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6815fb60 0x7f1d6813f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d681456c0 0x7f1d680b48c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 --2- 172.21.15.100:0/1507460827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d6806f570 0x7f1d6815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:44.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.846+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 >> 172.21.15.100:0/1507460827 conn(0x7f1d6806c7f0 msgr2=0x7f1d6806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:44.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.847+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 shutdown_connections 2024-05-09T05:05:44.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:44.847+0000 7f1d67e00640 1 -- 172.21.15.100:0/1507460827 wait complete. 2024-05-09T05:05:44.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.057+0000 7fc22d400640 1 Processor -- start 2024-05-09T05:05:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.057+0000 7fc22d400640 1 -- start start 2024-05-09T05:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.058+0000 7fc22d400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2280ce330 0x7fc2280cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.058+0000 7fc22d400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc228143af0 con 0x7fc228161730 2024-05-09T05:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.058+0000 7fc22d400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22815e240 con 0x7fc228143710 2024-05-09T05:05:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.058+0000 7fc22d400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fc228160ce0 con 0x7fc2280ce330 2024-05-09T05:05:45.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.059+0000 7fc21f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc228161730 0x7fc2280cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51970/0 (socket says 172.21.15.100:51970) 2024-05-09T05:05:45.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.059+0000 7fc21f400640 1 -- 172.21.15.100:0/3779331975 learned_addr learned my addr 172.21.15.100:0/3779331975 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:45.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.059+0000 7fc22ca00640 1 --2- 172.21.15.100:0/3779331975 >> v2:172.21.15.133:3300/0 conn(0x7fc2280ce330 0x7fc2280cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940672306 0 0) 0x7fc228143af0 con 0x7fc228161730 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc20c003520 con 0x7fc228161730 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2935470798 0 0) 0x7fc20c003520 con 0x7fc228161730 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 >> v2:172.21.15.133:3300/0 conn(0x7fc2280ce330 msgr2=0x7fc2280cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 --2- 172.21.15.100:0/3779331975 >> v2:172.21.15.133:3300/0 conn(0x7fc2280ce330 0x7fc2280cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 >> v1:172.21.15.133:6789/0 conn(0x7fc228143710 legacy=0x7fc22815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22815e520 con 0x7fc228161730 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fc2100016f0 con 0x7fc228161730 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 >> v1:172.21.15.100:6789/0 conn(0x7fc228161730 legacy=0x7fc2280cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc20c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc20c004800 0x7fc20c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc20c0051c0 0x7fc20c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc228160ce0 con 0x7fc20c003a00 2024-05-09T05:05:45.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c00c110 con 0x7fc20c0051c0 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c00c310 con 0x7fc20c004800 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.060+0000 7fc227e00640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc20c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc21f400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc20c004800 0x7fc20c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc227e00640 1 -- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc20c004800 msgr2=0x7fc20c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc227e00640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc20c004800 0x7fc20c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc227e00640 1 -- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc20c0051c0 msgr2=0x7fc20c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc227e00640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc20c0051c0 0x7fc20c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc22ca00640 1 -- 172.21.15.100:0/3779331975 reap_dead start 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc227e00640 1 -- 172.21.15.100:0/3779331975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c003520 con 0x7fc20c003a00 2024-05-09T05:05:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.061+0000 7fc21f400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc20c004800 0x7fc20c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:45.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.062+0000 7fc227e00640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc20c003de0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc218001890 tx=0x7fc20c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd6194764d44afe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.062+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218037070 con 0x7fc20c003a00 2024-05-09T05:05:45.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.062+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21802ac20 con 0x7fc20c003a00 2024-05-09T05:05:45.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.062+0000 7fc227400640 1 -- 172.21.15.100:0/3779331975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180014b0 con 0x7fc20c003a00 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 -- 172.21.15.100:0/3779331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 msgr2=0x7fc20c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc20c003de0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc218001890 tx=0x7fc20c005830 comp rx=0 tx=0).stop 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 -- 172.21.15.100:0/3779331975 shutdown_connections 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 --2- 172.21.15.100:0/3779331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc20c003de0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 -- 172.21.15.100:0/3779331975 >> 172.21.15.100:0/3779331975 conn(0x7fc22806c7f0 msgr2=0x7fc22806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 -- 172.21.15.100:0/3779331975 shutdown_connections 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.063+0000 7fc22d400640 1 -- 172.21.15.100:0/3779331975 wait complete. 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.065+0000 7fc22d400640 1 Processor -- start 2024-05-09T05:05:45.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.065+0000 7fc22d400640 1 -- start start 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc22d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc228145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc22d400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc22815c990 0x7fc2280b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc22d400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22813c830 0x7fc2280b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc22d400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc228072490 con 0x7fc20c003a00 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc22d400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc228161210 con 0x7fc22813c830 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc22d400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc228161bc0 con 0x7fc22815c990 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc228145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc228145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51438/0 (socket says 172.21.15.100:51438) 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 -- 172.21.15.100:0/778739867 learned_addr learned my addr 172.21.15.100:0/778739867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:45.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 -- 172.21.15.100:0/778739867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc22815c990 msgr2=0x7fc2280b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc22815c990 0x7fc2280b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 -- 172.21.15.100:0/778739867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22813c830 msgr2=0x7fc2280b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22813c830 0x7fc2280b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.066+0000 7fc227e00640 1 -- 172.21.15.100:0/778739867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2280b5ee0 con 0x7fc20c003a00 2024-05-09T05:05:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.067+0000 7fc227e00640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc228145fc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2180019b0 tx=0x7fc2180012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.067+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21803f020 con 0x7fc20c003a00 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.067+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2180052e0 con 0x7fc20c003a00 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.067+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc228144f20 con 0x7fc20c003a00 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.067+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218037040 con 0x7fc20c003a00 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.067+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2281454e0 con 0x7fc20c003a00 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.068+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22806a550 con 0x7fc20c003a00 2024-05-09T05:05:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.069+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc218042020 con 0x7fc20c003a00 2024-05-09T05:05:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.070+0000 7fc224c00640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc204076300 0x7fc2040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.070+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7fc2180b7320 con 0x7fc20c003a00 2024-05-09T05:05:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.070+0000 7fc21f400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc204076300 0x7fc2040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.071+0000 7fc21f400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc204076300 0x7fc2040787c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc210001120 tx=0x7fc210009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.074+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc218049030 con 0x7fc20c003a00 2024-05-09T05:05:45.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.321+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2281403a0 con 0x7fc20c003a00 2024-05-09T05:05:45.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.322+0000 7fc224c00640 1 -- 172.21.15.100:0/778739867 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5195 (secure 0 0 0) 0x7fc2280b5ee0 con 0x7fc20c003a00 2024-05-09T05:05:45.323 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:45.323 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:20.140697+0000","modified":"2024-05-09T05:05:36.293585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4749},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4749":{"gid":4749,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.100:6837/1862982495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1862982495},{"type":"v1","addr":"172.21.15.100:6837","nonce":1862982495}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4749,"qdb_cluster":[4749]},"id":2}]} 2024-05-09T05:05:45.323 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 19 2024-05-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc204076300 msgr2=0x7fc2040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc204076300 0x7fc2040787c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc210001120 tx=0x7fc210009040 comp rx=0 tx=0).stop 2024-05-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 msgr2=0x7fc228145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc228145fc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc2180019b0 tx=0x7fc2180012f0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 shutdown_connections 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc204076300 0x7fc2040787c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc22813c830 0x7fc2280b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc22815c990 0x7fc2280b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 --2- 172.21.15.100:0/778739867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc20c003a00 0x7fc228145fc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 >> 172.21.15.100:0/778739867 conn(0x7fc22806c7f0 msgr2=0x7fc22813f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 shutdown_connections 2024-05-09T05:05:45.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.325+0000 7fc22d400640 1 -- 172.21.15.100:0/778739867 wait complete. 2024-05-09T05:05:45.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.541+0000 7f5755400640 1 Processor -- start 2024-05-09T05:05:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.542+0000 7f5755400640 1 -- start start 2024-05-09T05:05:45.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f5755400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f57500b4530 0x7f57500b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f5755400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57500d3660 0x7f57500d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f5755400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d1a10 0x7f57500d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f5755400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f57500d23a0 con 0x7f57500b4530 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f5755400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f57500d2f80 con 0x7f57500d3660 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f5755400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f57500b51e0 con 0x7f57500d1a10 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f574fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f57500b4530 0x7f57500b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f574fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f57500b4530 0x7f57500b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51454/0 (socket says 172.21.15.100:51454) 2024-05-09T05:05:45.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.543+0000 7f574fe00640 1 -- 172.21.15.100:0/97385390 learned_addr learned my addr 172.21.15.100:0/97385390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.544+0000 7f574fe00640 1 -- 172.21.15.100:0/97385390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d1a10 msgr2=0x7f57500d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.544+0000 7f574fe00640 1 --2- 172.21.15.100:0/97385390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d1a10 0x7f57500d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.544+0000 7f574fe00640 1 -- 172.21.15.100:0/97385390 >> v2:172.21.15.133:3300/0 conn(0x7f57500d3660 msgr2=0x7f57500d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.544+0000 7f574fe00640 1 --2- 172.21.15.100:0/97385390 >> v2:172.21.15.133:3300/0 conn(0x7f57500d3660 0x7f57500d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.544+0000 7f574fe00640 1 -- 172.21.15.100:0/97385390 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57500b6190 con 0x7f57500b4530 2024-05-09T05:05:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.545+0000 7f574fe00640 1 --2- 172.21.15.100:0/97385390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500b4530 0x7f57500b5c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f57500d2ba0 tx=0x7f574002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0045750d9f31647 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.545+0000 7f574ea00640 1 -- 172.21.15.100:0/97385390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740036070 con 0x7f57500b4530 2024-05-09T05:05:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.545+0000 7f574ea00640 1 -- 172.21.15.100:0/97385390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5740031600 con 0x7f57500b4530 2024-05-09T05:05:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.545+0000 7f574ea00640 1 -- 172.21.15.100:0/97385390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57400319d0 con 0x7f57500b4530 2024-05-09T05:05:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.545+0000 7f5755400640 1 -- 172.21.15.100:0/97385390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500b4530 msgr2=0x7f57500b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.545+0000 7f5755400640 1 --2- 172.21.15.100:0/97385390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500b4530 0x7f57500b5c50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f57500d2ba0 tx=0x7f574002a6a0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 -- 172.21.15.100:0/97385390 shutdown_connections 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 --2- 172.21.15.100:0/97385390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d1a10 0x7f57500d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 --2- 172.21.15.100:0/97385390 >> v2:172.21.15.133:3300/0 conn(0x7f57500d3660 0x7f57500d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 --2- 172.21.15.100:0/97385390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500b4530 0x7f57500b5c50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 -- 172.21.15.100:0/97385390 >> 172.21.15.100:0/97385390 conn(0x7f575008eb30 msgr2=0x7f575009e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 -- 172.21.15.100:0/97385390 shutdown_connections 2024-05-09T05:05:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.546+0000 7f5755400640 1 -- 172.21.15.100:0/97385390 wait complete. 2024-05-09T05:05:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.547+0000 7f5755400640 1 Processor -- start 2024-05-09T05:05:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.547+0000 7f5755400640 1 -- start start 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.548+0000 7f5755400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57500b4530 0x7f575015f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.548+0000 7f5755400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 0x7f57500cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.548+0000 7f5755400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d3660 0x7f57500ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.548+0000 7f5755400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57500b5730 con 0x7f57500d1a10 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.548+0000 7f5755400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f57500b5450 con 0x7f57500b4530 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.548+0000 7f5755400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f57500d28d0 con 0x7f57500d3660 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 0x7f57500cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 0x7f57500cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51456/0 (socket says 172.21.15.100:51456) 2024-05-09T05:05:45.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 -- 172.21.15.100:0/2646631104 learned_addr learned my addr 172.21.15.100:0/2646631104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 -- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d3660 msgr2=0x7f57500ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d3660 0x7f57500ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 -- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57500b4530 msgr2=0x7f575015f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574fe00640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57500b4530 0x7f575015f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57500b4530 0x7f575015f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 -- 172.21.15.100:0/2646631104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57500cc6b0 con 0x7f57500d1a10 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f574f400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 0x7f57500cc170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f573800b4a0 tx=0x7f573800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.549+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738014070 con 0x7f57500d1a10 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.550+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738010610 con 0x7f57500d1a10 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.550+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5738010a00 con 0x7f57500d1a10 2024-05-09T05:05:45.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.550+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57500ccc20 con 0x7f57500d1a10 2024-05-09T05:05:45.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.550+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57500c99d0 con 0x7f57500d1a10 2024-05-09T05:05:45.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.551+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575006a550 con 0x7f57500d1a10 2024-05-09T05:05:45.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.552+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5738017070 con 0x7f57500d1a10 2024-05-09T05:05:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.553+0000 7f5747e00640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f572c0762d0 0x7f572c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.553+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7f57380971a0 con 0x7f57500d1a10 2024-05-09T05:05:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.553+0000 7f574fe00640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f572c0762d0 0x7f572c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.554+0000 7f574fe00640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f572c0762d0 0x7f572c078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5740033000 tx=0x7f5740009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.557+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5738060960 con 0x7f57500d1a10 2024-05-09T05:05:45.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.763+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57500b4bd0 con 0x7f57500d1a10 2024-05-09T05:05:45.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.764+0000 7f5747e00640 1 -- 172.21.15.100:0/2646631104 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+18505 (secure 0 0 0) 0x7f5738060260 con 0x7f57500d1a10 2024-05-09T05:05:45.765 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:45.765 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":35,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:37.841238+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:18.083878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:19.108109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"data_new","create_time":"2024-05-09T05:05:35.515359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f572c0762d0 msgr2=0x7f572c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f572c0762d0 0x7f572c078790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5740033000 tx=0x7f5740009000 comp rx=0 tx=0).stop 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 msgr2=0x7f57500cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 0x7f57500cc170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f573800b4a0 tx=0x7f573800b960 comp rx=0 tx=0).stop 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 shutdown_connections 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f572c0762d0 0x7f572c078790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57500d3660 0x7f57500ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57500d1a10 0x7f57500cc170 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 --2- 172.21.15.100:0/2646631104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57500b4530 0x7f575015f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 >> 172.21.15.100:0/2646631104 conn(0x7f575008eb30 msgr2=0x7f5750161240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 shutdown_connections 2024-05-09T05:05:45.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.767+0000 7f5755400640 1 -- 172.21.15.100:0/2646631104 wait complete. 2024-05-09T05:05:45.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T05:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.985+0000 7fc5fb000640 1 Processor -- start 2024-05-09T05:05:45.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.985+0000 7fc5fb000640 1 -- start start 2024-05-09T05:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.987+0000 7fc5fb000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 0x7fc5f40cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.987+0000 7fc5fb000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f40d0680 con 0x7fc5f4146c70 2024-05-09T05:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.987+0000 7fc5fb000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f40d00c0 con 0x7fc5f4161870 2024-05-09T05:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.987+0000 7fc5fb000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f40cfe70 con 0x7fc5f406cae0 2024-05-09T05:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.987+0000 7fc5f3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc5f4146c70 0x7fc5f40712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51978/0 (socket says 172.21.15.100:51978) 2024-05-09T05:05:45.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.987+0000 7fc5f3e00640 1 -- 172.21.15.100:0/3488422853 learned_addr learned my addr 172.21.15.100:0/3488422853 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986138210 0 0) 0x7fc5f40d0680 con 0x7fc5f4146c70 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f9000640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 0x7fc5f40cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5d8003520 con 0x7fc5f4146c70 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1462689816 0 0) 0x7fc5d8003520 con 0x7fc5f4146c70 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 msgr2=0x7fc5f40cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 0x7fc5f40cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 >> v1:172.21.15.133:6789/0 conn(0x7fc5f4161870 legacy=0x7fc5f406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40d03a0 con 0x7fc5f4146c70 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fc5e40016f0 con 0x7fc5f4146c70 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 >> v1:172.21.15.100:6789/0 conn(0x7fc5f4146c70 legacy=0x7fc5f40712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5d8003a80 0x7fc5d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 0x7fc5d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5d8004d40 0x7fc5d80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f40cfe70 con 0x7fc5d8004d40 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d800bb80 con 0x7fc5d8003a80 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.988+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d800bd80 con 0x7fc5f406cae0 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f9000640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5d8004d40 0x7fc5d80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f3400640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 0x7fc5d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f3e00640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5d8003a80 0x7fc5d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f9000640 1 -- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 msgr2=0x7fc5d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f9000640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f406cae0 0x7fc5d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f9000640 1 -- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5d8003a80 msgr2=0x7fc5d8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f9000640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5d8003a80 0x7fc5d8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.989+0000 7fc5f9000640 1 -- 172.21.15.100:0/3488422853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d8003520 con 0x7fc5d8004d40 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.990+0000 7fc5f9000640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5d8004d40 0x7fc5d80051a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009f90 tx=0x7fc5d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45420f89d30d27e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.990+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec009c10 con 0x7fc5d8004d40 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.990+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5ec036070 con 0x7fc5d8004d40 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.990+0000 7fc5f2a00640 1 -- 172.21.15.100:0/3488422853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec031850 con 0x7fc5d8004d40 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5fb000640 1 -- 172.21.15.100:0/3488422853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5d8004d40 msgr2=0x7fc5d80051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3488422853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5d8004d40 0x7fc5d80051a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009f90 tx=0x7fc5d8005830 comp rx=0 tx=0).stop 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5f9000640 1 -- 172.21.15.100:0/3488422853 reap_dead start 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5fb000640 1 -- 172.21.15.100:0/3488422853 shutdown_connections 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5fb000640 1 -- 172.21.15.100:0/3488422853 >> 172.21.15.100:0/3488422853 conn(0x7fc5f40b3d80 msgr2=0x7fc5f40b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5fb000640 1 -- 172.21.15.100:0/3488422853 shutdown_connections 2024-05-09T05:05:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.991+0000 7fc5fb000640 1 -- 172.21.15.100:0/3488422853 wait complete. 2024-05-09T05:05:45.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.993+0000 7fc5fb000640 1 Processor -- start 2024-05-09T05:05:45.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.993+0000 7fc5fb000640 1 -- start start 2024-05-09T05:05:45.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5fb000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 0x7fc5f41407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5fb000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f413cb10 0x7fc5f4140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5fb000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5f40b5b90 0x7fc5f40af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5fb000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f40cf930 con 0x7fc5f413c730 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5fb000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4070d90 con 0x7fc5f40b5b90 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5fb000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f40cfab0 con 0x7fc5f413cb10 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 0x7fc5f41407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 0x7fc5f41407c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51472/0 (socket says 172.21.15.100:51472) 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.994+0000 7fc5f3e00640 1 -- 172.21.15.100:0/3693641770 learned_addr learned my addr 172.21.15.100:0/3693641770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3e00640 1 -- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f413cb10 msgr2=0x7fc5f4140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3400640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f413cb10 0x7fc5f4140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3e00640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f413cb10 0x7fc5f4140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3e00640 1 -- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5f40b5b90 msgr2=0x7fc5f40af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3e00640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5f40b5b90 0x7fc5f40af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3e00640 1 -- 172.21.15.100:0/3693641770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40b60e0 con 0x7fc5f413c730 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3400640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f413cb10 0x7fc5f4140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5f3e00640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 0x7fc5f41407c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000fb0 tx=0x7fc5e400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e400c850 con 0x7fc5f413c730 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e4018070 con 0x7fc5f413c730 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f40b63c0 con 0x7fc5f413c730 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e400cc30 con 0x7fc5f413c730 2024-05-09T05:05:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.995+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f40b6980 con 0x7fc5f413c730 2024-05-09T05:05:45.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.996+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f406a630 con 0x7fc5f413c730 2024-05-09T05:05:45.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.997+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5e401d460 con 0x7fc5f413c730 2024-05-09T05:05:45.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.998+0000 7fc5ebe00640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc5d0076300 0x7fc5d00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:45.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.999+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6104+0+0 (secure 0 0 0) 0x7fc5e4097670 con 0x7fc5f413c730 2024-05-09T05:05:46.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:45.999+0000 7fc5f3400640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc5d0076300 0x7fc5d00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:46.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.000+0000 7fc5f3400640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc5d0076300 0x7fc5d00787c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc000c00 tx=0x7fc5dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:46.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.003+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc5e4060da0 con 0x7fc5f413c730 2024-05-09T05:05:46.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.228+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc5f4071630 con 0x7fc5f413c730 2024-05-09T05:05:46.229 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-05-09T05:05:46.229+0000 7f475d400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T05:05:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.232+0000 7fc5ebe00640 1 -- 172.21.15.100:0/3693641770 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7fc5e40606a0 con 0x7fc5f413c730 2024-05-09T05:05:46.233 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T05:05:46.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.235+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc5d0076300 msgr2=0x7fc5d00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:46.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.235+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc5d0076300 0x7fc5d00787c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc000c00 tx=0x7fc5dc009040 comp rx=0 tx=0).stop 2024-05-09T05:05:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.235+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 msgr2=0x7fc5f41407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.235+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 0x7fc5f41407c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000fb0 tx=0x7fc5e400ef80 comp rx=0 tx=0).stop 2024-05-09T05:05:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 shutdown_connections 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc5d0076300 0x7fc5d00787c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5f40b5b90 0x7fc5f40af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5f413cb10 0x7fc5f4140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 --2- 172.21.15.100:0/3693641770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5f413c730 0x7fc5f41407c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 >> 172.21.15.100:0/3693641770 conn(0x7fc5f40b3d80 msgr2=0x7fc5f4144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 shutdown_connections 2024-05-09T05:05:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.236+0000 7fc5fb000640 1 -- 172.21.15.100:0/3693641770 wait complete. 2024-05-09T05:05:46.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T05:05:46.304 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-05-09T05:05:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.428+0000 7f5c2be00640 1 Processor -- start 2024-05-09T05:05:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.428+0000 7f5c2be00640 1 -- start start 2024-05-09T05:05:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c15d630 0x7f5c2c0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c2c0b6980 0x7f5c2c06e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c2c06e9c0 0x7f5c2c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2c06ee70 con 0x7f5c2c0b6980 2024-05-09T05:05:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f5c2c0b5fb0 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c0b4000 con 0x7f5c2c15d630 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c2c0b6980 0x7f5c2c06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c2c0b6980 0x7f5c2c06e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51484/0 (socket says 172.21.15.100:51484) 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 -- 172.21.15.100:0/582639486 learned_addr learned my addr 172.21.15.100:0/582639486 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 -- 172.21.15.100:0/582639486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c15d630 msgr2=0x7f5c2c0b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 --2- 172.21.15.100:0/582639486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c15d630 0x7f5c2c0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 -- 172.21.15.100:0/582639486 >> v2:172.21.15.133:3300/0 conn(0x7f5c2c06e9c0 msgr2=0x7f5c2c0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2b400640 1 --2- 172.21.15.100:0/582639486 >> v2:172.21.15.133:3300/0 conn(0x7f5c2c06e9c0 0x7f5c2c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.430+0000 7f5c2a000640 1 --2- 172.21.15.100:0/582639486 >> v2:172.21.15.133:3300/0 conn(0x7f5c2c06e9c0 0x7f5c2c0721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.431+0000 7f5c2a000640 1 -- 172.21.15.100:0/582639486 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c06f090 con 0x7f5c2c0b6980 2024-05-09T05:05:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.432+0000 7f5c2a000640 1 --2- 172.21.15.100:0/582639486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c0b6980 0x7f5c2c06e480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c160ae0 tx=0x7f5c1802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3a579e03b492df server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.432+0000 7f5c29600640 1 -- 172.21.15.100:0/582639486 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18037070 con 0x7f5c2c0b6980 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.432+0000 7f5c29600640 1 -- 172.21.15.100:0/582639486 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c18032440 con 0x7f5c2c0b6980 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.432+0000 7f5c29600640 1 -- 172.21.15.100:0/582639486 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c18032810 con 0x7f5c2c0b6980 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 -- 172.21.15.100:0/582639486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c0b6980 msgr2=0x7f5c2c06e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 --2- 172.21.15.100:0/582639486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c0b6980 0x7f5c2c06e480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c160ae0 tx=0x7f5c1802a210 comp rx=0 tx=0).stop 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 -- 172.21.15.100:0/582639486 shutdown_connections 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 --2- 172.21.15.100:0/582639486 >> v2:172.21.15.133:3300/0 conn(0x7f5c2c06e9c0 0x7f5c2c0721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 --2- 172.21.15.100:0/582639486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c0b6980 0x7f5c2c06e480 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 --2- 172.21.15.100:0/582639486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c15d630 0x7f5c2c0b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 -- 172.21.15.100:0/582639486 >> 172.21.15.100:0/582639486 conn(0x7f5c2c0b29b0 msgr2=0x7f5c2c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 -- 172.21.15.100:0/582639486 shutdown_connections 2024-05-09T05:05:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.433+0000 7f5c2be00640 1 -- 172.21.15.100:0/582639486 wait complete. 2024-05-09T05:05:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.435+0000 7f5c2be00640 1 Processor -- start 2024-05-09T05:05:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.435+0000 7f5c2be00640 1 -- start start 2024-05-09T05:05:46.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 0x7f5c2c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c0b6980 0x7f5c2c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c2c15d630 0x7f5c2c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c0b5c40 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5c2c0b5960 con 0x7f5c2c15d630 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5c2c072720 con 0x7f5c2c0b6980 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 0x7f5c2c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 0x7f5c2c152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51500/0 (socket says 172.21.15.100:51500) 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 -- 172.21.15.100:0/2214845728 learned_addr learned my addr 172.21.15.100:0/2214845728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 -- 172.21.15.100:0/2214845728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c0b6980 msgr2=0x7f5c2c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c0b6980 0x7f5c2c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 -- 172.21.15.100:0/2214845728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c2c15d630 msgr2=0x7f5c2c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c2c15d630 0x7f5c2c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.436+0000 7f5c2aa00640 1 -- 172.21.15.100:0/2214845728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c2c152a70 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.437+0000 7f5c2aa00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 0x7f5c2c152240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00b4d0 tx=0x7f5c1c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.437+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c014070 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.437+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c1c010870 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.437+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2c152d50 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.437+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c010c60 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.437+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2c153310 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.438+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c2c06a550 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.439+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c1c017070 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.440+0000 7f5c22a00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5c0c0762d0 0x7f5c0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.440+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6190+0+0 (secure 0 0 0) 0x7f5c1c097640 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.441+0000 7f5c2a000640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5c0c0762d0 0x7f5c0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:46.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.441+0000 7f5c2a000640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5c0c0762d0 0x7f5c0c078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c18034000 tx=0x7f5c1802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:46.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.445+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c1c060d20 con 0x7f5c2c06e9c0 2024-05-09T05:05:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:46.671+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5c2c0ae880 con 0x7f5c2c06e9c0 2024-05-09T05:05:47.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.236+0000 7f5c22a00640 1 -- 172.21.15.100:0/2214845728 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f5c1c060620 con 0x7f5c2c06e9c0 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5c0c0762d0 msgr2=0x7f5c0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5c0c0762d0 0x7f5c0c078790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c18034000 tx=0x7f5c1802c000 comp rx=0 tx=0).stop 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 msgr2=0x7f5c2c152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 0x7f5c2c152240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00b4d0 tx=0x7f5c1c00b990 comp rx=0 tx=0).stop 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 shutdown_connections 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5c0c0762d0 0x7f5c0c078790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c2c15d630 0x7f5c2c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c2c0b6980 0x7f5c2c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 --2- 172.21.15.100:0/2214845728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c2c06e9c0 0x7f5c2c152240 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 >> 172.21.15.100:0/2214845728 conn(0x7f5c2c0b29b0 msgr2=0x7f5c2c0b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:47.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.240+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 shutdown_connections 2024-05-09T05:05:47.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.241+0000 7f5c2be00640 1 -- 172.21.15.100:0/2214845728 wait complete. 2024-05-09T05:05:47.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T05:05:47.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.464+0000 7fe8a9200640 1 Processor -- start 2024-05-09T05:05:47.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.464+0000 7fe8a9200640 1 -- start start 2024-05-09T05:05:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a9200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8a41574e0 0x7fe8a40b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a9200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8a4161780 0x7fe8a40b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a9200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a415e290 con 0x7fe8a415d510 2024-05-09T05:05:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a9200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a4160ca0 con 0x7fe8a41574e0 2024-05-09T05:05:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a9200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a4160f80 con 0x7fe8a4161780 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8a41574e0 0x7fe8a40b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8a41574e0 0x7fe8a40b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51506/0 (socket says 172.21.15.100:51506) 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.466+0000 7fe8a3400640 1 -- 172.21.15.100:0/518386040 learned_addr learned my addr 172.21.15.100:0/518386040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.467+0000 7fe8a3400640 1 -- 172.21.15.100:0/518386040 >> v2:172.21.15.133:3300/0 conn(0x7fe8a4161780 msgr2=0x7fe8a40b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.467+0000 7fe8a3400640 1 --2- 172.21.15.100:0/518386040 >> v2:172.21.15.133:3300/0 conn(0x7fe8a4161780 0x7fe8a40b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.467+0000 7fe8a3400640 1 -- 172.21.15.100:0/518386040 >> v1:172.21.15.133:6789/0 conn(0x7fe8a415d510 legacy=0x7fe8a415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.467+0000 7fe8a3400640 1 -- 172.21.15.100:0/518386040 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a4161260 con 0x7fe8a41574e0 2024-05-09T05:05:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.468+0000 7fe8a3400640 1 --2- 172.21.15.100:0/518386040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a40b6210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7777ca9ad5918d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:47.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.468+0000 7fe8a2a00640 1 -- 172.21.15.100:0/518386040 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894037070 con 0x7fe8a41574e0 2024-05-09T05:05:47.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.468+0000 7fe8a2a00640 1 -- 172.21.15.100:0/518386040 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe894032440 con 0x7fe8a41574e0 2024-05-09T05:05:47.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.468+0000 7fe8a2a00640 1 -- 172.21.15.100:0/518386040 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894032810 con 0x7fe8a41574e0 2024-05-09T05:05:47.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 -- 172.21.15.100:0/518386040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 msgr2=0x7fe8a40b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:47.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 --2- 172.21.15.100:0/518386040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a40b6210 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe89402a210 comp rx=0 tx=0).stop 2024-05-09T05:05:47.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 -- 172.21.15.100:0/518386040 shutdown_connections 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 --2- 172.21.15.100:0/518386040 >> v2:172.21.15.133:3300/0 conn(0x7fe8a4161780 0x7fe8a40b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 --2- 172.21.15.100:0/518386040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a40b6210 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 -- 172.21.15.100:0/518386040 >> 172.21.15.100:0/518386040 conn(0x7fe8a406c3d0 msgr2=0x7fe8a406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 -- 172.21.15.100:0/518386040 shutdown_connections 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.469+0000 7fe8a9200640 1 -- 172.21.15.100:0/518386040 wait complete. 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.471+0000 7fe8a9200640 1 Processor -- start 2024-05-09T05:05:47.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.471+0000 7fe8a9200640 1 -- start start 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a41f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8a415d510 0x7fe8a4148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a9200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8a4161780 0x7fe8a40b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a9200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40733e0 con 0x7fe8a41574e0 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a9200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a4073260 con 0x7fe8a415d510 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a9200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a4073560 con 0x7fe8a4161780 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a41f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a41f9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51522/0 (socket says 172.21.15.100:51522) 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 -- 172.21.15.100:0/567787685 learned_addr learned my addr 172.21.15.100:0/567787685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:47.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 -- 172.21.15.100:0/567787685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8a4161780 msgr2=0x7fe8a40b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8a4161780 0x7fe8a40b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 -- 172.21.15.100:0/567787685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8a415d510 msgr2=0x7fe8a4148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8a415d510 0x7fe8a4148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.472+0000 7fe8a3400640 1 -- 172.21.15.100:0/567787685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40b13c0 con 0x7fe8a41574e0 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.473+0000 7fe8a3400640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a41f9b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe8940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.473+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894041070 con 0x7fe8a41574e0 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.473+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89403c870 con 0x7fe8a41574e0 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.473+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894037040 con 0x7fe8a41574e0 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.473+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a40b16a0 con 0x7fe8a41574e0 2024-05-09T05:05:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.473+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a4159010 con 0x7fe8a41574e0 2024-05-09T05:05:47.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.474+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a406a630 con 0x7fe8a41574e0 2024-05-09T05:05:47.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.475+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe894044070 con 0x7fe8a41574e0 2024-05-09T05:05:47.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.476+0000 7fe89b400640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe8800762d0 0x7fe880078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:47.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.476+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6190+0+0 (secure 0 0 0) 0x7fe8940b82c0 con 0x7fe8a41574e0 2024-05-09T05:05:47.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.476+0000 7fe89be00640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe8800762d0 0x7fe880078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:47.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.477+0000 7fe89be00640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe8800762d0 0x7fe880078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40b0a10 tx=0x7fe88c006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:47.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.480+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe894081a40 con 0x7fe8a41574e0 2024-05-09T05:05:47.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:47.685+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8a4072d80 con 0x7fe8a41574e0 2024-05-09T05:05:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.240+0000 7fe89b400640 1 -- 172.21.15.100:0/567787685 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7fe894081340 con 0x7fe8a41574e0 2024-05-09T05:05:48.241 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-05-09T05:05:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.243+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe8800762d0 msgr2=0x7fe880078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.243+0000 7fe8a9200640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe8800762d0 0x7fe880078790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40b0a10 tx=0x7fe88c006bf0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.243+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 msgr2=0x7fe8a41f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.243+0000 7fe8a9200640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a41f9b20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe894009870 tx=0x7fe8940046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 shutdown_connections 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fe8800762d0 0x7fe880078790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8a4161780 0x7fe8a40b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8a415d510 0x7fe8a4148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 --2- 172.21.15.100:0/567787685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8a41574e0 0x7fe8a41f9b20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 >> 172.21.15.100:0/567787685 conn(0x7fe8a406c3d0 msgr2=0x7fe8a415b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:48.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.244+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 shutdown_connections 2024-05-09T05:05:48.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.245+0000 7fe8a9200640 1 -- 172.21.15.100:0/567787685 wait complete. 2024-05-09T05:05:48.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T05:05:48.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.460+0000 7fa8c1c00640 1 Processor -- start 2024-05-09T05:05:48.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.461+0000 7fa8c1c00640 1 -- start start 2024-05-09T05:05:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.462+0000 7fa8c1c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8bc06f510 0x7fa8bc164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.462+0000 7fa8c1c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc15d5c0 con 0x7fa8bc0d0760 2024-05-09T05:05:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.462+0000 7fa8c1c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc072c90 con 0x7fa8bc0d01e0 2024-05-09T05:05:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.462+0000 7fa8c1c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fa8bc0d05c0 con 0x7fa8bc06f510 2024-05-09T05:05:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.463+0000 7fa8bb400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa8bc0d0760 0x7fa8bc167220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51982/0 (socket says 172.21.15.100:51982) 2024-05-09T05:05:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.463+0000 7fa8bb400640 1 -- 172.21.15.100:0/935610462 learned_addr learned my addr 172.21.15.100:0/935610462 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.463+0000 7fa8b3e00640 1 --2- 172.21.15.100:0/935610462 >> v2:172.21.15.133:3300/0 conn(0x7fa8bc06f510 0x7fa8bc164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.463+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887968416 0 0) 0x7fa8bc15d5c0 con 0x7fa8bc0d0760 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.463+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a0003520 con 0x7fa8bc0d0760 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3020084060 0 0) 0x7fa8a0003520 con 0x7fa8bc0d0760 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 >> v2:172.21.15.133:3300/0 conn(0x7fa8bc06f510 msgr2=0x7fa8bc164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 --2- 172.21.15.100:0/935610462 >> v2:172.21.15.133:3300/0 conn(0x7fa8bc06f510 0x7fa8bc164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 >> v1:172.21.15.133:6789/0 conn(0x7fa8bc0d01e0 legacy=0x7fa8bc0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc072f70 con 0x7fa8bc0d0760 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fa8b4001a70 con 0x7fa8bc0d0760 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 >> v1:172.21.15.100:6789/0 conn(0x7fa8bc0d0760 legacy=0x7fa8bc167220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8a0003a50 0x7fa8a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8a0004800 0x7fa8a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0d05c0 con 0x7fa8a00051c0 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a000c160 con 0x7fa8a0004800 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa8a000c360 con 0x7fa8a0003a50 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8bb400640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8bb400640 1 -- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8a0003a50 msgr2=0x7fa8a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.464+0000 7fa8baa00640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8a0003a50 0x7fa8a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8bb400640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8a0003a50 0x7fa8a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8b3e00640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8a0004800 0x7fa8a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8bb400640 1 -- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8a0004800 msgr2=0x7fa8a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8bb400640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8a0004800 0x7fa8a0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8bb400640 1 -- 172.21.15.100:0/935610462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a0003520 con 0x7fa8a00051c0 2024-05-09T05:05:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8baa00640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8a0003a50 0x7fa8a0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.465+0000 7fa8bb400640 1 -- 172.21.15.100:0/935610462 reap_dead start 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.466+0000 7fa8bb400640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8a000b9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400a850 tx=0x7fa8a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b8b89edbe11af4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.466+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400a4a0 con 0x7fa8a00051c0 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.466+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b402f070 con 0x7fa8a00051c0 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.466+0000 7fa8ba000640 1 -- 172.21.15.100:0/935610462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b402bc30 con 0x7fa8a00051c0 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 -- 172.21.15.100:0/935610462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 msgr2=0x7fa8a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8a000b9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400a850 tx=0x7fa8a0005830 comp rx=0 tx=0).stop 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 -- 172.21.15.100:0/935610462 shutdown_connections 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/935610462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8a000b9c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 -- 172.21.15.100:0/935610462 >> 172.21.15.100:0/935610462 conn(0x7fa8bc0b2c20 msgr2=0x7fa8bc0b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 -- 172.21.15.100:0/935610462 shutdown_connections 2024-05-09T05:05:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.467+0000 7fa8c1c00640 1 -- 172.21.15.100:0/935610462 wait complete. 2024-05-09T05:05:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.468+0000 7fa8c1c00640 1 Processor -- start 2024-05-09T05:05:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.469+0000 7fa8c1c00640 1 -- start start 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8c1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8bc1f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8c1c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8bc0cecd0 0x7fa8bc09e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8c1c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8bc09e680 0x7fa8bc15f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8c1c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc073810 con 0x7fa8a00051c0 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8c1c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc073530 con 0x7fa8bc09e680 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8c1c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc072980 con 0x7fa8bc0cecd0 2024-05-09T05:05:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8bc1f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8bc1f4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51544/0 (socket says 172.21.15.100:51544) 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8baa00640 1 -- 172.21.15.100:0/2265427661 learned_addr learned my addr 172.21.15.100:0/2265427661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8b3e00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8bc0cecd0 0x7fa8bc09e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.470+0000 7fa8bb400640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8bc09e680 0x7fa8bc15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8baa00640 1 -- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8bc0cecd0 msgr2=0x7fa8bc09e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8baa00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8bc0cecd0 0x7fa8bc09e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8baa00640 1 -- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8bc09e680 msgr2=0x7fa8bc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8baa00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8bc09e680 0x7fa8bc15f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:48.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8baa00640 1 -- 172.21.15.100:0/2265427661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc09ba10 con 0x7fa8a00051c0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8baa00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8bc1f4b20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00d7d0 tx=0x7fa8ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac005270 con 0x7fa8a00051c0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac017070 con 0x7fa8a00051c0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00b6b0 con 0x7fa8a00051c0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc09bcf0 con 0x7fa8a00051c0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.471+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc09c2b0 con 0x7fa8a00051c0 2024-05-09T05:05:48.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.472+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc09ea90 con 0x7fa8a00051c0 2024-05-09T05:05:48.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.474+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8ac00b850 con 0x7fa8a00051c0 2024-05-09T05:05:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.475+0000 7fa8b2a00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8980762d0 0x7fa898078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.475+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5752+0+0 (secure 0 0 0) 0x7fa8ac0974f0 con 0x7fa8a00051c0 2024-05-09T05:05:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.475+0000 7fa8b3e00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8980762d0 0x7fa898078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:48.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.476+0000 7fa8b3e00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8980762d0 0x7fa898078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc09f220 tx=0x7fa8a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:48.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.479+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8bc09ea90 con 0x7fa8a00051c0 2024-05-09T05:05:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:48.688+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa8bc15cda0 con 0x7fa8a00051c0 2024-05-09T05:05:49.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.256+0000 7fa8b2a00640 1 -- 172.21.15.100:0/2265427661 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7fa8ac060e10 con 0x7fa8a00051c0 2024-05-09T05:05:49.257 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.260+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8980762d0 msgr2=0x7fa898078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.260+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8980762d0 0x7fa898078790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc09f220 tx=0x7fa8a4008040 comp rx=0 tx=0).stop 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.260+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 msgr2=0x7fa8bc1f4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.260+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8bc1f4b20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00d7d0 tx=0x7fa8ac00dc90 comp rx=0 tx=0).stop 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 shutdown_connections 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa8980762d0 0x7fa898078790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8bc09e680 0x7fa8bc15f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8bc0cecd0 0x7fa8bc09e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 --2- 172.21.15.100:0/2265427661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a00051c0 0x7fa8bc1f4b20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 >> 172.21.15.100:0/2265427661 conn(0x7fa8bc0b2c20 msgr2=0x7fa8bc0b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 shutdown_connections 2024-05-09T05:05:49.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.261+0000 7fa8c1c00640 1 -- 172.21.15.100:0/2265427661 wait complete. 2024-05-09T05:05:49.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2024-05-09T05:05:49.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.476+0000 7f5393e00640 1 Processor -- start 2024-05-09T05:05:49.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.476+0000 7f5393e00640 1 -- start start 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5393e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53941574e0 0x7f53940b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5393e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5394161780 0x7f53940b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5393e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f539415d510 0x7f539415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5393e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f539415e290 con 0x7f5394161780 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5393e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f5394160ca0 con 0x7f53941574e0 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5393e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5394160f80 con 0x7f539415d510 2024-05-09T05:05:49.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5394161780 0x7f53940b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5394161780 0x7f53940b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51550/0 (socket says 172.21.15.100:51550) 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 -- 172.21.15.100:0/783063479 learned_addr learned my addr 172.21.15.100:0/783063479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f5392a00640 1 --2- 172.21.15.100:0/783063479 >> v2:172.21.15.133:3300/0 conn(0x7f53941574e0 0x7f53940b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 -- 172.21.15.100:0/783063479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f539415d510 msgr2=0x7f539415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 --2- 172.21.15.100:0/783063479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f539415d510 0x7f539415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 -- 172.21.15.100:0/783063479 >> v2:172.21.15.133:3300/0 conn(0x7f53941574e0 msgr2=0x7f53940b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 --2- 172.21.15.100:0/783063479 >> v2:172.21.15.133:3300/0 conn(0x7f53941574e0 0x7f53940b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.478+0000 7f538a000640 1 -- 172.21.15.100:0/783063479 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5394161260 con 0x7f5394161780 2024-05-09T05:05:49.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.479+0000 7f538a000640 1 --2- 172.21.15.100:0/783063479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5394161780 0x7f53940b6750 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f537c009870 tx=0x7f537c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea82997e9e73c39 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:49.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.480+0000 7f5392000640 1 -- 172.21.15.100:0/783063479 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c037070 con 0x7f5394161780 2024-05-09T05:05:49.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.480+0000 7f5392000640 1 -- 172.21.15.100:0/783063479 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c032440 con 0x7f5394161780 2024-05-09T05:05:49.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.480+0000 7f5392000640 1 -- 172.21.15.100:0/783063479 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c032810 con 0x7f5394161780 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.480+0000 7f5393e00640 1 -- 172.21.15.100:0/783063479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5394161780 msgr2=0x7f53940b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.480+0000 7f5393e00640 1 --2- 172.21.15.100:0/783063479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5394161780 0x7f53940b6750 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f537c009870 tx=0x7f537c02a210 comp rx=0 tx=0).stop 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 -- 172.21.15.100:0/783063479 shutdown_connections 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 --2- 172.21.15.100:0/783063479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f539415d510 0x7f539415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 --2- 172.21.15.100:0/783063479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5394161780 0x7f53940b6750 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 --2- 172.21.15.100:0/783063479 >> v2:172.21.15.133:3300/0 conn(0x7f53941574e0 0x7f53940b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 -- 172.21.15.100:0/783063479 >> 172.21.15.100:0/783063479 conn(0x7f539406c3d0 msgr2=0x7f539406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 -- 172.21.15.100:0/783063479 shutdown_connections 2024-05-09T05:05:49.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.481+0000 7f5393e00640 1 -- 172.21.15.100:0/783063479 wait complete. 2024-05-09T05:05:49.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.482+0000 7f5393e00640 1 Processor -- start 2024-05-09T05:05:49.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.483+0000 7f5393e00640 1 -- start start 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.483+0000 7f5393e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 0x7f539414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5393e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539415d510 0x7f53940ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5393e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5394161780 0x7f539415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5393e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53941578c0 con 0x7f53941574e0 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5393e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5394073260 con 0x7f539415d510 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5393e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f539414bd90 con 0x7f5394161780 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 0x7f539414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 0x7f539414b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51564/0 (socket says 172.21.15.100:51564) 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 -- 172.21.15.100:0/4222921083 learned_addr learned my addr 172.21.15.100:0/4222921083 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 -- 172.21.15.100:0/4222921083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5394161780 msgr2=0x7f539415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5394161780 0x7f539415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 -- 172.21.15.100:0/4222921083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539415d510 msgr2=0x7f53940ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539415d510 0x7f53940ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 -- 172.21.15.100:0/4222921083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53940af340 con 0x7f53941574e0 2024-05-09T05:05:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.484+0000 7f5392a00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 0x7f539414b850 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f538400c7f0 tx=0x7f538400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:49.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.485+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384015070 con 0x7f53941574e0 2024-05-09T05:05:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.485+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5384004240 con 0x7f53941574e0 2024-05-09T05:05:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.485+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384003610 con 0x7f53941574e0 2024-05-09T05:05:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.485+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53940af620 con 0x7f53941574e0 2024-05-09T05:05:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.485+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53940afbe0 con 0x7f53941574e0 2024-05-09T05:05:49.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.486+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539406a630 con 0x7f53941574e0 2024-05-09T05:05:49.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.487+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f53840037b0 con 0x7f53941574e0 2024-05-09T05:05:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.488+0000 7f538b400640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f53700762d0 0x7f5370078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.488+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5338+0+0 (secure 0 0 0) 0x7f5384097610 con 0x7f53941574e0 2024-05-09T05:05:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.489+0000 7f538a000640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f53700762d0 0x7f5370078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:49.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.489+0000 7f538a000640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f53700762d0 0x7f5370078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f537c034000 tx=0x7f537c02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:49.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.493+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5384061170 con 0x7f53941574e0 2024-05-09T05:05:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:49.701+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5394072d80 con 0x7f53941574e0 2024-05-09T05:05:50.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.270+0000 7f538b400640 1 -- 172.21.15.100:0/4222921083 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v39) ==== 160+0+0 (secure 0 0 0) 0x7f5384069160 con 0x7f53941574e0 2024-05-09T05:05:50.271 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'data_new' removed 2024-05-09T05:05:50.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f53700762d0 msgr2=0x7f5370078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f53700762d0 0x7f5370078790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f537c034000 tx=0x7f537c02c000 comp rx=0 tx=0).stop 2024-05-09T05:05:50.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 msgr2=0x7f539414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 0x7f539414b850 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f538400c7f0 tx=0x7f538400ccb0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 shutdown_connections 2024-05-09T05:05:50.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f53700762d0 0x7f5370078790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5394161780 0x7f539415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539415d510 0x7f53940ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 --2- 172.21.15.100:0/4222921083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f53941574e0 0x7f539414b850 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.274+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 >> 172.21.15.100:0/4222921083 conn(0x7f539406c3d0 msgr2=0x7f539415e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.276+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 shutdown_connections 2024-05-09T05:05:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.276+0000 7f5393e00640 1 -- 172.21.15.100:0/4222921083 wait complete. 2024-05-09T05:05:50.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_symlink_recovery 2024-05-09T05:05:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.495+0000 7fc030a00640 1 Processor -- start 2024-05-09T05:05:50.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.496+0000 7fc030a00640 1 -- start start 2024-05-09T05:05:50.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.497+0000 7fc030a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc02c0cef60 0x7fc02c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.497+0000 7fc030a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc02c06edf0 0x7fc02c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.497+0000 7fc030a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02c0721e0 con 0x7fc02c1458f0 2024-05-09T05:05:50.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.497+0000 7fc030a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc02c06f600 con 0x7fc02c0cef60 2024-05-09T05:05:50.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.497+0000 7fc030a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fc02c06f8e0 con 0x7fc02c06edf0 2024-05-09T05:05:50.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc023e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc02c0cef60 0x7fc02c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc02a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc02c1458f0 0x7fc02c0ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51990/0 (socket says 172.21.15.100:51990) 2024-05-09T05:05:50.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc02a800640 1 -- 172.21.15.100:0/3367085601 learned_addr learned my addr 172.21.15.100:0/3367085601 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:50.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc02b200640 1 --2- 172.21.15.100:0/3367085601 >> v2:172.21.15.133:3300/0 conn(0x7fc02c06edf0 0x7fc02c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc023e00640 1 -- 172.21.15.100:0/3367085601 >> v2:172.21.15.133:3300/0 conn(0x7fc02c06edf0 msgr2=0x7fc02c0726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc023e00640 1 --2- 172.21.15.100:0/3367085601 >> v2:172.21.15.133:3300/0 conn(0x7fc02c06edf0 0x7fc02c0726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc023e00640 1 -- 172.21.15.100:0/3367085601 >> v1:172.21.15.100:6789/0 conn(0x7fc02c1458f0 legacy=0x7fc02c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc029e00640 1 -- 172.21.15.100:0/3367085601 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101037213 0 0) 0x7fc02c0721e0 con 0x7fc02c1458f0 2024-05-09T05:05:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.498+0000 7fc023e00640 1 -- 172.21.15.100:0/3367085601 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c06fbc0 con 0x7fc02c0cef60 2024-05-09T05:05:50.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.500+0000 7fc023e00640 1 --2- 172.21.15.100:0/3367085601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c06e8b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0ce1e0 tx=0x7fc01402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db1f06de37992f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.500+0000 7fc029e00640 1 -- 172.21.15.100:0/3367085601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014037070 con 0x7fc02c0cef60 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.500+0000 7fc029e00640 1 -- 172.21.15.100:0/3367085601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014032440 con 0x7fc02c0cef60 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.500+0000 7fc029e00640 1 -- 172.21.15.100:0/3367085601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01402ae60 con 0x7fc02c0cef60 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.500+0000 7fc030a00640 1 -- 172.21.15.100:0/3367085601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 msgr2=0x7fc02c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.500+0000 7fc030a00640 1 --2- 172.21.15.100:0/3367085601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c06e8b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0ce1e0 tx=0x7fc01402a110 comp rx=0 tx=0).stop 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.501+0000 7fc030a00640 1 -- 172.21.15.100:0/3367085601 shutdown_connections 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.501+0000 7fc030a00640 1 --2- 172.21.15.100:0/3367085601 >> v2:172.21.15.133:3300/0 conn(0x7fc02c06edf0 0x7fc02c0726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.501+0000 7fc030a00640 1 --2- 172.21.15.100:0/3367085601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c06e8b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.501+0000 7fc030a00640 1 -- 172.21.15.100:0/3367085601 >> 172.21.15.100:0/3367085601 conn(0x7fc02c0b29b0 msgr2=0x7fc02c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.501+0000 7fc030a00640 1 -- 172.21.15.100:0/3367085601 shutdown_connections 2024-05-09T05:05:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.501+0000 7fc030a00640 1 -- 172.21.15.100:0/3367085601 wait complete. 2024-05-09T05:05:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.502+0000 7fc030a00640 1 Processor -- start 2024-05-09T05:05:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.503+0000 7fc030a00640 1 -- start start 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.503+0000 7fc030a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc02c06edf0 0x7fc02c141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.503+0000 7fc030a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c0b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc030a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc02c1458f0 0x7fc02c143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc030a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c06f3a0 con 0x7fc02c0cef60 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc030a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c06f220 con 0x7fc02c06edf0 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc030a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c072c20 con 0x7fc02c1458f0 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c0b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c0b63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51588/0 (socket says 172.21.15.100:51588) 2024-05-09T05:05:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 -- 172.21.15.100:0/814842933 learned_addr learned my addr 172.21.15.100:0/814842933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc02a800640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc02c06edf0 0x7fc02c141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 -- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc02c1458f0 msgr2=0x7fc02c143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc02b200640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc02c1458f0 0x7fc02c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc02c1458f0 0x7fc02c143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 -- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc02c06edf0 msgr2=0x7fc02c141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc02c06edf0 0x7fc02c141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc023e00640 1 -- 172.21.15.100:0/814842933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c1424d0 con 0x7fc02c0cef60 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.504+0000 7fc02a800640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc02c06edf0 0x7fc02c141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.505+0000 7fc023e00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c0b63e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc014035040 tx=0x7fc0140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.505+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014037050 con 0x7fc02c0cef60 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.505+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014038040 con 0x7fc02c0cef60 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.505+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014004470 con 0x7fc02c0cef60 2024-05-09T05:05:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.505+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c1609e0 con 0x7fc02c0cef60 2024-05-09T05:05:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.505+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c161280 con 0x7fc02c0cef60 2024-05-09T05:05:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.507+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c160dd0 con 0x7fc02c0cef60 2024-05-09T05:05:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.508+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc014030900 con 0x7fc02c0cef60 2024-05-09T05:05:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.509+0000 7fc022a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc0080762d0 0x7fc008078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.509+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fc0140b7e00 con 0x7fc02c0cef60 2024-05-09T05:05:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.509+0000 7fc02a800640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc0080762d0 0x7fc008078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.510+0000 7fc02a800640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc0080762d0 0x7fc008078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000f60 tx=0x7fc01c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.513+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc014081a50 con 0x7fc02c0cef60 2024-05-09T05:05:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.719+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"} v 0) -- 0x7fc02c0b04e0 con 0x7fc02c0cef60 2024-05-09T05:05:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.726+0000 7fc022a00640 1 -- 172.21.15.100:0/814842933 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"}]=0 v13) ==== 103+0+0 (secure 0 0 0) 0x7fc014081350 con 0x7fc02c0cef60 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc0080762d0 msgr2=0x7fc008078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc0080762d0 0x7fc008078790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000f60 tx=0x7fc01c009040 comp rx=0 tx=0).stop 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 msgr2=0x7fc02c0b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c0b63e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc014035040 tx=0x7fc0140046c0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 shutdown_connections 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc0080762d0 0x7fc008078790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc02c1458f0 0x7fc02c143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc02c0cef60 0x7fc02c0b63e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 --2- 172.21.15.100:0/814842933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc02c06edf0 0x7fc02c141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 >> 172.21.15.100:0/814842933 conn(0x7fc02c0b29b0 msgr2=0x7fc02c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 shutdown_connections 2024-05-09T05:05:50.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.729+0000 7fc030a00640 1 -- 172.21.15.100:0/814842933 wait complete. 2024-05-09T05:05:50.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-09T05:05:50.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.950+0000 7ff931000640 1 Processor -- start 2024-05-09T05:05:50.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.950+0000 7ff931000640 1 -- start start 2024-05-09T05:05:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.951+0000 7ff931000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 0x7ff92c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.951+0000 7ff931000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c160240 con 0x7ff92c1599d0 2024-05-09T05:05:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.951+0000 7ff931000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c160520 con 0x7ff92c15d670 2024-05-09T05:05:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.951+0000 7ff931000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c160800 con 0x7ff92c06fca0 2024-05-09T05:05:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff92c1599d0 0x7ff92c06f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52004/0 (socket says 172.21.15.100:52004) 2024-05-09T05:05:50.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92b400640 1 -- 172.21.15.100:0/3665173540 learned_addr learned my addr 172.21.15.100:0/3665173540 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277593877 0 0) 0x7ff92c160240 con 0x7ff92c1599d0 2024-05-09T05:05:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff910003520 con 0x7ff92c1599d0 2024-05-09T05:05:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff923e00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 0x7ff92c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2121135096 0 0) 0x7ff910003520 con 0x7ff92c1599d0 2024-05-09T05:05:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 msgr2=0x7ff92c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92aa00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 0x7ff92c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.952+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 >> v1:172.21.15.133:6789/0 conn(0x7ff92c15d670 legacy=0x7ff92c0cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c0cf6b0 con 0x7ff92c1599d0 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7ff91c0016f0 con 0x7ff92c1599d0 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 >> v1:172.21.15.100:6789/0 conn(0x7ff92c1599d0 legacy=0x7ff92c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff910003a30 0x7ff910003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff910004800 0x7ff910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 0x7ff91000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c160800 con 0x7ff910003a30 2024-05-09T05:05:50.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff910005520 con 0x7ff910004800 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff91000e110 con 0x7ff92c06fca0 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92b400640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff910003a30 0x7ff910003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff923e00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff910004800 0x7ff910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92be00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 0x7ff91000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92b400640 1 -- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 msgr2=0x7ff91000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92b400640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff92c06fca0 0x7ff91000dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92b400640 1 -- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff910004800 msgr2=0x7ff910004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92b400640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff910004800 0x7ff910004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.953+0000 7ff92b400640 1 -- 172.21.15.100:0/3665173540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff910003520 con 0x7ff910003a30 2024-05-09T05:05:50.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.954+0000 7ff923e00640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff910004800 0x7ff910004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:50.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.954+0000 7ff92b400640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff910003a30 0x7ff910003e30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00c190 tx=0x7ff910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df03367a9bd225cd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c007cc0 con 0x7ff910003a30 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91c005ad0 con 0x7ff910003a30 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff92aa00640 1 -- 172.21.15.100:0/3665173540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c007070 con 0x7ff910003a30 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff931000640 1 -- 172.21.15.100:0/3665173540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff910003a30 msgr2=0x7ff910003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff931000640 1 --2- 172.21.15.100:0/3665173540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff910003a30 0x7ff910003e30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00c190 tx=0x7ff910005830 comp rx=0 tx=0).stop 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff92be00640 1 -- 172.21.15.100:0/3665173540 reap_dead start 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff931000640 1 -- 172.21.15.100:0/3665173540 shutdown_connections 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.955+0000 7ff931000640 1 -- 172.21.15.100:0/3665173540 >> 172.21.15.100:0/3665173540 conn(0x7ff92c0b29b0 msgr2=0x7ff92c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.956+0000 7ff931000640 1 -- 172.21.15.100:0/3665173540 shutdown_connections 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.956+0000 7ff931000640 1 -- 172.21.15.100:0/3665173540 wait complete. 2024-05-09T05:05:50.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.957+0000 7ff931000640 1 Processor -- start 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.958+0000 7ff931000640 1 -- start start 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.958+0000 7ff931000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff910003a30 0x7ff92c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.958+0000 7ff931000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff92c0b6a90 0x7ff92c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff931000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 0x7ff92c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff931000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c15d1b0 con 0x7ff92c0b4b90 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff931000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c15d030 con 0x7ff92c0b6a90 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff931000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff92c15d330 con 0x7ff910003a30 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 0x7ff92c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 0x7ff92c15b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51614/0 (socket says 172.21.15.100:51614) 2024-05-09T05:05:50.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 -- 172.21.15.100:0/2750393891 learned_addr learned my addr 172.21.15.100:0/2750393891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92b400640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff910003a30 0x7ff92c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff923e00640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff92c0b6a90 0x7ff92c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 -- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff910003a30 msgr2=0x7ff92c0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff910003a30 0x7ff92c0ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 -- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff92c0b6a90 msgr2=0x7ff92c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff92c0b6a90 0x7ff92c0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff92be00640 1 -- 172.21.15.100:0/2750393891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c1f5be0 con 0x7ff92c0b4b90 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.959+0000 7ff923e00640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff92c0b6a90 0x7ff92c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.960+0000 7ff92be00640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 0x7ff92c15b140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0b4200 tx=0x7ff92400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.960+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924004b70 con 0x7ff92c0b4b90 2024-05-09T05:05:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.960+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff924004d10 con 0x7ff92c0b4b90 2024-05-09T05:05:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.960+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c1f5060 con 0x7ff92c0b4b90 2024-05-09T05:05:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.960+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924005270 con 0x7ff92c0b4b90 2024-05-09T05:05:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.960+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92c1f5620 con 0x7ff92c0b4b90 2024-05-09T05:05:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.961+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c06a550 con 0x7ff92c0b4b90 2024-05-09T05:05:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.962+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff924005410 con 0x7ff92c0b4b90 2024-05-09T05:05:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.963+0000 7ff923400640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff908076300 0x7ff9080787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.963+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7ff9240970e0 con 0x7ff92c0b4b90 2024-05-09T05:05:50.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.964+0000 7ff92b400640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff908076300 0x7ff9080787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:50.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.964+0000 7ff92b400640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff908076300 0x7ff9080787c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff91c032000 tx=0x7ff91c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:50.968+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff924016020 con 0x7ff92c0b4b90 2024-05-09T05:05:51.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.180+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff92c070380 con 0x7ff92c0b4b90 2024-05-09T05:05:51.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.185+0000 7ff923400640 1 -- 172.21.15.100:0/2750393891 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7ff924060d30 con 0x7ff92c0b4b90 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff908076300 msgr2=0x7ff9080787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff908076300 0x7ff9080787c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff91c032000 tx=0x7ff91c009030 comp rx=0 tx=0).stop 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 msgr2=0x7ff92c15b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 0x7ff92c15b140 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0b4200 tx=0x7ff92400d9d0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 shutdown_connections 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff908076300 0x7ff9080787c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff92c0b4b90 0x7ff92c15b140 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff92c0b6a90 0x7ff92c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 --2- 172.21.15.100:0/2750393891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff910003a30 0x7ff92c0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 >> 172.21.15.100:0/2750393891 conn(0x7ff92c0b29b0 msgr2=0x7ff92c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:51.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 shutdown_connections 2024-05-09T05:05:51.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.188+0000 7ff931000640 1 -- 172.21.15.100:0/2750393891 wait complete. 2024-05-09T05:05:51.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-05-09T05:05:51.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.414+0000 7f0093000640 1 Processor -- start 2024-05-09T05:05:51.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.415+0000 7f0093000640 1 -- start start 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0093000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0d3660 0x7f008c0d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0093000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f008c0d1a10 0x7f008c0d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0093000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c0d2f80 con 0x7f008c0b4530 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0093000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f008c0d3fe0 con 0x7f008c0d1a10 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0093000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f008c0d23a0 con 0x7f008c0d3660 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0092600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f008c0d1a10 0x7f008c0d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0092600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f008c0d1a10 0x7f008c0d1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51628/0 (socket says 172.21.15.100:51628) 2024-05-09T05:05:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.416+0000 7f0092600640 1 -- 172.21.15.100:0/1575166352 learned_addr learned my addr 172.21.15.100:0/1575166352 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.417+0000 7f0091200640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0d3660 0x7f008c0d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.417+0000 7f0092600640 1 -- 172.21.15.100:0/1575166352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0d3660 msgr2=0x7f008c0d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.417+0000 7f0092600640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0d3660 0x7f008c0d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.417+0000 7f0092600640 1 -- 172.21.15.100:0/1575166352 >> v1:172.21.15.133:6789/0 conn(0x7f008c0b4530 legacy=0x7f008c0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.417+0000 7f0092600640 1 -- 172.21.15.100:0/1575166352 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c0b51e0 con 0x7f008c0d1a10 2024-05-09T05:05:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.417+0000 7f0091200640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0d3660 0x7f008c0d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.418+0000 7f0092600640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d1a10 0x7f008c0d1e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f008402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a7c934f27911e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.418+0000 7f008be00640 1 -- 172.21.15.100:0/1575166352 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084036070 con 0x7f008c0d1a10 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.418+0000 7f008be00640 1 -- 172.21.15.100:0/1575166352 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084031600 con 0x7f008c0d1a10 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.418+0000 7f008be00640 1 -- 172.21.15.100:0/1575166352 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840319d0 con 0x7f008c0d1a10 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 -- 172.21.15.100:0/1575166352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d1a10 msgr2=0x7f008c0d1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d1a10 0x7f008c0d1e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f008402a680 comp rx=0 tx=0).stop 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 -- 172.21.15.100:0/1575166352 shutdown_connections 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d1a10 0x7f008c0d1e60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 --2- 172.21.15.100:0/1575166352 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0d3660 0x7f008c0d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 -- 172.21.15.100:0/1575166352 >> 172.21.15.100:0/1575166352 conn(0x7f008c08eb30 msgr2=0x7f008c09e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 -- 172.21.15.100:0/1575166352 shutdown_connections 2024-05-09T05:05:51.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.419+0000 7f0093000640 1 -- 172.21.15.100:0/1575166352 wait complete. 2024-05-09T05:05:51.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.421+0000 7f0093000640 1 Processor -- start 2024-05-09T05:05:51.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.421+0000 7f0093000640 1 -- start start 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0093000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0b4530 0x7f008c15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0093000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c0d1a10 0x7f008c1e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0093000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 0x7f008c06df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0093000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f008c0b5730 con 0x7f008c0d3660 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0093000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f008c0b5450 con 0x7f008c0d1a10 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0093000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f008c0d28d0 con 0x7f008c0b4530 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0092600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 0x7f008c06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0092600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 0x7f008c06df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51644/0 (socket says 172.21.15.100:51644) 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.422+0000 7f0092600640 1 -- 172.21.15.100:0/3488582603 learned_addr learned my addr 172.21.15.100:0/3488582603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0091200640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c0d1a10 0x7f008c1e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0091c00640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0b4530 0x7f008c15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0092600640 1 -- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0b4530 msgr2=0x7f008c15e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0092600640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0b4530 0x7f008c15e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0092600640 1 -- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c0d1a10 msgr2=0x7f008c1e9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0092600640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c0d1a10 0x7f008c1e9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0092600640 1 -- 172.21.15.100:0/3488582603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c0ca3e0 con 0x7f008c0d3660 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0091c00640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0b4530 0x7f008c15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0091200640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c0d1a10 0x7f008c1e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0092600640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 0x7f008c06df80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f0084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084036050 con 0x7f008c0d3660 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084042070 con 0x7f008c0d3660 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.423+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084009510 con 0x7f008c0d3660 2024-05-09T05:05:51.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.424+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c0ca6c0 con 0x7f008c0d3660 2024-05-09T05:05:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.424+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c0cac80 con 0x7f008c0d3660 2024-05-09T05:05:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.425+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c0b49a0 con 0x7f008c0d3660 2024-05-09T05:05:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.426+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0084007bf0 con 0x7f008c0d3660 2024-05-09T05:05:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.427+0000 7f0089600640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f006c076300 0x7f006c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.427+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f00840b8320 con 0x7f008c0d3660 2024-05-09T05:05:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.427+0000 7f0091c00640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f006c076300 0x7f006c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:51.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.428+0000 7f0091c00640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f006c076300 0x7f006c0787c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f007c003eb0 tx=0x7f007c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:51.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.431+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f008c0b49a0 con 0x7f008c0d3660 2024-05-09T05:05:51.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:51.717+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7f008c06a550 con 0x7f008c0d3660 2024-05-09T05:05:52.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.283+0000 7f0089600640 1 -- 172.21.15.100:0/3488582603 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v105) ==== 135+0+0 (secure 0 0 0) 0x7f0084081ee0 con 0x7f008c0d3660 2024-05-09T05:05:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f006c076300 msgr2=0x7f006c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f006c076300 0x7f006c0787c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f007c003eb0 tx=0x7f007c009040 comp rx=0 tx=0).stop 2024-05-09T05:05:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 msgr2=0x7f008c06df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 0x7f008c06df80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f0084004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 shutdown_connections 2024-05-09T05:05:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f006c076300 0x7f006c0787c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f008c0d3660 0x7f008c06df80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f008c0d1a10 0x7f008c1e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 --2- 172.21.15.100:0/3488582603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f008c0b4530 0x7f008c15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.287+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 >> 172.21.15.100:0/3488582603 conn(0x7f008c08eb30 msgr2=0x7f008c161260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.288+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 shutdown_connections 2024-05-09T05:05:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.288+0000 7f0093000640 1 -- 172.21.15.100:0/3488582603 wait complete. 2024-05-09T05:05:52.313 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files ... ok 2024-05-09T05:05:52.313 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace) that the MDS does not go read-only when handling backtrace update errors 2024-05-09T05:05:52.313 INFO:tasks.cephfs_test_runner:test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace) 2024-05-09T05:05:52.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:05:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.506+0000 7f0845400640 1 Processor -- start 2024-05-09T05:05:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.507+0000 7f0845400640 1 -- start start 2024-05-09T05:05:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0845400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08400b4530 0x7f08400b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0845400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08400d2120 0x7f08400d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0845400640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08400d2f80 con 0x7f08400d3660 2024-05-09T05:05:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0845400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f08400b6190 con 0x7f08400d2120 2024-05-09T05:05:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0845400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f08400d25f0 con 0x7f08400b4530 2024-05-09T05:05:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0844a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08400d2120 0x7f08400d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0844a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08400d2120 0x7f08400d3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52086/0 (socket says 172.21.15.100:52086) 2024-05-09T05:05:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.508+0000 7f0844a00640 1 -- 172.21.15.100:0/3987888810 learned_addr learned my addr 172.21.15.100:0/3987888810 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.509+0000 7f0844a00640 1 -- 172.21.15.100:0/3987888810 >> v2:172.21.15.133:3300/0 conn(0x7f08400b4530 msgr2=0x7f08400b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.509+0000 7f0844a00640 1 --2- 172.21.15.100:0/3987888810 >> v2:172.21.15.133:3300/0 conn(0x7f08400b4530 0x7f08400b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.509+0000 7f0844a00640 1 -- 172.21.15.100:0/3987888810 >> v1:172.21.15.133:6789/0 conn(0x7f08400d3660 legacy=0x7f08400d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.509+0000 7f0844a00640 1 -- 172.21.15.100:0/3987888810 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08400b51e0 con 0x7f08400d2120 2024-05-09T05:05:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.510+0000 7f0844a00640 1 --2- 172.21.15.100:0/3987888810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f08400d3af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f08400d5f80 tx=0x7f083802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17daa9d54a1db256 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.510+0000 7f083ea00640 1 -- 172.21.15.100:0/3987888810 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838037070 con 0x7f08400d2120 2024-05-09T05:05:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.510+0000 7f083ea00640 1 -- 172.21.15.100:0/3987888810 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0838032440 con 0x7f08400d2120 2024-05-09T05:05:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.510+0000 7f083ea00640 1 -- 172.21.15.100:0/3987888810 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838032810 con 0x7f08400d2120 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 -- 172.21.15.100:0/3987888810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 msgr2=0x7f08400d3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 --2- 172.21.15.100:0/3987888810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f08400d3af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f08400d5f80 tx=0x7f083802a1e0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 -- 172.21.15.100:0/3987888810 shutdown_connections 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 --2- 172.21.15.100:0/3987888810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f08400d3af0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 --2- 172.21.15.100:0/3987888810 >> v2:172.21.15.133:3300/0 conn(0x7f08400b4530 0x7f08400b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 -- 172.21.15.100:0/3987888810 >> 172.21.15.100:0/3987888810 conn(0x7f084008eb30 msgr2=0x7f084009e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 -- 172.21.15.100:0/3987888810 shutdown_connections 2024-05-09T05:05:52.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.511+0000 7f0845400640 1 -- 172.21.15.100:0/3987888810 wait complete. 2024-05-09T05:05:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.513+0000 7f0845400640 1 Processor -- start 2024-05-09T05:05:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.513+0000 7f0845400640 1 -- start start 2024-05-09T05:05:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0845400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08400b4530 0x7f0840157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0845400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f084015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0845400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08400d3660 0x7f08400ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0845400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08400d28d0 con 0x7f08400d2120 2024-05-09T05:05:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0845400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f08400b5730 con 0x7f08400b4530 2024-05-09T05:05:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0845400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f08400b4910 con 0x7f08400d3660 2024-05-09T05:05:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f083f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f084015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f083f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f084015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52100/0 (socket says 172.21.15.100:52100) 2024-05-09T05:05:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f083f400640 1 -- 172.21.15.100:0/2294226553 learned_addr learned my addr 172.21.15.100:0/2294226553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:52.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f083fe00640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08400b4530 0x7f0840157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f0844a00640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08400d3660 0x7f08400ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.514+0000 7f083f400640 1 -- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08400d3660 msgr2=0x7f08400ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f083f400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08400d3660 0x7f08400ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f083f400640 1 -- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08400b4530 msgr2=0x7f0840157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f083f400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08400b4530 0x7f0840157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f083f400640 1 -- 172.21.15.100:0/2294226553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0840157970 con 0x7f08400d2120 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f083fe00640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08400b4530 0x7f0840157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f083f400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f084015da80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f083000ba80 tx=0x7f083000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083000cc00 con 0x7f08400d2120 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083000cda0 con 0x7f08400d2120 2024-05-09T05:05:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830003bb0 con 0x7f08400d2120 2024-05-09T05:05:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08400b8c50 con 0x7f08400d2120 2024-05-09T05:05:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.515+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084015e800 con 0x7f08400d2120 2024-05-09T05:05:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.517+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084006a550 con 0x7f08400d2120 2024-05-09T05:05:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.518+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0830014440 con 0x7f08400d2120 2024-05-09T05:05:52.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.519+0000 7f0837e00640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f081c0762d0 0x7f081c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.519+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f08300972c0 con 0x7f08400d2120 2024-05-09T05:05:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.519+0000 7f083fe00640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f081c0762d0 0x7f081c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.520+0000 7f083fe00640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f081c0762d0 0x7f081c078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0828006fd0 tx=0x7f0828008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:52.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.523+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0830060e80 con 0x7f08400d2120 2024-05-09T05:05:52.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.731+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f084008f150 con 0x7f08400d2120 2024-05-09T05:05:52.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.733+0000 7f0837e00640 1 -- 172.21.15.100:0/2294226553 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+13046 (secure 0 0 0) 0x7f0830067e20 con 0x7f08400d2120 2024-05-09T05:05:52.734 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:52.734 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:50.258054+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/1862982495":"2024-05-10T05:05:46.230100+0000","172.21.15.100:6836/1862982495":"2024-05-10T05:05:46.230100+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f081c0762d0 msgr2=0x7f081c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f081c0762d0 0x7f081c078790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0828006fd0 tx=0x7f0828008040 comp rx=0 tx=0).stop 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 msgr2=0x7f084015da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f084015da80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f083000ba80 tx=0x7f083000bf40 comp rx=0 tx=0).stop 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 shutdown_connections 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f081c0762d0 0x7f081c078790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f08400d3660 0x7f08400ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08400d2120 0x7f084015da80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 --2- 172.21.15.100:0/2294226553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08400b4530 0x7f0840157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 >> 172.21.15.100:0/2294226553 conn(0x7f084008eb30 msgr2=0x7f08400b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:52.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.736+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 shutdown_connections 2024-05-09T05:05:52.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.737+0000 7f0845400640 1 -- 172.21.15.100:0/2294226553 wait complete. 2024-05-09T05:05:52.755 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T05:04:11.914841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T05:05:52.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T05:05:52.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.948+0000 7f7801c00640 1 Processor -- start 2024-05-09T05:05:52.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.948+0000 7f7801c00640 1 -- start start 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f7801c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77fc0d31c0 0x7f77fc0d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f7801c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc15f8d0 0x7f77fc0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f7801c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77fc0b48a0 con 0x7f77fc0d3870 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f7801c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc0b4b80 con 0x7f77fc0d31c0 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f7801c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc0b4e60 con 0x7f77fc15f8d0 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f77fa000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77fc0d31c0 0x7f77fc0d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f77fa000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77fc0d31c0 0x7f77fc0d08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52114/0 (socket says 172.21.15.100:52114) 2024-05-09T05:05:52.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.950+0000 7f77fa000640 1 -- 172.21.15.100:0/1881385316 learned_addr learned my addr 172.21.15.100:0/1881385316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.951+0000 7f77fb400640 1 --2- 172.21.15.100:0/1881385316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc15f8d0 0x7f77fc0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.951+0000 7f77fa000640 1 -- 172.21.15.100:0/1881385316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc15f8d0 msgr2=0x7f77fc0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.951+0000 7f77fa000640 1 --2- 172.21.15.100:0/1881385316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc15f8d0 0x7f77fc0b5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.951+0000 7f77fa000640 1 -- 172.21.15.100:0/1881385316 >> v1:172.21.15.100:6789/0 conn(0x7f77fc0d3870 legacy=0x7f77fc0d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.951+0000 7f77fa000640 1 -- 172.21.15.100:0/1881385316 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0b5140 con 0x7f77fc0d31c0 2024-05-09T05:05:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.952+0000 7f77fa000640 1 --2- 172.21.15.100:0/1881385316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d31c0 0x7f77fc0d08b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009870 tx=0x7f77e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36a429dbcd0e0e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.952+0000 7f77f9600640 1 -- 172.21.15.100:0/1881385316 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4037070 con 0x7f77fc0d31c0 2024-05-09T05:05:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.952+0000 7f77f9600640 1 -- 172.21.15.100:0/1881385316 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e4032440 con 0x7f77fc0d31c0 2024-05-09T05:05:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.952+0000 7f77f9600640 1 -- 172.21.15.100:0/1881385316 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4032810 con 0x7f77fc0d31c0 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 -- 172.21.15.100:0/1881385316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d31c0 msgr2=0x7f77fc0d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 --2- 172.21.15.100:0/1881385316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d31c0 0x7f77fc0d08b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009870 tx=0x7f77e402a270 comp rx=0 tx=0).stop 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 -- 172.21.15.100:0/1881385316 shutdown_connections 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 --2- 172.21.15.100:0/1881385316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc15f8d0 0x7f77fc0b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 --2- 172.21.15.100:0/1881385316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d31c0 0x7f77fc0d08b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 -- 172.21.15.100:0/1881385316 >> 172.21.15.100:0/1881385316 conn(0x7f77fc09e5d0 msgr2=0x7f77fc0d5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 -- 172.21.15.100:0/1881385316 shutdown_connections 2024-05-09T05:05:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.953+0000 7f7801c00640 1 -- 172.21.15.100:0/1881385316 wait complete. 2024-05-09T05:05:52.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.955+0000 7f7801c00640 1 Processor -- start 2024-05-09T05:05:52.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.955+0000 7f7801c00640 1 -- start start 2024-05-09T05:05:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f7801c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0d31c0 0x7f77fc0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f7801c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc0d3870 0x7f77fc151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f7801c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 0x7f77fc0bab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f7801c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0b5ba0 con 0x7f77fc15f8d0 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f7801c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0d1000 con 0x7f77fc0d3870 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f7801c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc0b5d20 con 0x7f77fc0d31c0 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f77fb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 0x7f77fc0bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f77fb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 0x7f77fc0bab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52120/0 (socket says 172.21.15.100:52120) 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.956+0000 7f77fb400640 1 -- 172.21.15.100:0/2771778394 learned_addr learned my addr 172.21.15.100:0/2771778394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fa000640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc0d3870 0x7f77fc151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77faa00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0d31c0 0x7f77fc0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fb400640 1 -- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0d31c0 msgr2=0x7f77fc0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fb400640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0d31c0 0x7f77fc0c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fb400640 1 -- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc0d3870 msgr2=0x7f77fc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fb400640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc0d3870 0x7f77fc151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fb400640 1 -- 172.21.15.100:0/2771778394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0bb0c0 con 0x7f77fc15f8d0 2024-05-09T05:05:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77fb400640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 0x7f77fc0bab80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c510 tx=0x7f77f400c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:52.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4015070 con 0x7f77fc15f8d0 2024-05-09T05:05:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4004240 con 0x7f77fc15f8d0 2024-05-09T05:05:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4003610 con 0x7f77fc15f8d0 2024-05-09T05:05:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.957+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc0c9480 con 0x7f77fc15f8d0 2024-05-09T05:05:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.958+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc0cb120 con 0x7f77fc15f8d0 2024-05-09T05:05:52.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.959+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc06a630 con 0x7f77fc15f8d0 2024-05-09T05:05:52.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.960+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f77f40037b0 con 0x7f77fc15f8d0 2024-05-09T05:05:52.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.961+0000 7f77f2a00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:52.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.962+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f77f4096fa0 con 0x7f77fc15f8d0 2024-05-09T05:05:52.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.962+0000 7f77faa00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.962+0000 7f77faa00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77ec007fd0 tx=0x7f77ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:52.966+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f77f4060c90 con 0x7f77fc15f8d0 2024-05-09T05:05:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.168+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f77fc0d4c30 con 0x7f77fc15f8d0 2024-05-09T05:05:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.169+0000 7f77f2a00640 1 -- 172.21.15.100:0/2771778394 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f77f4060590 con 0x7f77fc15f8d0 2024-05-09T05:05:53.170 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 msgr2=0x7f77d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77ec007fd0 tx=0x7f77ec009040 comp rx=0 tx=0).stop 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 msgr2=0x7f77fc0bab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 0x7f77fc0bab80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c510 tx=0x7f77f400c9d0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 shutdown_connections 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc15f8d0 0x7f77fc0bab80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc0d3870 0x7f77fc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 --2- 172.21.15.100:0/2771778394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0d31c0 0x7f77fc0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 >> 172.21.15.100:0/2771778394 conn(0x7f77fc09e5d0 msgr2=0x7f77fc0cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 shutdown_connections 2024-05-09T05:05:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.172+0000 7f7801c00640 1 -- 172.21.15.100:0/2771778394 wait complete. 2024-05-09T05:05:53.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace_flush_on_deleted_data_pool' 2024-05-09T05:05:53.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.386+0000 7ff9c0400640 1 Processor -- start 2024-05-09T05:05:53.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.387+0000 7ff9c0400640 1 -- start start 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9c0400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b8145900 0x7ff9b8073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9c0400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9b80739a0 0x7ff9b80b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9c0400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9b80b43f0 0x7ff9b8163080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9c0400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b806f390 con 0x7ff9b80b43f0 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9c0400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b806ead0 con 0x7ff9b80739a0 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9c0400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b806ed40 con 0x7ff9b8145900 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.388+0000 7ff9be400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9b80b43f0 0x7ff9b8163080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9b80b43f0 0x7ff9b8163080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52122/0 (socket says 172.21.15.100:52122) 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 -- 172.21.15.100:0/2478462716 learned_addr learned my addr 172.21.15.100:0/2478462716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9bda00640 1 --2- 172.21.15.100:0/2478462716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b8145900 0x7ff9b8073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9bd000640 1 --2- 172.21.15.100:0/2478462716 >> v2:172.21.15.133:3300/0 conn(0x7ff9b80739a0 0x7ff9b80b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:53.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 -- 172.21.15.100:0/2478462716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b8145900 msgr2=0x7ff9b8073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:53.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 --2- 172.21.15.100:0/2478462716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b8145900 0x7ff9b8073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 -- 172.21.15.100:0/2478462716 >> v2:172.21.15.133:3300/0 conn(0x7ff9b80739a0 msgr2=0x7ff9b80b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:53.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 --2- 172.21.15.100:0/2478462716 >> v2:172.21.15.133:3300/0 conn(0x7ff9b80739a0 0x7ff9b80b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9be400640 1 -- 172.21.15.100:0/2478462716 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b806f020 con 0x7ff9b80b43f0 2024-05-09T05:05:53.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.389+0000 7ff9bd000640 1 --2- 172.21.15.100:0/2478462716 >> v2:172.21.15.133:3300/0 conn(0x7ff9b80739a0 0x7ff9b80b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.390+0000 7ff9be400640 1 --2- 172.21.15.100:0/2478462716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b80b43f0 0x7ff9b8163080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80b3bf0 tx=0x7ff9b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99bba769771f974 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.390+0000 7ff9b7e00640 1 -- 172.21.15.100:0/2478462716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0036070 con 0x7ff9b80b43f0 2024-05-09T05:05:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.390+0000 7ff9b7e00640 1 -- 172.21.15.100:0/2478462716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b0031600 con 0x7ff9b80b43f0 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.390+0000 7ff9b7e00640 1 -- 172.21.15.100:0/2478462716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00319d0 con 0x7ff9b80b43f0 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 -- 172.21.15.100:0/2478462716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b80b43f0 msgr2=0x7ff9b8163080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 --2- 172.21.15.100:0/2478462716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b80b43f0 0x7ff9b8163080 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80b3bf0 tx=0x7ff9b002a6a0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 -- 172.21.15.100:0/2478462716 shutdown_connections 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 --2- 172.21.15.100:0/2478462716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b80b43f0 0x7ff9b8163080 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 --2- 172.21.15.100:0/2478462716 >> v2:172.21.15.133:3300/0 conn(0x7ff9b80739a0 0x7ff9b80b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 --2- 172.21.15.100:0/2478462716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b8145900 0x7ff9b8073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 -- 172.21.15.100:0/2478462716 >> 172.21.15.100:0/2478462716 conn(0x7ff9b80b31e0 msgr2=0x7ff9b80d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 -- 172.21.15.100:0/2478462716 shutdown_connections 2024-05-09T05:05:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.391+0000 7ff9c0400640 1 -- 172.21.15.100:0/2478462716 wait complete. 2024-05-09T05:05:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.393+0000 7ff9c0400640 1 Processor -- start 2024-05-09T05:05:53.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.393+0000 7ff9c0400640 1 -- start start 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9c0400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b80739a0 0x7ff9b815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9c0400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b80b43f0 0x7ff9b8145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9c0400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 0x7ff9b80cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9c0400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b8145ce0 con 0x7ff9b8145900 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9c0400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80ade90 con 0x7ff9b80b43f0 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9c0400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b8145e60 con 0x7ff9b80739a0 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 0x7ff9b80cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 0x7ff9b80cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52132/0 (socket says 172.21.15.100:52132) 2024-05-09T05:05:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 -- 172.21.15.100:0/1631869802 learned_addr learned my addr 172.21.15.100:0/1631869802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 -- 172.21.15.100:0/1631869802 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b80739a0 msgr2=0x7ff9b815f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b80739a0 0x7ff9b815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 -- 172.21.15.100:0/1631869802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b80b43f0 msgr2=0x7ff9b8145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b80b43f0 0x7ff9b8145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.394+0000 7ff9be400640 1 -- 172.21.15.100:0/1631869802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b80cb880 con 0x7ff9b8145900 2024-05-09T05:05:53.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.395+0000 7ff9be400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 0x7ff9b80cc920 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009f40 tx=0x7ff9b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.395+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0036050 con 0x7ff9b8145900 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.395+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b0042070 con 0x7ff9b8145900 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.395+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0009510 con 0x7ff9b8145900 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.395+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b80cbb60 con 0x7ff9b8145900 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.395+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b80cc400 con 0x7ff9b8145900 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.396+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b80cbd30 con 0x7ff9b8145900 2024-05-09T05:05:53.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.397+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff9b0007bd0 con 0x7ff9b8145900 2024-05-09T05:05:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.398+0000 7ff9b5600640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff99c0762d0 0x7ff99c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.399+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7ff9b00b82e0 con 0x7ff9b8145900 2024-05-09T05:05:53.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.399+0000 7ff9bda00640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff99c0762d0 0x7ff99c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:53.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.399+0000 7ff9bda00640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff99c0762d0 0x7ff99c078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00a810 tx=0x7ff9ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:53.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.402+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff9b0081f30 con 0x7ff9b8145900 2024-05-09T05:05:53.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:53.661+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace_flush_on_deleted_data_pool"]} v 0) -- 0x7ff9b80cc5d0 con 0x7ff9b8145900 2024-05-09T05:05:54.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.298+0000 7ff9b5600640 1 -- 172.21.15.100:0/1631869802 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace_flush_on_deleted_data_pool"]}]=0 v107) ==== 165+0+0 (secure 0 0 0) 0x7ff9b0081830 con 0x7ff9b8145900 2024-05-09T05:05:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff99c0762d0 msgr2=0x7ff99c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff99c0762d0 0x7ff99c078790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00a810 tx=0x7ff9ac008040 comp rx=0 tx=0).stop 2024-05-09T05:05:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 msgr2=0x7ff9b80cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 0x7ff9b80cc920 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0009f40 tx=0x7ff9b0004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:54.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 shutdown_connections 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff99c0762d0 0x7ff99c078790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9b8145900 0x7ff9b80cc920 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9b80b43f0 0x7ff9b8145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 --2- 172.21.15.100:0/1631869802 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff9b80739a0 0x7ff9b815f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.302+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 >> 172.21.15.100:0/1631869802 conn(0x7ff9b80b31e0 msgr2=0x7ff9b80ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.303+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 shutdown_connections 2024-05-09T05:05:54.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.303+0000 7ff9c0400640 1 -- 172.21.15.100:0/1631869802 wait complete. 2024-05-09T05:05:54.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-09T05:05:54.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.524+0000 7f2e9d000640 1 Processor -- start 2024-05-09T05:05:54.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.524+0000 7f2e9d000640 1 -- start start 2024-05-09T05:05:54.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.526+0000 7f2e9d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 0x7f2e98073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:54.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.526+0000 7f2e9d000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e980d0110 0x7f2e9806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:54.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.526+0000 7f2e9d000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9806e520 con 0x7f2e98074490 2024-05-09T05:05:54.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.526+0000 7f2e9d000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9815d980 con 0x7f2e980d0110 2024-05-09T05:05:54.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.526+0000 7f2e9d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2e980cf440 con 0x7f2e9815d5a0 2024-05-09T05:05:54.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.527+0000 7f2e95e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 0x7f2e98073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.527+0000 7f2e95e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 0x7f2e98073f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:53014/0 (socket says 172.21.15.100:53014) 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.527+0000 7f2e95e00640 1 -- 172.21.15.100:0/2785533223 learned_addr learned my addr 172.21.15.100:0/2785533223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.527+0000 7f2e96800640 1 --2- 172.21.15.100:0/2785533223 >> v2:172.21.15.133:3300/0 conn(0x7f2e980d0110 0x7f2e9806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.528+0000 7f2e95e00640 1 -- 172.21.15.100:0/2785533223 >> v2:172.21.15.133:3300/0 conn(0x7f2e980d0110 msgr2=0x7f2e9806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.528+0000 7f2e95e00640 1 --2- 172.21.15.100:0/2785533223 >> v2:172.21.15.133:3300/0 conn(0x7f2e980d0110 0x7f2e9806ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.528+0000 7f2e95e00640 1 -- 172.21.15.100:0/2785533223 >> v1:172.21.15.133:6789/0 conn(0x7f2e98074490 legacy=0x7f2e980cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.528+0000 7f2e95e00640 1 -- 172.21.15.100:0/2785533223 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e980cf720 con 0x7f2e9815d5a0 2024-05-09T05:05:54.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.529+0000 7f2e95e00640 1 --2- 172.21.15.100:0/2785533223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 0x7f2e98073f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009870 tx=0x7f2e8802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b52491f815ad4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:54.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.529+0000 7f2e95400640 1 -- 172.21.15.100:0/2785533223 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88037070 con 0x7f2e9815d5a0 2024-05-09T05:05:54.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.529+0000 7f2e95400640 1 -- 172.21.15.100:0/2785533223 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88032440 con 0x7f2e9815d5a0 2024-05-09T05:05:54.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.529+0000 7f2e95400640 1 -- 172.21.15.100:0/2785533223 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88032810 con 0x7f2e9815d5a0 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 -- 172.21.15.100:0/2785533223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 msgr2=0x7f2e98073f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2785533223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 0x7f2e98073f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009870 tx=0x7f2e8802a1c0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 -- 172.21.15.100:0/2785533223 shutdown_connections 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2785533223 >> v2:172.21.15.133:3300/0 conn(0x7f2e980d0110 0x7f2e9806ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2785533223 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e9815d5a0 0x7f2e98073f50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 -- 172.21.15.100:0/2785533223 >> 172.21.15.100:0/2785533223 conn(0x7f2e980b2c90 msgr2=0x7f2e980b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 -- 172.21.15.100:0/2785533223 shutdown_connections 2024-05-09T05:05:54.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.530+0000 7f2e9d000640 1 -- 172.21.15.100:0/2785533223 wait complete. 2024-05-09T05:05:54.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.532+0000 7f2e9d000640 1 Processor -- start 2024-05-09T05:05:54.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.532+0000 7f2e9d000640 1 -- start start 2024-05-09T05:05:54.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e9d000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e98074490 0x7f2e9815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:54.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e9d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 0x7f2e9809dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:54.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e9d000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9815d5a0 0x7f2e9809e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:54.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e9d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9809ede0 con 0x7f2e980d0110 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e9d000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2e980d05a0 con 0x7f2e9815d5a0 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e9d000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9809ef60 con 0x7f2e98074490 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 0x7f2e9809dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 0x7f2e9809dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52134/0 (socket says 172.21.15.100:52134) 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.533+0000 7f2e8fe00640 1 -- 172.21.15.100:0/2969154872 learned_addr learned my addr 172.21.15.100:0/2969154872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e95e00640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e98074490 0x7f2e9815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e96800640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9815d5a0 0x7f2e9809e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8fe00640 1 -- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e98074490 msgr2=0x7f2e9815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8fe00640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e98074490 0x7f2e9815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8fe00640 1 -- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9815d5a0 msgr2=0x7f2e9809e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8fe00640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9815d5a0 0x7f2e9809e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8fe00640 1 -- 172.21.15.100:0/2969154872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9814df60 con 0x7f2e980d0110 2024-05-09T05:05:54.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8fe00640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 0x7f2e9809dbe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c370 tx=0x7f2e8000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80017070 con 0x7f2e980d0110 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e800052d0 con 0x7f2e980d0110 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80003830 con 0x7f2e980d0110 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.534+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e981609e0 con 0x7f2e980d0110 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.535+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9815aca0 con 0x7f2e980d0110 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.536+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9806a630 con 0x7f2e980d0110 2024-05-09T05:05:54.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.537+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2e8001a070 con 0x7f2e980d0110 2024-05-09T05:05:54.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.538+0000 7f2e8e000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e740762d0 0x7f2e74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:54.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.538+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f2e80096730 con 0x7f2e980d0110 2024-05-09T05:05:54.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.538+0000 7f2e95e00640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e740762d0 0x7f2e74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:54.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.539+0000 7f2e95e00640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e740762d0 0x7f2e74078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e88034000 tx=0x7f2e8802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:54.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.543+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2e800602f0 con 0x7f2e980d0110 2024-05-09T05:05:54.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.746+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2e980cfde0 con 0x7f2e980d0110 2024-05-09T05:05:54.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.752+0000 7f2e8e000640 1 -- 172.21.15.100:0/2969154872 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f2e800682e0 con 0x7f2e980d0110 2024-05-09T05:05:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e740762d0 msgr2=0x7f2e74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e740762d0 0x7f2e74078790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e88034000 tx=0x7f2e8802e000 comp rx=0 tx=0).stop 2024-05-09T05:05:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 msgr2=0x7f2e9809dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 0x7f2e9809dbe0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c370 tx=0x7f2e8000c830 comp rx=0 tx=0).stop 2024-05-09T05:05:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 shutdown_connections 2024-05-09T05:05:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2e740762d0 0x7f2e74078790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e9815d5a0 0x7f2e9809e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e980d0110 0x7f2e9809dbe0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 --2- 172.21.15.100:0/2969154872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e98074490 0x7f2e9815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.755+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 >> 172.21.15.100:0/2969154872 conn(0x7f2e980b2c90 msgr2=0x7f2e980b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.756+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 shutdown_connections 2024-05-09T05:05:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:54.756+0000 7f2e9d000640 1 -- 172.21.15.100:0/2969154872 wait complete. 2024-05-09T05:05:54.773 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-09T05:05:54.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:05:54.874 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:05:54.981 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-09T05:05:54.981 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:05:54.981 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:55.039 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052691,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248964k,nr_inodes=812241,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-09T05:05:55.040 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:05:55.040 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:55.097 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:05:55.097 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:05:55.097 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:55.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052691,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248964k,nr_inodes=812241,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-09T05:05:55.152 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:05:55.152 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:05:55.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:05:55.210 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-09T05:05:55.211 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:05:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.418+0000 7f6394800640 1 Processor -- start 2024-05-09T05:05:55.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.418+0000 7f6394800640 1 -- start start 2024-05-09T05:05:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6394800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 0x7f638c073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6394800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c06f390 con 0x7f638c06fd60 2024-05-09T05:05:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6394800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c06e810 con 0x7f638c0aee10 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6394800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f638c06eaf0 con 0x7f638c073840 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6391e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f638c06fd60 0x7f638c070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49118/0 (socket says 172.21.15.100:49118) 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6391e00640 1 -- 172.21.15.100:0/2997459775 learned_addr learned my addr 172.21.15.100:0/2997459775 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786865088 0 0) 0x7f638c06f390 con 0x7f638c06fd60 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6374003520 con 0x7f638c06fd60 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.420+0000 7f6391400640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 0x7f638c073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 65370648 0 0) 0x7f6374003520 con 0x7f638c06fd60 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 msgr2=0x7f638c073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 0x7f638c073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 >> v1:172.21.15.133:6789/0 conn(0x7f638c0aee10 legacy=0x7f638c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c06edd0 con 0x7f638c06fd60 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f63800016f0 con 0x7f638c06fd60 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 >> v1:172.21.15.100:6789/0 conn(0x7f638c06fd60 legacy=0x7f638c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f6374003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 0x7f6374004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6374004d90 0x7f6374005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f638c06eaf0 con 0x7f6374003a30 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f637400bba0 con 0x7f6374004d90 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f637400dfb0 con 0x7f638c073840 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6391e00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f6374003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6391e00640 1 -- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 msgr2=0x7f6374004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.421+0000 7f6391e00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c073840 0x7f6374004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.422+0000 7f6391e00640 1 -- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6374004d90 msgr2=0x7f6374005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.422+0000 7f6391e00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6374004d90 0x7f6374005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.422+0000 7f6391e00640 1 -- 172.21.15.100:0/2997459775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6374003520 con 0x7f6374003a30 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.422+0000 7f6391e00640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f6374003e50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6380007fd0 tx=0x7f6374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cdc44d10efd1d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380007d50 con 0x7f6374003a30 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380005af0 con 0x7f6374003a30 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6390a00640 1 -- 172.21.15.100:0/2997459775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380007070 con 0x7f6374003a30 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6394800640 1 -- 172.21.15.100:0/2997459775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 msgr2=0x7f6374003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6394800640 1 --2- 172.21.15.100:0/2997459775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f6374003e50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6380007fd0 tx=0x7f6374005830 comp rx=0 tx=0).stop 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6392800640 1 -- 172.21.15.100:0/2997459775 reap_dead start 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6394800640 1 -- 172.21.15.100:0/2997459775 shutdown_connections 2024-05-09T05:05:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6394800640 1 -- 172.21.15.100:0/2997459775 >> 172.21.15.100:0/2997459775 conn(0x7f638c0b31e0 msgr2=0x7f638c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6394800640 1 -- 172.21.15.100:0/2997459775 shutdown_connections 2024-05-09T05:05:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.423+0000 7f6394800640 1 -- 172.21.15.100:0/2997459775 wait complete. 2024-05-09T05:05:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.425+0000 7f6394800640 1 Processor -- start 2024-05-09T05:05:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.425+0000 7f6394800640 1 -- start start 2024-05-09T05:05:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6394800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f638c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6394800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c14e760 0x7f638c09da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6394800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f638c158ae0 0x7f638c09df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6394800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f638c159f00 con 0x7f6374003a30 2024-05-09T05:05:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6394800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f638c06e4a0 con 0x7f638c158ae0 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6394800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f638c09c650 con 0x7f638c14e760 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6391e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f638c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6391e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f638c155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52152/0 (socket says 172.21.15.100:52152) 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.426+0000 7f6391e00640 1 -- 172.21.15.100:0/3268244349 learned_addr learned my addr 172.21.15.100:0/3268244349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6392800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f638c158ae0 0x7f638c09df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6391e00640 1 -- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c14e760 msgr2=0x7f638c09da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6391e00640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c14e760 0x7f638c09da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6391e00640 1 -- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f638c158ae0 msgr2=0x7f638c09df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6391e00640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f638c158ae0 0x7f638c09df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6391e00640 1 -- 172.21.15.100:0/3268244349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c09c930 con 0x7f6374003a30 2024-05-09T05:05:55.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6392800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f638c158ae0 0x7f638c09df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6391e00640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f638c155e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f638000c300 tx=0x7f6380001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380037040 con 0x7f6374003a30 2024-05-09T05:05:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380041070 con 0x7f6374003a30 2024-05-09T05:05:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380004a20 con 0x7f6374003a30 2024-05-09T05:05:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.427+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c09cc10 con 0x7f6374003a30 2024-05-09T05:05:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.428+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c09d1d0 con 0x7f6374003a30 2024-05-09T05:05:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.429+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c076070 con 0x7f6374003a30 2024-05-09T05:05:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.430+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6380004bc0 con 0x7f6374003a30 2024-05-09T05:05:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.431+0000 7f6386000640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6370076300 0x7f63700787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.431+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f63800b7180 con 0x7f6374003a30 2024-05-09T05:05:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.431+0000 7f6391400640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6370076300 0x7f63700787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.432+0000 7f6391400640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6370076300 0x7f63700787c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f637c006ce0 tx=0x7f637c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.435+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6380080cb0 con 0x7f6374003a30 2024-05-09T05:05:55.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.679+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f638c159030 con 0x7f6374003a30 2024-05-09T05:05:55.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.681+0000 7f6386000640 1 -- 172.21.15.100:0/3268244349 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3878 (secure 0 0 0) 0x7f63800805b0 con 0x7f6374003a30 2024-05-09T05:05:55.681 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:55.681 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3835463138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3835463138},{"type":"v1","addr":"172.21.15.133:6833","nonce":3835463138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1532586947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1532586947},{"type":"v1","addr":"172.21.15.133:6835","nonce":1532586947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1235831564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1235831564},{"type":"v1","addr":"172.21.15.100:6835","nonce":1235831564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/593000079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":593000079},{"type":"v1","addr":"172.21.15.100:6837","nonce":593000079}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[]} 2024-05-09T05:05:55.682 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-05-09T05:05:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6370076300 msgr2=0x7f63700787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6370076300 0x7f63700787c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f637c006ce0 tx=0x7f637c008040 comp rx=0 tx=0).stop 2024-05-09T05:05:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 msgr2=0x7f638c155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f638c155e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f638000c300 tx=0x7f6380001a30 comp rx=0 tx=0).stop 2024-05-09T05:05:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 shutdown_connections 2024-05-09T05:05:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6370076300 0x7f63700787c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f638c158ae0 0x7f638c09df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f638c14e760 0x7f638c09da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 --2- 172.21.15.100:0/3268244349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374003a30 0x7f638c155e40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.683+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 >> 172.21.15.100:0/3268244349 conn(0x7f638c0b31e0 msgr2=0x7f638c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:55.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.684+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 shutdown_connections 2024-05-09T05:05:55.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.684+0000 7f6394800640 1 -- 172.21.15.100:0/3268244349 wait complete. 2024-05-09T05:05:55.703 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-09T05:05:55.703 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-09T05:05:55.704 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T05:05:55.704 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:55.704 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-09T05:05:55.704 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-09T05:05:55.704 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T05:05:55.704 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:55.704 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-09T05:05:55.705 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-09T05:05:55.705 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T05:05:55.705 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:55.705 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-09T05:05:55.705 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-09T05:05:55.705 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T05:05:55.705 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:05:55.724 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T05:05:55.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-09T05:05:55.726 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T05:05:55.726 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-09T05:05:55.730 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T05:05:55.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-09T05:05:55.733 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T05:05:55.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-09T05:05:55.774 INFO:tasks.ceph.mds.c:Started 2024-05-09T05:05:55.775 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:55.780 INFO:tasks.ceph.mds.b:Started 2024-05-09T05:05:55.780 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:55.781 INFO:tasks.ceph.mds.a:Started 2024-05-09T05:05:55.781 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:55.786 INFO:tasks.ceph.mds.d:Started 2024-05-09T05:05:55.786 DEBUG:teuthology.parallel:result is None 2024-05-09T05:05:55.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-09T05:05:55.928 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-05-09T05:05:55.930 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-05-09T05:05:55.937 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2024-05-09T05:05:55.937 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2024-05-09T05:05:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.977+0000 7fbaa2c00640 1 Processor -- start 2024-05-09T05:05:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.977+0000 7fbaa2c00640 1 -- start start 2024-05-09T05:05:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.978+0000 7fbaa2c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba9c15f860 0x7fba9c0d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.978+0000 7fbaa2c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa2c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba9c15fdc0 con 0x7fba9c0d3700 2024-05-09T05:05:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa2c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fba9c1600a0 con 0x7fba9c15f860 2024-05-09T05:05:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa2c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fba9c160380 con 0x7fba9c0d5c40 2024-05-09T05:05:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa0e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba9c15f860 0x7fba9c0d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa2200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa1800640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba9c0d3700 0x7fba9c0d3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:43362/0 (socket says 172.21.15.100:43362) 2024-05-09T05:05:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.979+0000 7fbaa1800640 1 -- 172.21.15.100:0/2177544250 learned_addr learned my addr 172.21.15.100:0/2177544250 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.980+0000 7fbaa2200640 1 -- 172.21.15.100:0/2177544250 >> v2:172.21.15.133:3300/0 conn(0x7fba9c15f860 msgr2=0x7fba9c0d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:55.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.980+0000 7fbaa2200640 1 --2- 172.21.15.100:0/2177544250 >> v2:172.21.15.133:3300/0 conn(0x7fba9c15f860 0x7fba9c0d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.980+0000 7fba9be00640 1 -- 172.21.15.100:0/2177544250 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161581895 0 0) 0x7fba9c15fdc0 con 0x7fba9c0d3700 2024-05-09T05:05:55.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.980+0000 7fbaa2200640 1 -- 172.21.15.100:0/2177544250 >> v1:172.21.15.133:6789/0 conn(0x7fba9c0d3700 legacy=0x7fba9c0d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.980+0000 7fbaa2200640 1 -- 172.21.15.100:0/2177544250 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c160660 con 0x7fba9c0d5c40 2024-05-09T05:05:55.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.981+0000 7fbaa2200640 1 --2- 172.21.15.100:0/2177544250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cfda0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba94009d90 tx=0x7fba9402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546814d0a8be12f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:55.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.981+0000 7fba9be00640 1 -- 172.21.15.100:0/2177544250 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94007740 con 0x7fba9c0d5c40 2024-05-09T05:05:55.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.981+0000 7fba9be00640 1 -- 172.21.15.100:0/2177544250 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940078e0 con 0x7fba9c0d5c40 2024-05-09T05:05:55.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.981+0000 7fba9be00640 1 -- 172.21.15.100:0/2177544250 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94007cb0 con 0x7fba9c0d5c40 2024-05-09T05:05:55.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 -- 172.21.15.100:0/2177544250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 msgr2=0x7fba9c0cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/2177544250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cfda0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba94009d90 tx=0x7fba9402a6f0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 -- 172.21.15.100:0/2177544250 shutdown_connections 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/2177544250 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cfda0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/2177544250 >> v2:172.21.15.133:3300/0 conn(0x7fba9c15f860 0x7fba9c0d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 -- 172.21.15.100:0/2177544250 >> 172.21.15.100:0/2177544250 conn(0x7fba9c0d5120 msgr2=0x7fba9c0d5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 -- 172.21.15.100:0/2177544250 shutdown_connections 2024-05-09T05:05:55.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.982+0000 7fbaa2c00640 1 -- 172.21.15.100:0/2177544250 wait complete. 2024-05-09T05:05:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.983+0000 7fbaa2c00640 1 Processor -- start 2024-05-09T05:05:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 -- start start 2024-05-09T05:05:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba9c0d3700 0x7fba9c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 0x7fba9c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c0d0460 con 0x7fba9c15f860 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c0d02e0 con 0x7fba9c0d3700 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.984+0000 7fbaa2c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fba9c0d05e0 con 0x7fba9c0d5c40 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 0x7fba9c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 0x7fba9c0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52188/0 (socket says 172.21.15.100:52188) 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 -- 172.21.15.100:0/126999522 learned_addr learned my addr 172.21.15.100:0/126999522 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:55.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa1800640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba9c0d3700 0x7fba9c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa0e00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 -- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 msgr2=0x7fba9c0cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 -- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba9c0d3700 msgr2=0x7fba9c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:55.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba9c0d3700 0x7fba9c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:55.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.985+0000 7fbaa2200640 1 -- 172.21.15.100:0/126999522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c0b8750 con 0x7fba9c15f860 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.986+0000 7fbaa2200640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 0x7fba9c0b2d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba94009eb0 tx=0x7fba94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.986+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94040070 con 0x7fba9c15f860 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.986+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba94031c40 con 0x7fba9c15f860 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.986+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94009450 con 0x7fba9c15f860 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.986+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c0b8a30 con 0x7fba9c15f860 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.986+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c0b8ff0 con 0x7fba9c15f860 2024-05-09T05:05:55.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.987+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c06a550 con 0x7fba9c15f860 2024-05-09T05:05:55.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.988+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fba94039040 con 0x7fba9c15f860 2024-05-09T05:05:55.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.989+0000 7fba99600640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fba7c076300 0x7fba7c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:55.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.989+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fba940b7fe0 con 0x7fba9c15f860 2024-05-09T05:05:55.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.989+0000 7fbaa1800640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fba7c076300 0x7fba7c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:55.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.990+0000 7fbaa1800640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fba7c076300 0x7fba7c0787c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fba90000f60 tx=0x7fba90007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:55.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:55.994+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fba94081600 con 0x7fba9c15f860 2024-05-09T05:05:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.212+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fba9c0d34e0 con 0x7fba9c15f860 2024-05-09T05:05:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.326+0000 7fba99600640 1 -- 172.21.15.100:0/126999522 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) ==== 97+0+0 (secure 0 0 0) 0x7fba94085900 con 0x7fba9c15f860 2024-05-09T05:05:56.326 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-05-09T05:05:56.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fba7c076300 msgr2=0x7fba7c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fba7c076300 0x7fba7c0787c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fba90000f60 tx=0x7fba90007cf0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 msgr2=0x7fba9c0b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 0x7fba9c0b2d30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba94009eb0 tx=0x7fba94004a40 comp rx=0 tx=0).stop 2024-05-09T05:05:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 shutdown_connections 2024-05-09T05:05:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fba7c076300 0x7fba7c0787c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba9c15f860 0x7fba9c0b2d30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba9c0d5c40 0x7fba9c0cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 --2- 172.21.15.100:0/126999522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba9c0d3700 0x7fba9c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.330+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 >> 172.21.15.100:0/126999522 conn(0x7fba9c0d5120 msgr2=0x7fba9c0d1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.331+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 shutdown_connections 2024-05-09T05:05:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.331+0000 7fbaa2c00640 1 -- 172.21.15.100:0/126999522 wait complete. 2024-05-09T05:05:56.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-09T05:05:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.555+0000 7f4d7a200640 1 Processor -- start 2024-05-09T05:05:56.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.555+0000 7f4d7a200640 1 -- start start 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.556+0000 7f4d7a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d74161730 0x7f4d740cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.556+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d740ce160 0x7f4d740cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.556+0000 7f4d7a200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d740ce580 con 0x7f4d74143710 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.556+0000 7f4d7a200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4d74160ce0 con 0x7f4d74161730 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.556+0000 7f4d7a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4d74143af0 con 0x7f4d740ce160 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d74161730 0x7f4d740cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d74161730 0x7f4d740cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52190/0 (socket says 172.21.15.100:52190) 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 -- 172.21.15.100:0/304339420 learned_addr learned my addr 172.21.15.100:0/304339420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d79800640 1 --2- 172.21.15.100:0/304339420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d740ce160 0x7f4d740cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:56.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 -- 172.21.15.100:0/304339420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d740ce160 msgr2=0x7f4d740cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:56.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 --2- 172.21.15.100:0/304339420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d740ce160 0x7f4d740cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 -- 172.21.15.100:0/304339420 >> v1:172.21.15.133:6789/0 conn(0x7f4d74143710 legacy=0x7f4d7415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:56.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.557+0000 7f4d73e00640 1 -- 172.21.15.100:0/304339420 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7415e240 con 0x7f4d74161730 2024-05-09T05:05:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.558+0000 7f4d73e00640 1 --2- 172.21.15.100:0/304339420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d74161730 0x7f4d740cdc20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4d74070640 tx=0x7f4d6002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8542d2eeb74358ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:56.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d73400640 1 -- 172.21.15.100:0/304339420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60037070 con 0x7f4d74161730 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d73400640 1 -- 172.21.15.100:0/304339420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6002ae50 con 0x7f4d74161730 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d73400640 1 -- 172.21.15.100:0/304339420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60032660 con 0x7f4d74161730 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 -- 172.21.15.100:0/304339420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d74161730 msgr2=0x7f4d740cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 --2- 172.21.15.100:0/304339420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d74161730 0x7f4d740cdc20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4d74070640 tx=0x7f4d6002a100 comp rx=0 tx=0).stop 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 -- 172.21.15.100:0/304339420 shutdown_connections 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 --2- 172.21.15.100:0/304339420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d740ce160 0x7f4d740cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 --2- 172.21.15.100:0/304339420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d74161730 0x7f4d740cdc20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 -- 172.21.15.100:0/304339420 >> 172.21.15.100:0/304339420 conn(0x7f4d7406c7f0 msgr2=0x7f4d7406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 -- 172.21.15.100:0/304339420 shutdown_connections 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.559+0000 7f4d7a200640 1 -- 172.21.15.100:0/304339420 wait complete. 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.561+0000 7f4d7a200640 1 Processor -- start 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.561+0000 7f4d7a200640 1 -- start start 2024-05-09T05:05:56.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 0x7f4d740cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d74143710 0x7f4d740cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d7a200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d74161730 0x7f4d740b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d7a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74161210 con 0x7f4d740ce160 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d7a200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74160f30 con 0x7f4d74161730 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d7a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4d74072490 con 0x7f4d74143710 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d78e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 0x7f4d740cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d78e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 0x7f4d740cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52192/0 (socket says 172.21.15.100:52192) 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.562+0000 7f4d78e00640 1 -- 172.21.15.100:0/1787605026 learned_addr learned my addr 172.21.15.100:0/1787605026 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d78e00640 1 -- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d74143710 msgr2=0x7f4d740cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d78e00640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d74143710 0x7f4d740cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d78e00640 1 -- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d74161730 msgr2=0x7f4d740b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d79800640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d74161730 0x7f4d740b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d78e00640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d74161730 0x7f4d740b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d78e00640 1 -- 172.21.15.100:0/1787605026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d740ca310 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d79800640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d74161730 0x7f4d740b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d78e00640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 0x7f4d740cbd20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c430 tx=0x7f4d6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68011790 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d68017070 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68011bb0 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.563+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d740ca5f0 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.564+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d74141b00 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.565+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7406a550 con 0x7f4d740ce160 2024-05-09T05:05:56.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.566+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4d6801c460 con 0x7f4d740ce160 2024-05-09T05:05:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.567+0000 7f4d70c00640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4d540762d0 0x7f4d54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.567+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f4d68097140 con 0x7f4d740ce160 2024-05-09T05:05:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.567+0000 7f4d73e00640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4d540762d0 0x7f4d54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:56.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.568+0000 7f4d73e00640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4d540762d0 0x7f4d54078790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4d60034000 tx=0x7f4d6002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:56.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.571+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4d68060de0 con 0x7f4d740ce160 2024-05-09T05:05:56.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.853+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4d7406fc30 con 0x7f4d740ce160 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.853+0000 7f4d70c00640 1 -- 172.21.15.100:0/1787605026 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f4d680606e0 con 0x7f4d740ce160 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-05-09T05:05:56.854 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmMGu+HxAAedx72Hw1h9YzVwqVN60b1w==", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmuj9cORAAmW56LGvbz1Lu7FgQssQ4Wg==", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:56.855 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmKnItKxAALO+XiqBeH/9/6zteDWPGvA==", 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.856 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmWFd0DBAA0BXHQlyp/O6oFwlY3+Snwg==", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAXWTxm0tb7CBAAaCbjNh5SvUxktzWNn9dbug==", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAaWTxmkkDbEhAAJD6Rjo599OgRt2FGwLdI5A==", 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.858 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAdWTxmbNqXLBAAvsCZhY6/iZuQndkG/lAAvQ==", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAhWTxmEAZWChAAlkyLgMXWyX4K7ql8FP9dVw==", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.859 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAnWTxmU1kFFRAAwIv6t79b7s3WdbYXgMRjjA==", 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-05-09T05:05:56.860 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAqWTxm3ziSIBAAjewlIROEUUbScj5tEban/A==", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAtWTxmcVhQOxAAfIu8Qjzh1QSQwuRdZMQZKQ==", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAxWTxmAGdBGRAAwKNCvC+t3oaZVQyu9qvwzQ==", 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxm/8wxGBAA16AyM9b+UYE5joYlLTmgZA==", 2024-05-09T05:05:56.862 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmw+GCKhAAPue97EzI+2Ht+SQeUd/IiA==", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.2", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmjSJlIBAA7FhCpTR8GjN+HUc6mGhUGA==", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.3", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQATWTxmfeNaMxAAp3g4lQmtsN3qZhpR9lFAIw==", 2024-05-09T05:05:56.864 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQARWTxmCL09FxAAgTcJtZKZBPh/O3/KIotCZA==", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmNJpBFhAAeSuOIiSNCPrByF3tsiJC5A==", 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQASWTxmfaioCRAAdB5Xwrdnd0j8A49mrNnLCQ==", 2024-05-09T05:05:56.866 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:05:56.867 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4d540762d0 msgr2=0x7f4d54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4d540762d0 0x7f4d54078790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4d60034000 tx=0x7f4d6002c000 comp rx=0 tx=0).stop 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 msgr2=0x7f4d740cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 0x7f4d740cbd20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800c430 tx=0x7f4d6800c8f0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 shutdown_connections 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4d540762d0 0x7f4d54078790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d74161730 0x7f4d740b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d74143710 0x7f4d740cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 --2- 172.21.15.100:0/1787605026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d740ce160 0x7f4d740cbd20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:56.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 >> 172.21.15.100:0/1787605026 conn(0x7f4d7406c7f0 msgr2=0x7f4d7406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:56.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 shutdown_connections 2024-05-09T05:05:56.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:56.856+0000 7f4d7a200640 1 -- 172.21.15.100:0/1787605026 wait complete. 2024-05-09T05:05:56.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T05:05:57.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.066+0000 7f44ae000640 1 Processor -- start 2024-05-09T05:05:57.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.066+0000 7f44ae000640 1 -- start start 2024-05-09T05:05:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.067+0000 7f44ae000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a8143710 0x7f44a8161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.067+0000 7f44ae000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f44a815d6c0 0x7f44a815db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.067+0000 7f44ae000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44a80cdc20 0x7f44a80ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.067+0000 7f44ae000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f44a80ce5b0 con 0x7f44a815d6c0 2024-05-09T05:05:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.067+0000 7f44ae000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f44a8160ce0 con 0x7f44a80cdc20 2024-05-09T05:05:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.067+0000 7f44ae000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f44a8161c70 con 0x7f44a8143710 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f44a815d6c0 0x7f44a815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f44a815d6c0 0x7f44a815db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52202/0 (socket says 172.21.15.100:52202) 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 -- 172.21.15.100:0/88504585 learned_addr learned my addr 172.21.15.100:0/88504585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44acc00640 1 --2- 172.21.15.100:0/88504585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a8143710 0x7f44a8161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44ad600640 1 --2- 172.21.15.100:0/88504585 >> v2:172.21.15.133:3300/0 conn(0x7f44a80cdc20 0x7f44a80ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 -- 172.21.15.100:0/88504585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a8143710 msgr2=0x7f44a8161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 --2- 172.21.15.100:0/88504585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a8143710 0x7f44a8161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 -- 172.21.15.100:0/88504585 >> v2:172.21.15.133:3300/0 conn(0x7f44a80cdc20 msgr2=0x7f44a80ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 --2- 172.21.15.100:0/88504585 >> v2:172.21.15.133:3300/0 conn(0x7f44a80cdc20 0x7f44a80ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.068+0000 7f44a7e00640 1 -- 172.21.15.100:0/88504585 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a8143af0 con 0x7f44a815d6c0 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.070+0000 7f44a7e00640 1 --2- 172.21.15.100:0/88504585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815db20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f44a8146fd0 tx=0x7f449c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1507c95f1088f06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.070+0000 7f44a7400640 1 -- 172.21.15.100:0/88504585 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c037070 con 0x7f44a815d6c0 2024-05-09T05:05:57.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.070+0000 7f44a7400640 1 -- 172.21.15.100:0/88504585 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449c032440 con 0x7f44a815d6c0 2024-05-09T05:05:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.070+0000 7f44a7400640 1 -- 172.21.15.100:0/88504585 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c032810 con 0x7f44a815d6c0 2024-05-09T05:05:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 -- 172.21.15.100:0/88504585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 msgr2=0x7f44a815db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 --2- 172.21.15.100:0/88504585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815db20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f44a8146fd0 tx=0x7f449c02a180 comp rx=0 tx=0).stop 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 -- 172.21.15.100:0/88504585 shutdown_connections 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 --2- 172.21.15.100:0/88504585 >> v2:172.21.15.133:3300/0 conn(0x7f44a80cdc20 0x7f44a80ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 --2- 172.21.15.100:0/88504585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815db20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 --2- 172.21.15.100:0/88504585 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a8143710 0x7f44a8161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 -- 172.21.15.100:0/88504585 >> 172.21.15.100:0/88504585 conn(0x7f44a806c7f0 msgr2=0x7f44a806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 -- 172.21.15.100:0/88504585 shutdown_connections 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.071+0000 7f44ae000640 1 -- 172.21.15.100:0/88504585 wait complete. 2024-05-09T05:05:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.073+0000 7f44ae000640 1 Processor -- start 2024-05-09T05:05:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.073+0000 7f44ae000640 1 -- start start 2024-05-09T05:05:57.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ae000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a80cdc20 0x7f44a80b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ae000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44a8143710 0x7f44a813a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ae000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ae000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44a8160f30 con 0x7f44a815d6c0 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ae000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f44a815e520 con 0x7f44a8143710 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ae000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f44a8161210 con 0x7f44a80cdc20 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52208/0 (socket says 172.21.15.100:52208) 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 -- 172.21.15.100:0/283399399 learned_addr learned my addr 172.21.15.100:0/283399399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44acc00640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a80cdc20 0x7f44a80b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44a7e00640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44a8143710 0x7f44a813a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 -- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a80cdc20 msgr2=0x7f44a80b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a80cdc20 0x7f44a80b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 -- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44a8143710 msgr2=0x7f44a813a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44a8143710 0x7f44a813a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.074+0000 7f44ad600640 1 -- 172.21.15.100:0/283399399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a813aa70 con 0x7f44a815d6c0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.075+0000 7f44ad600640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815ece0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f44a0007e90 tx=0x7f44a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.075+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a0014420 con 0x7f44a815d6c0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.075+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44a0019070 con 0x7f44a815d6c0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.075+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a0014820 con 0x7f44a815d6c0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.075+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a813ad50 con 0x7f44a815d6c0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.075+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a813b310 con 0x7f44a815d6c0 2024-05-09T05:05:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.076+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a806a550 con 0x7f44a815d6c0 2024-05-09T05:05:57.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.077+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f44a00149c0 con 0x7f44a815d6c0 2024-05-09T05:05:57.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.078+0000 7f44a4c00640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f44880762d0 0x7f4488078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.079+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7f44a0097b10 con 0x7f44a815d6c0 2024-05-09T05:05:57.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.079+0000 7f44acc00640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f44880762d0 0x7f4488078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.079+0000 7f44acc00640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f44880762d0 0x7f4488078790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4494006fd0 tx=0x7f4494008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:57.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.083+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f44a0061160 con 0x7f44a815d6c0 2024-05-09T05:05:57.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.286+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f44a806fc30 con 0x7f44a815d6c0 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.287+0000 7f44a4c00640 1 -- 172.21.15.100:0/283399399 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) ==== 84+0+65 (secure 0 0 0) 0x7f44a0065460 con 0x7f44a815d6c0 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T05:05:57.288 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.289+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f44880762d0 msgr2=0x7f4488078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.289+0000 7f44ae000640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f44880762d0 0x7f4488078790 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4494006fd0 tx=0x7f4494008040 comp rx=0 tx=0).stop 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 msgr2=0x7f44a815ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815ece0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f44a0007e90 tx=0x7f44a000e4b0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 shutdown_connections 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f44880762d0 0x7f4488078790 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44a815d6c0 0x7f44a815ece0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44a8143710 0x7f44a813a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 --2- 172.21.15.100:0/283399399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44a80cdc20 0x7f44a80b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 >> 172.21.15.100:0/283399399 conn(0x7f44a806c7f0 msgr2=0x7f44a806cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:57.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 shutdown_connections 2024-05-09T05:05:57.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.290+0000 7f44ae000640 1 -- 172.21.15.100:0/283399399 wait complete. 2024-05-09T05:05:57.309 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T05:05:57.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T05:05:57.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.499+0000 7fb9d2e00640 1 Processor -- start 2024-05-09T05:05:57.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.499+0000 7fb9d2e00640 1 -- start start 2024-05-09T05:05:57.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d2e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9cc147f10 0x7fb9cc074200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d2e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 0x7fb9cc0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d2e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9cc163790 con 0x7fb9cc148450 2024-05-09T05:05:57.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d2e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb9cc163a70 con 0x7fb9cc147f10 2024-05-09T05:05:57.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d2e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc0b40a0 con 0x7fb9cc0b32a0 2024-05-09T05:05:57.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d1000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb9cc148450 0x7fb9cc0b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49140/0 (socket says 172.21.15.100:49140) 2024-05-09T05:05:57.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.501+0000 7fb9d1000640 1 -- 172.21.15.100:0/1719326983 learned_addr learned my addr 172.21.15.100:0/1719326983 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9d2400640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 0x7fb9cc0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9d1a00640 1 --2- 172.21.15.100:0/1719326983 >> v2:172.21.15.133:3300/0 conn(0x7fb9cc147f10 0x7fb9cc074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453871139 0 0) 0x7fb9cc163790 con 0x7fb9cc148450 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9b4003520 con 0x7fb9cc148450 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1528351589 0 0) 0x7fb9b4003520 con 0x7fb9cc148450 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 msgr2=0x7fb9cc0b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 0x7fb9cc0b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 >> v2:172.21.15.133:3300/0 conn(0x7fb9cc147f10 msgr2=0x7fb9cc074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 --2- 172.21.15.100:0/1719326983 >> v2:172.21.15.133:3300/0 conn(0x7fb9cc147f10 0x7fb9cc074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc0b4380 con 0x7fb9cc148450 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fb9b80016f0 con 0x7fb9cc148450 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 >> v1:172.21.15.100:6789/0 conn(0x7fb9cc148450 legacy=0x7fb9cc0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 0x7fb9b4003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b4004d40 0x7fb9b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc163a70 con 0x7fb9b4004020 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc0b40a0 con 0x7fb9b4004d40 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.502+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b400ba70 con 0x7fb9cc0b32a0 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1000640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1a00640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 0x7fb9b4003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1000640 1 -- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 msgr2=0x7fb9b4003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:57.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1000640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc0b32a0 0x7fb9b4003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1000640 1 -- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b4004d40 msgr2=0x7fb9b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:57.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1000640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9b4004d40 0x7fb9b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.503+0000 7fb9d1000640 1 -- 172.21.15.100:0/1719326983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b4003520 con 0x7fb9b4004020 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.504+0000 7fb9d1000640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9b4004800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c160 tx=0x7fb9b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc635a13ed1c6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.504+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8007ca0 con 0x7fb9b4004020 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.504+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b8005ad0 con 0x7fb9b4004020 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.504+0000 7fb9cbe00640 1 -- 172.21.15.100:0/1719326983 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8007070 con 0x7fb9b4004020 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2e00640 1 -- 172.21.15.100:0/1719326983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 msgr2=0x7fb9b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/1719326983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9b4004800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c160 tx=0x7fb9b4005830 comp rx=0 tx=0).stop 2024-05-09T05:05:57.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2400640 1 -- 172.21.15.100:0/1719326983 reap_dead start 2024-05-09T05:05:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2e00640 1 -- 172.21.15.100:0/1719326983 shutdown_connections 2024-05-09T05:05:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2e00640 1 -- 172.21.15.100:0/1719326983 >> 172.21.15.100:0/1719326983 conn(0x7fb9cc06c3d0 msgr2=0x7fb9cc06c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2e00640 1 -- 172.21.15.100:0/1719326983 shutdown_connections 2024-05-09T05:05:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.505+0000 7fb9d2e00640 1 -- 172.21.15.100:0/1719326983 wait complete. 2024-05-09T05:05:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.507+0000 7fb9d2e00640 1 Processor -- start 2024-05-09T05:05:57.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.507+0000 7fb9d2e00640 1 -- start start 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d2e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9cc1330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d2e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc15e610 0x7fb9cc15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d2e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9cc15ea90 0x7fb9cc161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d2e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc0b47e0 con 0x7fb9b4004020 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d2e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc0b4660 con 0x7fb9cc15ea90 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d2e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc0b5fa0 con 0x7fb9cc15e610 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9cc1330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9cc1330a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52226/0 (socket says 172.21.15.100:52226) 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 -- 172.21.15.100:0/938705428 learned_addr learned my addr 172.21.15.100:0/938705428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 -- 172.21.15.100:0/938705428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc15e610 msgr2=0x7fb9cc15fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc15e610 0x7fb9cc15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 -- 172.21.15.100:0/938705428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9cc15ea90 msgr2=0x7fb9cc161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9cc15ea90 0x7fb9cc161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 -- 172.21.15.100:0/938705428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc160ab0 con 0x7fb9b4004020 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.508+0000 7fb9d1a00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9cc1330a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00115a0 tx=0x7fb9c0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.509+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0015930 con 0x7fb9b4004020 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.509+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c0015ad0 con 0x7fb9b4004020 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.509+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000f480 con 0x7fb9b4004020 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.509+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9cc160d90 con 0x7fb9b4004020 2024-05-09T05:05:57.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.509+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9cc161350 con 0x7fb9b4004020 2024-05-09T05:05:57.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.510+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc06a630 con 0x7fb9b4004020 2024-05-09T05:05:57.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.511+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb9c000f620 con 0x7fb9b4004020 2024-05-09T05:05:57.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.512+0000 7fb9c9600640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb9ac0762d0 0x7fb9ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:57.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.512+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4857+0+0 (secure 0 0 0) 0x7fb9c0097be0 con 0x7fb9b4004020 2024-05-09T05:05:57.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.512+0000 7fb9d1000640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb9ac0762d0 0x7fb9ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:57.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.513+0000 7fb9d1000640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb9ac0762d0 0x7fb9ac078790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8032000 tx=0x7fb9b8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:57.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.516+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb9c0019030 con 0x7fb9b4004020 2024-05-09T05:05:57.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:57.704+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb9cc0d0700 con 0x7fb9b4004020 2024-05-09T05:05:58.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.342+0000 7fb9c9600640 1 -- 172.21.15.100:0/938705428 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) ==== 138+0+0 (secure 0 0 0) 0x7fb9c00617f0 con 0x7fb9b4004020 2024-05-09T05:05:58.344 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb9ac0762d0 msgr2=0x7fb9ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb9ac0762d0 0x7fb9ac078790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8032000 tx=0x7fb9b8007000 comp rx=0 tx=0).stop 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 msgr2=0x7fb9cc1330a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9cc1330a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00115a0 tx=0x7fb9c0011a60 comp rx=0 tx=0).stop 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 shutdown_connections 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb9ac0762d0 0x7fb9ac078790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9cc15ea90 0x7fb9cc161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb9cc15e610 0x7fb9cc15fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 --2- 172.21.15.100:0/938705428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9b4004020 0x7fb9cc1330a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 >> 172.21.15.100:0/938705428 conn(0x7fb9cc06c3d0 msgr2=0x7fb9cc1426e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:58.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.347+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 shutdown_connections 2024-05-09T05:05:58.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.348+0000 7fb9d2e00640 1 -- 172.21.15.100:0/938705428 wait complete. 2024-05-09T05:05:58.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T05:05:58.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.566+0000 7f2c17200640 1 Processor -- start 2024-05-09T05:05:58.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.566+0000 7f2c17200640 1 -- start start 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.567+0000 7f2c17200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c1815f420 0x7f2c180d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.567+0000 7f2c17200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d2280 0x7f2c180b8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.567+0000 7f2c17200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c180d2de0 con 0x7f2c180d0e90 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.567+0000 7f2c17200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2c180d3080 con 0x7f2c1815f420 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.567+0000 7f2c17200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2c180d3360 con 0x7f2c180d2280 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c1815f420 0x7f2c180d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c1815f420 0x7f2c180d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52236/0 (socket says 172.21.15.100:52236) 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 -- 172.21.15.100:0/807933024 learned_addr learned my addr 172.21.15.100:0/807933024 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c16800640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d2280 0x7f2c180b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 -- 172.21.15.100:0/807933024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d2280 msgr2=0x7f2c180b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:58.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d2280 0x7f2c180b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 -- 172.21.15.100:0/807933024 >> v1:172.21.15.100:6789/0 conn(0x7f2c180d0e90 legacy=0x7f2c180d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:58.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15e00640 1 -- 172.21.15.100:0/807933024 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c180d3640 con 0x7f2c1815f420 2024-05-09T05:05:58.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c15400640 1 -- 172.21.15.100:0/807933024 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900115503 0 0) 0x7f2c180d2de0 con 0x7f2c180d0e90 2024-05-09T05:05:58.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.568+0000 7f2c16800640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d2280 0x7f2c180b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.569+0000 7f2c15e00640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1815f420 0x7f2c180d0950 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009e50 tx=0x7f2c0802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde4efc5aae2c346 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c15400640 1 -- 172.21.15.100:0/807933024 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08036070 con 0x7f2c1815f420 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c15400640 1 -- 172.21.15.100:0/807933024 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c08031600 con 0x7f2c1815f420 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c15400640 1 -- 172.21.15.100:0/807933024 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c080319d0 con 0x7f2c1815f420 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c17200640 1 -- 172.21.15.100:0/807933024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1815f420 msgr2=0x7f2c180d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c17200640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1815f420 0x7f2c180d0950 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009e50 tx=0x7f2c0802a710 comp rx=0 tx=0).stop 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c17200640 1 -- 172.21.15.100:0/807933024 shutdown_connections 2024-05-09T05:05:58.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c17200640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d2280 0x7f2c180b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c17200640 1 --2- 172.21.15.100:0/807933024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1815f420 0x7f2c180d0950 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.570+0000 7f2c17200640 1 -- 172.21.15.100:0/807933024 >> 172.21.15.100:0/807933024 conn(0x7f2c1809e550 msgr2=0x7f2c180d5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.571+0000 7f2c17200640 1 -- 172.21.15.100:0/807933024 shutdown_connections 2024-05-09T05:05:58.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.571+0000 7f2c17200640 1 -- 172.21.15.100:0/807933024 wait complete. 2024-05-09T05:05:58.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.572+0000 7f2c17200640 1 Processor -- start 2024-05-09T05:05:58.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.572+0000 7f2c17200640 1 -- start start 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.573+0000 7f2c17200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d0e90 0x7f2c181f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.573+0000 7f2c17200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 0x7f2c180b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.573+0000 7f2c17200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1815f420 0x7f2c1806e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.573+0000 7f2c17200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c180d4120 con 0x7f2c180d2280 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.573+0000 7f2c17200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2c180d3c00 con 0x7f2c1815f420 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.573+0000 7f2c17200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2c180d42a0 con 0x7f2c180d0e90 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 0x7f2c180b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 0x7f2c180b9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52238/0 (socket says 172.21.15.100:52238) 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 -- 172.21.15.100:0/1033302884 learned_addr learned my addr 172.21.15.100:0/1033302884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:58.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c15e00640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d0e90 0x7f2c181f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 -- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d0e90 msgr2=0x7f2c181f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d0e90 0x7f2c181f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 -- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1815f420 msgr2=0x7f2c1806e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c16800640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1815f420 0x7f2c1806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1815f420 0x7f2c1806e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 -- 172.21.15.100:0/1033302884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c180b7e00 con 0x7f2c180d2280 2024-05-09T05:05:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.574+0000 7f2c0d400640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 0x7f2c180b9ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c500 tx=0x7f2c0000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.575+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00017070 con 0x7f2c180d2280 2024-05-09T05:05:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.575+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c000035f0 con 0x7f2c180d2280 2024-05-09T05:05:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.575+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00003a20 con 0x7f2c180d2280 2024-05-09T05:05:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.575+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c181f57c0 con 0x7f2c180d2280 2024-05-09T05:05:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.575+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c181f5d80 con 0x7f2c180d2280 2024-05-09T05:05:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.576+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c18069c10 con 0x7f2c180d2280 2024-05-09T05:05:58.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.577+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c0001a070 con 0x7f2c180d2280 2024-05-09T05:05:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.578+0000 7f2c0ea00640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf4076300 0x7f2bf40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.578+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5227+0+0 (secure 0 0 0) 0x7f2c000968a0 con 0x7f2c180d2280 2024-05-09T05:05:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.579+0000 7f2c15e00640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf4076300 0x7f2bf40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.579+0000 7f2c15e00640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf4076300 0x7f2bf40787c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c08033000 tx=0x7f2c08009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:58.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.584+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c18069c10 con 0x7f2c180d2280 2024-05-09T05:05:58.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:58.791+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2c180b9a30 con 0x7f2c180d2280 2024-05-09T05:05:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.348+0000 7f2c0ea00640 1 -- 172.21.15.100:0/1033302884 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) ==== 170+0+0 (secure 0 0 0) 0x7f2c000603d0 con 0x7f2c180d2280 2024-05-09T05:05:59.351 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-05-09T05:05:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf4076300 msgr2=0x7f2bf40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf4076300 0x7f2bf40787c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2c08033000 tx=0x7f2c08009000 comp rx=0 tx=0).stop 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 msgr2=0x7f2c180b9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 0x7f2c180b9ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c500 tx=0x7f2c0000c9c0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 shutdown_connections 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf4076300 0x7f2bf40787c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1815f420 0x7f2c1806e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c180d2280 0x7f2c180b9ef0 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c500 tx=0x7f2c0000c9c0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 --2- 172.21.15.100:0/1033302884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c180d0e90 0x7f2c181f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.354+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 >> 172.21.15.100:0/1033302884 conn(0x7f2c1809e550 msgr2=0x7f2c1815f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.355+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 shutdown_connections 2024-05-09T05:05:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.355+0000 7f2c17200640 1 -- 172.21.15.100:0/1033302884 wait complete. 2024-05-09T05:05:59.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T05:05:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.568+0000 7f4c45600640 1 Processor -- start 2024-05-09T05:05:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.568+0000 7f4c45600640 1 -- start start 2024-05-09T05:05:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.569+0000 7f4c45600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c4015c640 0x7f4c400b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.569+0000 7f4c45600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c400ae350 0x7f4c400ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.569+0000 7f4c45600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c400cdd30 con 0x7f4c4006f590 2024-05-09T05:05:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.569+0000 7f4c45600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4c400ce010 con 0x7f4c4015c640 2024-05-09T05:05:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.569+0000 7f4c45600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f4c400ce2f0 con 0x7f4c400ae350 2024-05-09T05:05:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c4015c640 0x7f4c400b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c4015c640 0x7f4c400b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52242/0 (socket says 172.21.15.100:52242) 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 -- 172.21.15.100:0/4197507862 learned_addr learned my addr 172.21.15.100:0/4197507862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 -- 172.21.15.100:0/4197507862 >> v2:172.21.15.133:3300/0 conn(0x7f4c400ae350 msgr2=0x7f4c400ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3f400640 1 --2- 172.21.15.100:0/4197507862 >> v2:172.21.15.133:3300/0 conn(0x7f4c400ae350 0x7f4c400ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 --2- 172.21.15.100:0/4197507862 >> v2:172.21.15.133:3300/0 conn(0x7f4c400ae350 0x7f4c400ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 -- 172.21.15.100:0/4197507862 >> v1:172.21.15.133:6789/0 conn(0x7f4c4006f590 legacy=0x7f4c4006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3e000640 1 -- 172.21.15.100:0/4197507862 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400ce5d0 con 0x7f4c4015c640 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.570+0000 7f4c3f400640 1 --2- 172.21.15.100:0/4197507862 >> v2:172.21.15.133:3300/0 conn(0x7f4c400ae350 0x7f4c400ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.571+0000 7f4c3e000640 1 --2- 172.21.15.100:0/4197507862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c400b4800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c400720e0 tx=0x7f4c2c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65bf3fb2471b5fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c3d600640 1 -- 172.21.15.100:0/4197507862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c037070 con 0x7f4c4015c640 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c3d600640 1 -- 172.21.15.100:0/4197507862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2c032440 con 0x7f4c4015c640 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c3d600640 1 -- 172.21.15.100:0/4197507862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c032810 con 0x7f4c4015c640 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 -- 172.21.15.100:0/4197507862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 msgr2=0x7f4c400b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 --2- 172.21.15.100:0/4197507862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c400b4800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c400720e0 tx=0x7f4c2c02a140 comp rx=0 tx=0).stop 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 -- 172.21.15.100:0/4197507862 shutdown_connections 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 --2- 172.21.15.100:0/4197507862 >> v2:172.21.15.133:3300/0 conn(0x7f4c400ae350 0x7f4c400ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 --2- 172.21.15.100:0/4197507862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c400b4800 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 -- 172.21.15.100:0/4197507862 >> 172.21.15.100:0/4197507862 conn(0x7f4c400b2c90 msgr2=0x7f4c400b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:05:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 -- 172.21.15.100:0/4197507862 shutdown_connections 2024-05-09T05:05:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.572+0000 7f4c45600640 1 -- 172.21.15.100:0/4197507862 wait complete. 2024-05-09T05:05:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.574+0000 7f4c45600640 1 Processor -- start 2024-05-09T05:05:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.574+0000 7f4c45600640 1 -- start start 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c45600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4006f590 0x7f4c4014d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c45600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c400ae350 0x7f4c401e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c45600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c4006e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c45600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400cdaf0 con 0x7f4c4015c640 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c45600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400cd970 con 0x7f4c4006f590 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c45600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400d0660 con 0x7f4c400ae350 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.575+0000 7f4c3f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c4006e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c4006e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52248/0 (socket says 172.21.15.100:52248) 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 -- 172.21.15.100:0/3087764722 learned_addr learned my addr 172.21.15.100:0/3087764722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:05:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3ea00640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4006f590 0x7f4c4014d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3e000640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c400ae350 0x7f4c401e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 -- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c400ae350 msgr2=0x7f4c401e4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c400ae350 0x7f4c401e4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 -- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4006f590 msgr2=0x7f4c4014d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4006f590 0x7f4c4014d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 -- 172.21.15.100:0/3087764722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400ca680 con 0x7f4c4015c640 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3ea00640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4006f590 0x7f4c4014d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3e000640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c400ae350 0x7f4c401e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c3f400640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c4006e480 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800cef0 tx=0x7f4c3800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.576+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3801a070 con 0x7f4c4015c640 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.577+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3800d860 con 0x7f4c4015c640 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.577+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800dc50 con 0x7f4c4015c640 2024-05-09T05:05:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.577+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c400ca960 con 0x7f4c4015c640 2024-05-09T05:05:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.577+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c400caf20 con 0x7f4c4015c640 2024-05-09T05:05:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.578+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4006a630 con 0x7f4c4015c640 2024-05-09T05:05:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.579+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c3801d070 con 0x7f4c4015c640 2024-05-09T05:05:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.580+0000 7f4c36a00640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4c20076300 0x7f4c200787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:05:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.580+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5609+0+0 (secure 0 0 0) 0x7f4c380982b0 con 0x7f4c4015c640 2024-05-09T05:05:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.581+0000 7f4c3ea00640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4c20076300 0x7f4c200787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:05:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.581+0000 7f4c3ea00640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4c20076300 0x7f4c200787c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000a830 tx=0x7f4c30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:05:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.584+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4c38024020 con 0x7f4c4015c640 2024-05-09T05:05:59.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:05:59.820+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4c4006d3e0 con 0x7f4c4015c640 2024-05-09T05:06:00.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.377+0000 7f4c36a00640 1 -- 172.21.15.100:0/3087764722 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v24) ==== 172+0+0 (secure 0 0 0) 0x7f4c38061d10 con 0x7f4c4015c640 2024-05-09T05:06:00.379 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 7 and data pool 8 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4c20076300 msgr2=0x7f4c200787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4c20076300 0x7f4c200787c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000a830 tx=0x7f4c30008040 comp rx=0 tx=0).stop 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 msgr2=0x7f4c4006e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c4006e480 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800cef0 tx=0x7f4c3800a710 comp rx=0 tx=0).stop 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 shutdown_connections 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4c20076300 0x7f4c200787c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c4015c640 0x7f4c4006e480 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c400ae350 0x7f4c401e4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 --2- 172.21.15.100:0/3087764722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c4006f590 0x7f4c4014d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.381+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 >> 172.21.15.100:0/3087764722 conn(0x7f4c400b2c90 msgr2=0x7f4c4015b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:00.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.382+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 shutdown_connections 2024-05-09T05:06:00.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.382+0000 7f4c45600640 1 -- 172.21.15.100:0/3087764722 wait complete. 2024-05-09T05:06:00.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.592+0000 7f004ba00640 1 Processor -- start 2024-05-09T05:06:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.592+0000 7f004ba00640 1 -- start start 2024-05-09T05:06:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.593+0000 7f004ba00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00440b3eb0 0x7f00440b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.593+0000 7f004ba00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f004406ead0 con 0x7f0044145900 2024-05-09T05:06:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f004ba00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f004406ed40 con 0x7f004406f820 2024-05-09T05:06:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f004ba00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f00440b4850 con 0x7f00440b3eb0 2024-05-09T05:06:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f0043e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00440b3eb0 0x7f00440b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f0043e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00440b3eb0 0x7f00440b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52250/0 (socket says 172.21.15.100:52250) 2024-05-09T05:06:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f0043e00640 1 -- 172.21.15.100:0/2792134535 learned_addr learned my addr 172.21.15.100:0/2792134535 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f0043e00640 1 -- 172.21.15.100:0/2792134535 >> v1:172.21.15.133:6789/0 conn(0x7f004406f820 legacy=0x7f004406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f0043e00640 1 -- 172.21.15.100:0/2792134535 >> v1:172.21.15.100:6789/0 conn(0x7f0044145900 legacy=0x7f0044073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.594+0000 7f0043e00640 1 -- 172.21.15.100:0/2792134535 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004406f020 con 0x7f00440b3eb0 2024-05-09T05:06:00.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.595+0000 7f0043e00640 1 --2- 172.21.15.100:0/2792134535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440b4310 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0030009e80 tx=0x7f003002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a951a807baace28 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:00.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f0043400640 1 -- 172.21.15.100:0/2792134535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030036070 con 0x7f00440b3eb0 2024-05-09T05:06:00.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f0043400640 1 -- 172.21.15.100:0/2792134535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0030031600 con 0x7f00440b3eb0 2024-05-09T05:06:00.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f0043400640 1 -- 172.21.15.100:0/2792134535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300319d0 con 0x7f00440b3eb0 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f004ba00640 1 -- 172.21.15.100:0/2792134535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 msgr2=0x7f00440b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f004ba00640 1 --2- 172.21.15.100:0/2792134535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440b4310 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0030009e80 tx=0x7f003002a750 comp rx=0 tx=0).stop 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f004ba00640 1 -- 172.21.15.100:0/2792134535 shutdown_connections 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f004ba00640 1 --2- 172.21.15.100:0/2792134535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440b4310 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f004ba00640 1 -- 172.21.15.100:0/2792134535 >> 172.21.15.100:0/2792134535 conn(0x7f00440b31e0 msgr2=0x7f00440d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.596+0000 7f004ba00640 1 -- 172.21.15.100:0/2792134535 shutdown_connections 2024-05-09T05:06:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.597+0000 7f004ba00640 1 -- 172.21.15.100:0/2792134535 wait complete. 2024-05-09T05:06:00.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.598+0000 7f004ba00640 1 Processor -- start 2024-05-09T05:06:00.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.598+0000 7f004ba00640 1 -- start start 2024-05-09T05:06:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.599+0000 7f004ba00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f004406f820 0x7f00441f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.599+0000 7f004ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.599+0000 7f004ba00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0044145900 0x7f0044162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.599+0000 7f004ba00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0044073e70 con 0x7f00440b3eb0 2024-05-09T05:06:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.599+0000 7f004ba00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f004406f390 con 0x7f0044145900 2024-05-09T05:06:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.599+0000 7f004ba00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f00440ade90 con 0x7f004406f820 2024-05-09T05:06:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52266/0 (socket says 172.21.15.100:52266) 2024-05-09T05:06:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 -- 172.21.15.100:0/1280919120 learned_addr learned my addr 172.21.15.100:0/1280919120 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0049000640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f004406f820 0x7f00441f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0049a00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0044145900 0x7f0044162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 -- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f004406f820 msgr2=0x7f00441f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f004406f820 0x7f00441f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 -- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0044145900 msgr2=0x7f0044162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0044145900 0x7f0044162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.600+0000 7f0043e00640 1 -- 172.21.15.100:0/1280919120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00440b0780 con 0x7f00440b3eb0 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.601+0000 7f0043e00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440afe10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0030034040 tx=0x7f0030004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.601+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030041020 con 0x7f00440b3eb0 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.601+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0030007820 con 0x7f00440b3eb0 2024-05-09T05:06:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.601+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00440b0a60 con 0x7f00440b3eb0 2024-05-09T05:06:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.601+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030036040 con 0x7f00440b3eb0 2024-05-09T05:06:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.601+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00440b1020 con 0x7f00440b3eb0 2024-05-09T05:06:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.602+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0044076070 con 0x7f00440b3eb0 2024-05-09T05:06:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.603+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0030044020 con 0x7f00440b3eb0 2024-05-09T05:06:00.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.604+0000 7f0040c00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f00240762d0 0x7f0024078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:00.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.604+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f00300b8400 con 0x7f00440b3eb0 2024-05-09T05:06:00.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.604+0000 7f0049000640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f00240762d0 0x7f0024078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:00.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.605+0000 7f0049000640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f00240762d0 0x7f0024078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0044163b90 tx=0x7f0034009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:00.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.609+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f003004b030 con 0x7f00440b3eb0 2024-05-09T05:06:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.809+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0044148cd0 con 0x7f00440b3eb0 2024-05-09T05:06:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.810+0000 7f0040c00640 1 -- 172.21.15.100:0/1280919120 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16706 (secure 0 0 0) 0x7f0044148cd0 con 0x7f00440b3eb0 2024-05-09T05:06:00.813 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:00.813 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":46,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:59.823486+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f00240762d0 msgr2=0x7f0024078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f00240762d0 0x7f0024078790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0044163b90 tx=0x7f0034009040 comp rx=0 tx=0).stop 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 msgr2=0x7f00440afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440afe10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0030034040 tx=0x7f0030004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 shutdown_connections 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f00240762d0 0x7f0024078790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0044145900 0x7f0044162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00440b3eb0 0x7f00440afe10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 --2- 172.21.15.100:0/1280919120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f004406f820 0x7f00441f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:00.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.813+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 >> 172.21.15.100:0/1280919120 conn(0x7f00440b31e0 msgr2=0x7f00441485c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:00.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.814+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 shutdown_connections 2024-05-09T05:06:00.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:00.814+0000 7f004ba00640 1 -- 172.21.15.100:0/1280919120 wait complete. 2024-05-09T05:06:00.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:01.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.011+0000 7fa02ac00640 1 Processor -- start 2024-05-09T05:06:01.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.011+0000 7fa02ac00640 1 -- start start 2024-05-09T05:06:01.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa02ac00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa02415e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa02ac00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0240ade90 0x7fa0240b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa02ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02415e780 con 0x7fa0240afb70 2024-05-09T05:06:01.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa02ac00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa0240b55b0 con 0x7fa0240ade90 2024-05-09T05:06:01.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa02ac00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa0240ae3a0 con 0x7fa0240d0a70 2024-05-09T05:06:01.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa028c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa0240afb70 0x7fa0240affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49166/0 (socket says 172.21.15.100:49166) 2024-05-09T05:06:01.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa028c00640 1 -- 172.21.15.100:0/501250323 learned_addr learned my addr 172.21.15.100:0/501250323 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:01.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa023400640 1 --2- 172.21.15.100:0/501250323 >> v2:172.21.15.100:3300/0 conn(0x7fa0240ade90 0x7fa0240b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa023e00640 1 --2- 172.21.15.100:0/501250323 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa02415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.013+0000 7fa022a00640 1 -- 172.21.15.100:0/501250323 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178682891 0 0) 0x7fa01c001490 con 0x7fa0240afb70 2024-05-09T05:06:01.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.014+0000 7fa022a00640 1 -- 172.21.15.100:0/501250323 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa008003520 con 0x7fa0240afb70 2024-05-09T05:06:01.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.014+0000 7fa023400640 1 -- 172.21.15.100:0/501250323 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 msgr2=0x7fa02415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.014+0000 7fa023400640 1 --2- 172.21.15.100:0/501250323 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa02415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.014+0000 7fa023400640 1 -- 172.21.15.100:0/501250323 >> v1:172.21.15.100:6789/0 conn(0x7fa0240afb70 legacy=0x7fa0240affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.014+0000 7fa023400640 1 -- 172.21.15.100:0/501250323 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0240b4590 con 0x7fa0240ade90 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.015+0000 7fa023400640 1 --2- 172.21.15.100:0/501250323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa0240b5070 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa0100097a0 tx=0x7fa01002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7e164cd7dd2d4b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.015+0000 7fa022a00640 1 -- 172.21.15.100:0/501250323 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa010037070 con 0x7fa0240ade90 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.015+0000 7fa022a00640 1 -- 172.21.15.100:0/501250323 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa010032440 con 0x7fa0240ade90 2024-05-09T05:06:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.015+0000 7fa022a00640 1 -- 172.21.15.100:0/501250323 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100327f0 con 0x7fa0240ade90 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 -- 172.21.15.100:0/501250323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 msgr2=0x7fa0240b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 --2- 172.21.15.100:0/501250323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa0240b5070 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa0100097a0 tx=0x7fa01002a180 comp rx=0 tx=0).stop 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 -- 172.21.15.100:0/501250323 shutdown_connections 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 --2- 172.21.15.100:0/501250323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa0240b5070 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 --2- 172.21.15.100:0/501250323 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa02415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 -- 172.21.15.100:0/501250323 >> 172.21.15.100:0/501250323 conn(0x7fa0240b31e0 msgr2=0x7fa0240d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 -- 172.21.15.100:0/501250323 shutdown_connections 2024-05-09T05:06:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.016+0000 7fa02ac00640 1 -- 172.21.15.100:0/501250323 wait complete. 2024-05-09T05:06:01.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.018+0000 7fa02ac00640 1 Processor -- start 2024-05-09T05:06:01.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.018+0000 7fa02ac00640 1 -- start start 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.018+0000 7fa02ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa02409d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa02ac00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240afb70 0x7fa024154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa02ac00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa0241f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa02ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240ae680 con 0x7fa0240ade90 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa02ac00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240b4b50 con 0x7fa0240afb70 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa02ac00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa024072570 con 0x7fa0240d0a70 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa02409d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa02409d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52284/0 (socket says 172.21.15.100:52284) 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 -- 172.21.15.100:0/2790802816 learned_addr learned my addr 172.21.15.100:0/2790802816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 -- 172.21.15.100:0/2790802816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 msgr2=0x7fa0241f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa0241f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 -- 172.21.15.100:0/2790802816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240afb70 msgr2=0x7fa024154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240afb70 0x7fa024154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.019+0000 7fa023e00640 1 -- 172.21.15.100:0/2790802816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02409c440 con 0x7fa0240ade90 2024-05-09T05:06:01.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.020+0000 7fa023e00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa02409d4e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa01400d620 tx=0x7fa01400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.020+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140125f0 con 0x7fa0240ade90 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.020+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa014019070 con 0x7fa0240ade90 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.020+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02409c720 con 0x7fa0240ade90 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.020+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140129b0 con 0x7fa0240ade90 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.020+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa02409cce0 con 0x7fa0240ade90 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.021+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa024076070 con 0x7fa0240ade90 2024-05-09T05:06:01.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.022+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa014012b50 con 0x7fa0240ade90 2024-05-09T05:06:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.023+0000 7fa01be00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa004076300 0x7fa0040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.023+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa014097950 con 0x7fa0240ade90 2024-05-09T05:06:01.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.023+0000 7fa023400640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa004076300 0x7fa0040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.024+0000 7fa023400640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa004076300 0x7fa0040787c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa010034000 tx=0x7fa01002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:01.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.028+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa014061320 con 0x7fa0240ade90 2024-05-09T05:06:01.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.218+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa02409ef90 con 0x7fa0240ade90 2024-05-09T05:06:01.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.220+0000 7fa01be00640 1 -- 172.21.15.100:0/2790802816 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16706 (secure 0 0 0) 0x7fa014060c20 con 0x7fa0240ade90 2024-05-09T05:06:01.223 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:01.224 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":46,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:05:59.823486+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:01.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa004076300 msgr2=0x7fa0040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa004076300 0x7fa0040787c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa010034000 tx=0x7fa01002c000 comp rx=0 tx=0).stop 2024-05-09T05:06:01.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 msgr2=0x7fa02409d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa02409d4e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa01400d620 tx=0x7fa01400dae0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 shutdown_connections 2024-05-09T05:06:01.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa004076300 0x7fa0040787c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0240d0a70 0x7fa0241f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0240afb70 0x7fa024154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 --2- 172.21.15.100:0/2790802816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0240ade90 0x7fa02409d4e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.222+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 >> 172.21.15.100:0/2790802816 conn(0x7fa0240b31e0 msgr2=0x7fa024072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.223+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 shutdown_connections 2024-05-09T05:06:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.223+0000 7fa02ac00640 1 -- 172.21.15.100:0/2790802816 wait complete. 2024-05-09T05:06:01.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T05:06:01.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.433+0000 7f6372800640 1 Processor -- start 2024-05-09T05:06:01.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.434+0000 7f6372800640 1 -- start start 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6372800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f410 0x7f636c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6372800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f636c0d21b0 0x7f636c0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6372800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636c0d3eb0 con 0x7f636c15f7f0 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6372800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f636c0d4190 con 0x7f636c0d21b0 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6372800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f636c0cffd0 con 0x7f636c15f410 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6370a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f636c15f7f0 0x7f636c0d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49180/0 (socket says 172.21.15.100:49180) 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6370a00640 1 -- 172.21.15.100:0/3065528293 learned_addr learned my addr 172.21.15.100:0/3065528293 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.435+0000 7f6371e00640 1 --2- 172.21.15.100:0/3065528293 >> v2:172.21.15.100:3300/0 conn(0x7f636c0d21b0 0x7f636c0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f6371400640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f410 0x7f636c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f636be00640 1 -- 172.21.15.100:0/3065528293 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757216396 0 0) 0x7f636c0d3eb0 con 0x7f636c15f7f0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f636be00640 1 -- 172.21.15.100:0/3065528293 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6354003520 con 0x7f636c15f7f0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f6371e00640 1 -- 172.21.15.100:0/3065528293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f410 msgr2=0x7f636c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f6371e00640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f410 0x7f636c0b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f6371e00640 1 -- 172.21.15.100:0/3065528293 >> v1:172.21.15.100:6789/0 conn(0x7f636c15f7f0 legacy=0x7f636c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f6371e00640 1 -- 172.21.15.100:0/3065528293 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c0d02b0 con 0x7f636c0d21b0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.436+0000 7f6371400640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f410 0x7f636c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.437+0000 7f6371e00640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c0d0ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6364009d90 tx=0x7f636402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b5e9327aee1159 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.437+0000 7f636be00640 1 -- 172.21.15.100:0/3065528293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364007740 con 0x7f636c0d21b0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.437+0000 7f636be00640 1 -- 172.21.15.100:0/3065528293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63640078e0 con 0x7f636c0d21b0 2024-05-09T05:06:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.437+0000 7f636be00640 1 -- 172.21.15.100:0/3065528293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364007c90 con 0x7f636c0d21b0 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 -- 172.21.15.100:0/3065528293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 msgr2=0x7f636c0d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c0d0ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6364009d90 tx=0x7f636402a6f0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 -- 172.21.15.100:0/3065528293 shutdown_connections 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c0d0ab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 --2- 172.21.15.100:0/3065528293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f410 0x7f636c0b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 -- 172.21.15.100:0/3065528293 >> 172.21.15.100:0/3065528293 conn(0x7f636c0d5100 msgr2=0x7f636c0d5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 -- 172.21.15.100:0/3065528293 shutdown_connections 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.438+0000 7f6372800640 1 -- 172.21.15.100:0/3065528293 wait complete. 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.440+0000 7f6372800640 1 Processor -- start 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.440+0000 7f6372800640 1 -- start start 2024-05-09T05:06:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6372800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c1f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6372800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f636c15f410 0x7f636c1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6372800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f7f0 0x7f636c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6372800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0d5c20 con 0x7f636c0d21b0 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6372800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0b4780 con 0x7f636c15f410 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6372800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f636c0d5da0 con 0x7f636c15f7f0 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c1f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c1f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52298/0 (socket says 172.21.15.100:52298) 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 -- 172.21.15.100:0/4239566514 learned_addr learned my addr 172.21.15.100:0/4239566514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 -- 172.21.15.100:0/4239566514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f7f0 msgr2=0x7f636c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f7f0 0x7f636c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 -- 172.21.15.100:0/4239566514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f636c15f410 msgr2=0x7f636c1f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f636c15f410 0x7f636c1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.441+0000 7f6371400640 1 -- 172.21.15.100:0/4239566514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c1f5ff0 con 0x7f636c0d21b0 2024-05-09T05:06:01.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.442+0000 7f6371400640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c1f9080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f636000e7e0 tx=0x7f636000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.442+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636000f040 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.442+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6360004030 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.442+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360004400 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.442+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c0b9eb0 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.442+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c1f8880 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.443+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c06a550 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.444+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f636000c670 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.445+0000 7f6369600640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f634c076300 0x7f634c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.445+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f6360097310 con 0x7f636c0d21b0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.445+0000 7f6370a00640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f634c076300 0x7f634c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.446+0000 7f6370a00640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f634c076300 0x7f634c0787c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6358001220 tx=0x7f63580078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:01.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.449+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6360017020 con 0x7f636c0d21b0 2024-05-09T05:06:01.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:01.696+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f636c068b90 con 0x7f636c0d21b0 2024-05-09T05:06:02.338 INFO:tasks.ceph.mds.b.smithi133.stderr:2024-05-09T05:06:02.338+0000 7f7e8a400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:06:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.422+0000 7f6369600640 1 -- 172.21.15.100:0/4239566514 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f6360060c60 con 0x7f636c0d21b0 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f634c076300 msgr2=0x7f634c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f634c076300 0x7f634c0787c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6358001220 tx=0x7f63580078f0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 msgr2=0x7f636c1f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c1f9080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f636000e7e0 tx=0x7f636000eca0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 shutdown_connections 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f634c076300 0x7f634c0787c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f636c15f7f0 0x7f636c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f636c15f410 0x7f636c1f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 --2- 172.21.15.100:0/4239566514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636c0d21b0 0x7f636c1f9080 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 >> 172.21.15.100:0/4239566514 conn(0x7f636c0d5100 msgr2=0x7f636c0b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 shutdown_connections 2024-05-09T05:06:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.426+0000 7f6372800640 1 -- 172.21.15.100:0/4239566514 wait complete. 2024-05-09T05:06:02.449 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-09T05:06:02.450 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-09T05:06:02.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.649+0000 7f2fcd600640 1 Processor -- start 2024-05-09T05:06:02.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.649+0000 7f2fcd600640 1 -- start start 2024-05-09T05:06:02.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.651+0000 7f2fcd600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fc80cfa00 0x7f2fc80cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:02.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.651+0000 7f2fcd600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2fc80d03f0 0x7f2fc806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:02.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.651+0000 7f2fcd600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc806e520 con 0x7f2fc815d5a0 2024-05-09T05:06:02.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.651+0000 7f2fcd600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc815d980 con 0x7f2fc80d03f0 2024-05-09T05:06:02.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.651+0000 7f2fcd600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc80cf440 con 0x7f2fc80cfa00 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.651+0000 7f2fc7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2fc80d03f0 0x7f2fc806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fc7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2fc80d03f0 0x7f2fc806ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52686/0 (socket says 172.21.15.100:52686) 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fc7400640 1 -- 172.21.15.100:0/4142354666 learned_addr learned my addr 172.21.15.100:0/4142354666 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fbfe00640 1 --2- 172.21.15.100:0/4142354666 >> v2:172.21.15.133:3300/0 conn(0x7f2fc80cfa00 0x7f2fc80cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fc7400640 1 -- 172.21.15.100:0/4142354666 >> v2:172.21.15.133:3300/0 conn(0x7f2fc80cfa00 msgr2=0x7f2fc80cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fc7400640 1 --2- 172.21.15.100:0/4142354666 >> v2:172.21.15.133:3300/0 conn(0x7f2fc80cfa00 0x7f2fc80cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fc7400640 1 -- 172.21.15.100:0/4142354666 >> v1:172.21.15.133:6789/0 conn(0x7f2fc815d5a0 legacy=0x7f2fc8073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:02.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.652+0000 7f2fc7400640 1 -- 172.21.15.100:0/4142354666 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc80cf720 con 0x7f2fc80d03f0 2024-05-09T05:06:02.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.654+0000 7f2fc7400640 1 --2- 172.21.15.100:0/4142354666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80d03f0 0x7f2fc806ecb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2fc806d2c0 tx=0x7f2fc002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4be5afc27c985a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:02.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.654+0000 7f2fc6000640 1 -- 172.21.15.100:0/4142354666 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0036070 con 0x7f2fc80d03f0 2024-05-09T05:06:02.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.654+0000 7f2fc6000640 1 -- 172.21.15.100:0/4142354666 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc0031600 con 0x7f2fc80d03f0 2024-05-09T05:06:02.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.654+0000 7f2fc6000640 1 -- 172.21.15.100:0/4142354666 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00319d0 con 0x7f2fc80d03f0 2024-05-09T05:06:02.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 -- 172.21.15.100:0/4142354666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80d03f0 msgr2=0x7f2fc806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:02.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 --2- 172.21.15.100:0/4142354666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80d03f0 0x7f2fc806ecb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2fc806d2c0 tx=0x7f2fc002a6a0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 -- 172.21.15.100:0/4142354666 shutdown_connections 2024-05-09T05:06:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 --2- 172.21.15.100:0/4142354666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80d03f0 0x7f2fc806ecb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 --2- 172.21.15.100:0/4142354666 >> v2:172.21.15.133:3300/0 conn(0x7f2fc80cfa00 0x7f2fc80cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 -- 172.21.15.100:0/4142354666 >> 172.21.15.100:0/4142354666 conn(0x7f2fc80b2c90 msgr2=0x7f2fc80b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 -- 172.21.15.100:0/4142354666 shutdown_connections 2024-05-09T05:06:02.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.655+0000 7f2fcd600640 1 -- 172.21.15.100:0/4142354666 wait complete. 2024-05-09T05:06:02.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.657+0000 7f2fcd600640 1 Processor -- start 2024-05-09T05:06:02.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.657+0000 7f2fcd600640 1 -- start start 2024-05-09T05:06:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fcd600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 0x7f2fc814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fcd600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc80d03f0 0x7f2fc815f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fcd600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc815d5a0 0x7f2fc80aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fcd600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc809ede0 con 0x7f2fc80cfa00 2024-05-09T05:06:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fcd600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc8074660 con 0x7f2fc815d5a0 2024-05-09T05:06:02.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fcd600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc809ef60 con 0x7f2fc80d03f0 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fc6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 0x7f2fc814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fc6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 0x7f2fc814fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52696/0 (socket says 172.21.15.100:52696) 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fc6a00640 1 -- 172.21.15.100:0/1535342193 learned_addr learned my addr 172.21.15.100:0/1535342193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.658+0000 7f2fbfe00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc80d03f0 0x7f2fc815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc6a00640 1 -- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc80d03f0 msgr2=0x7f2fc815f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc7400640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc815d5a0 0x7f2fc80aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc6a00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc80d03f0 0x7f2fc815f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc6a00640 1 -- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc815d5a0 msgr2=0x7f2fc80aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc6a00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc815d5a0 0x7f2fc80aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc6a00640 1 -- 172.21.15.100:0/1535342193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc815f650 con 0x7f2fc80cfa00 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fbfe00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc80d03f0 0x7f2fc815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:02.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fc6a00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 0x7f2fc814fac0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c3a0 tx=0x7f2fb800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8017070 con 0x7f2fc80cfa00 2024-05-09T05:06:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb80052d0 con 0x7f2fc80cfa00 2024-05-09T05:06:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8003830 con 0x7f2fc80cfa00 2024-05-09T05:06:02.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc80afa00 con 0x7f2fc80cfa00 2024-05-09T05:06:02.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.659+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc809bd90 con 0x7f2fc80cfa00 2024-05-09T05:06:02.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.661+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc806a630 con 0x7f2fc80cfa00 2024-05-09T05:06:02.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.662+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fb801a070 con 0x7f2fc80cfa00 2024-05-09T05:06:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.663+0000 7f2fbea00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2fa40762d0 0x7f2fa4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.663+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f2fb8096a00 con 0x7f2fc80cfa00 2024-05-09T05:06:02.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.663+0000 7f2fbfe00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2fa40762d0 0x7f2fa4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:02.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.664+0000 7f2fbfe00640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2fa40762d0 0x7f2fa4078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8157080 tx=0x7f2fb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:02.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.667+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2fb80602c0 con 0x7f2fc80cfa00 2024-05-09T05:06:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:02.908+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2fc80b5ae0 con 0x7f2fc80cfa00 2024-05-09T05:06:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.433+0000 7f2fbea00640 1 -- 172.21.15.100:0/1535342193 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f2fb80682b0 con 0x7f2fc80cfa00 2024-05-09T05:06:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2fa40762d0 msgr2=0x7f2fa4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2fa40762d0 0x7f2fa4078790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8157080 tx=0x7f2fb0008040 comp rx=0 tx=0).stop 2024-05-09T05:06:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 msgr2=0x7f2fc814fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 0x7f2fc814fac0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c3a0 tx=0x7f2fb800c860 comp rx=0 tx=0).stop 2024-05-09T05:06:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 shutdown_connections 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2fa40762d0 0x7f2fa4078790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fc815d5a0 0x7f2fc80aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2fc80d03f0 0x7f2fc815f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 --2- 172.21.15.100:0/1535342193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fc80cfa00 0x7f2fc814fac0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.437+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 >> 172.21.15.100:0/1535342193 conn(0x7f2fc80b2c90 msgr2=0x7f2fc806ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.438+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 shutdown_connections 2024-05-09T05:06:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.438+0000 7f2fcd600640 1 -- 172.21.15.100:0/1535342193 wait complete. 2024-05-09T05:06:03.462 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-09T05:06:03.463 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.663+0000 7f5632200640 1 Processor -- start 2024-05-09T05:06:03.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.663+0000 7f5632200640 1 -- start start 2024-05-09T05:06:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.664+0000 7f5632200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f562c06f9f0 0x7f562c073dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.664+0000 7f5632200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c15d730 con 0x7f562c1456c0 2024-05-09T05:06:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.664+0000 7f5632200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c0cef30 con 0x7f562c06f570 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.664+0000 7f5632200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f562c0cfb40 con 0x7f562c06f9f0 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.664+0000 7f5631800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f562c06f9f0 0x7f562c073dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.665+0000 7f5631800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f562c06f9f0 0x7f562c073dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52708/0 (socket says 172.21.15.100:52708) 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.665+0000 7f5631800640 1 -- 172.21.15.100:0/768448818 learned_addr learned my addr 172.21.15.100:0/768448818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.665+0000 7f5631800640 1 -- 172.21.15.100:0/768448818 >> v1:172.21.15.133:6789/0 conn(0x7f562c06f570 legacy=0x7f562c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.665+0000 7f5631800640 1 -- 172.21.15.100:0/768448818 >> v1:172.21.15.100:6789/0 conn(0x7f562c1456c0 legacy=0x7f562c15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.665+0000 7f5631800640 1 -- 172.21.15.100:0/768448818 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c0cf210 con 0x7f562c06f9f0 2024-05-09T05:06:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.666+0000 7f5631800640 1 --2- 172.21.15.100:0/768448818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c06f9f0 0x7f562c073dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f562400d150 tx=0x7f562402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42cf1ff14d73d4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.666+0000 7f562be00640 1 -- 172.21.15.100:0/768448818 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624009600 con 0x7f562c06f9f0 2024-05-09T05:06:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.666+0000 7f562be00640 1 -- 172.21.15.100:0/768448818 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5624037070 con 0x7f562c06f9f0 2024-05-09T05:06:03.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.666+0000 7f562be00640 1 -- 172.21.15.100:0/768448818 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56240099c0 con 0x7f562c06f9f0 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 -- 172.21.15.100:0/768448818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c06f9f0 msgr2=0x7f562c073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 --2- 172.21.15.100:0/768448818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c06f9f0 0x7f562c073dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f562400d150 tx=0x7f562402c920 comp rx=0 tx=0).stop 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 -- 172.21.15.100:0/768448818 shutdown_connections 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 --2- 172.21.15.100:0/768448818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c06f9f0 0x7f562c073dd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 -- 172.21.15.100:0/768448818 >> 172.21.15.100:0/768448818 conn(0x7f562c06c7f0 msgr2=0x7f562c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 -- 172.21.15.100:0/768448818 shutdown_connections 2024-05-09T05:06:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.667+0000 7f5632200640 1 -- 172.21.15.100:0/768448818 wait complete. 2024-05-09T05:06:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.669+0000 7f5632200640 1 Processor -- start 2024-05-09T05:06:03.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.669+0000 7f5632200640 1 -- start start 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5632200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f562c06f570 0x7f562c141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5632200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f562c06f9f0 0x7f562c157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5632200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 0x7f562c13f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5632200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f562c06fe60 con 0x7f562c1456c0 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5632200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0cf7d0 con 0x7f562c06f9f0 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5632200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f562c0cec00 con 0x7f562c06f570 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5631800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 0x7f562c13f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5631800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 0x7f562c13f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52710/0 (socket says 172.21.15.100:52710) 2024-05-09T05:06:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.670+0000 7f5631800640 1 -- 172.21.15.100:0/3062408745 learned_addr learned my addr 172.21.15.100:0/3062408745 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:03.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5630e00640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f562c06f570 0x7f562c141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5623e00640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f562c06f9f0 0x7f562c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5631800640 1 -- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f562c06f570 msgr2=0x7f562c141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5631800640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f562c06f570 0x7f562c141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5631800640 1 -- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f562c06f9f0 msgr2=0x7f562c157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5631800640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f562c06f9f0 0x7f562c157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5631800640 1 -- 172.21.15.100:0/3062408745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c157e80 con 0x7f562c1456c0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5631800640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 0x7f562c13f7f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5624034040 tx=0x7f5624004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562400b720 con 0x7f562c1456c0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5624032820 con 0x7f562c1456c0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624032c50 con 0x7f562c1456c0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.671+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c158160 con 0x7f562c1456c0 2024-05-09T05:06:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.672+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c158720 con 0x7f562c1456c0 2024-05-09T05:06:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.673+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c145220 con 0x7f562c1456c0 2024-05-09T05:06:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.674+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5624043020 con 0x7f562c1456c0 2024-05-09T05:06:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.675+0000 7f5629600640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56080762d0 0x7f5608078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.675+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f56240b8840 con 0x7f562c1456c0 2024-05-09T05:06:03.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.675+0000 7f5630e00640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56080762d0 0x7f5608078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:03.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.676+0000 7f5630e00640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56080762d0 0x7f5608078790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f561c0015e0 tx=0x7f561c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:03.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.679+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f562c145220 con 0x7f562c1456c0 2024-05-09T05:06:03.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.908+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f562c06a550 con 0x7f562c1456c0 2024-05-09T05:06:03.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.909+0000 7f5629600640 1 -- 172.21.15.100:0/3062408745 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5193 (secure 0 0 0) 0x7f562402f070 con 0x7f562c1456c0 2024-05-09T05:06:03.911 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:03.911 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:02.911152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-05-09T05:06:03.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56080762d0 msgr2=0x7f5608078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56080762d0 0x7f5608078790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f561c0015e0 tx=0x7f561c009040 comp rx=0 tx=0).stop 2024-05-09T05:06:03.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 msgr2=0x7f562c13f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 0x7f562c13f7f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5624034040 tx=0x7f5624004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 shutdown_connections 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f56080762d0 0x7f5608078790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562c1456c0 0x7f562c13f7f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f562c06f9f0 0x7f562c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 --2- 172.21.15.100:0/3062408745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f562c06f570 0x7f562c141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 >> 172.21.15.100:0/3062408745 conn(0x7f562c06c7f0 msgr2=0x7f562c0b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 shutdown_connections 2024-05-09T05:06:03.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:03.912+0000 7f5632200640 1 -- 172.21.15.100:0/3062408745 wait complete. 2024-05-09T05:06:03.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:04.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.121+0000 7f06c8a00640 1 Processor -- start 2024-05-09T05:06:04.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.121+0000 7f06c8a00640 1 -- start start 2024-05-09T05:06:04.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c8a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c40b3e70 0x7f06c40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c8a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06c415e5b0 0x7f06c40b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c8a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06c40b1230 0x7f06c406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c8a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f06c415e120 con 0x7f06c40b1230 2024-05-09T05:06:04.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c8a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f06c40b4790 con 0x7f06c415e5b0 2024-05-09T05:06:04.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c8a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f06c415d810 con 0x7f06c40b3e70 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06c40b1230 0x7f06c406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06c40b1230 0x7f06c406c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52718/0 (socket says 172.21.15.100:52718) 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 -- 172.21.15.100:0/3609302429 learned_addr learned my addr 172.21.15.100:0/3609302429 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c1400640 1 --2- 172.21.15.100:0/3609302429 >> v2:172.21.15.133:3300/0 conn(0x7f06c415e5b0 0x7f06c40b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c1e00640 1 --2- 172.21.15.100:0/3609302429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c40b3e70 0x7f06c40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 -- 172.21.15.100:0/3609302429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c40b3e70 msgr2=0x7f06c40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 --2- 172.21.15.100:0/3609302429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c40b3e70 0x7f06c40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 -- 172.21.15.100:0/3609302429 >> v2:172.21.15.133:3300/0 conn(0x7f06c415e5b0 msgr2=0x7f06c40b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 --2- 172.21.15.100:0/3609302429 >> v2:172.21.15.133:3300/0 conn(0x7f06c415e5b0 0x7f06c40b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.123+0000 7f06c2800640 1 -- 172.21.15.100:0/3609302429 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c40b17d0 con 0x7f06c40b1230 2024-05-09T05:06:04.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.124+0000 7f06c2800640 1 --2- 172.21.15.100:0/3609302429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b1230 0x7f06c406c3d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f06c406d490 tx=0x7f06bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a2240a8353372f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:04.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.125+0000 7f06c0a00640 1 -- 172.21.15.100:0/3609302429 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc037070 con 0x7f06c40b1230 2024-05-09T05:06:04.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.125+0000 7f06c0a00640 1 -- 172.21.15.100:0/3609302429 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc032440 con 0x7f06c40b1230 2024-05-09T05:06:04.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.125+0000 7f06c0a00640 1 -- 172.21.15.100:0/3609302429 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc032810 con 0x7f06c40b1230 2024-05-09T05:06:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.125+0000 7f06c8a00640 1 -- 172.21.15.100:0/3609302429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b1230 msgr2=0x7f06c406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.125+0000 7f06c8a00640 1 --2- 172.21.15.100:0/3609302429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b1230 0x7f06c406c3d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f06c406d490 tx=0x7f06bc02a140 comp rx=0 tx=0).stop 2024-05-09T05:06:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.125+0000 7f06c8a00640 1 -- 172.21.15.100:0/3609302429 shutdown_connections 2024-05-09T05:06:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.126+0000 7f06c8a00640 1 --2- 172.21.15.100:0/3609302429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b1230 0x7f06c406c3d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.126+0000 7f06c8a00640 1 --2- 172.21.15.100:0/3609302429 >> v2:172.21.15.133:3300/0 conn(0x7f06c415e5b0 0x7f06c40b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.126+0000 7f06c8a00640 1 --2- 172.21.15.100:0/3609302429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c40b3e70 0x7f06c40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.126+0000 7f06c8a00640 1 -- 172.21.15.100:0/3609302429 >> 172.21.15.100:0/3609302429 conn(0x7f06c406d6c0 msgr2=0x7f06c406dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.126+0000 7f06c8a00640 1 -- 172.21.15.100:0/3609302429 shutdown_connections 2024-05-09T05:06:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.126+0000 7f06c8a00640 1 -- 172.21.15.100:0/3609302429 wait complete. 2024-05-09T05:06:04.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.127+0000 7f06c8a00640 1 Processor -- start 2024-05-09T05:06:04.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.127+0000 7f06c8a00640 1 -- start start 2024-05-09T05:06:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.128+0000 7f06c8a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c40b1230 0x7f06c40cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.128+0000 7f06c8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 0x7f06c4145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.128+0000 7f06c8a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c415e5b0 0x7f06c4143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.128+0000 7f06c8a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06c4146d90 con 0x7f06c40b3e70 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.128+0000 7f06c8a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f06c415ddb0 con 0x7f06c40b1230 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.128+0000 7f06c8a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f06c4146f10 con 0x7f06c415e5b0 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 0x7f06c4145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 0x7f06c4145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52734/0 (socket says 172.21.15.100:52734) 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 -- 172.21.15.100:0/1544080389 learned_addr learned my addr 172.21.15.100:0/1544080389 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c2800640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c415e5b0 0x7f06c4143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 -- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c415e5b0 msgr2=0x7f06c4143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c415e5b0 0x7f06c4143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 -- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c40b1230 msgr2=0x7f06c40cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c40b1230 0x7f06c40cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 -- 172.21.15.100:0/1544080389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c4144e30 con 0x7f06c40b3e70 2024-05-09T05:06:04.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.129+0000 7f06c1400640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 0x7f06c4145ed0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f06b0007f20 tx=0x7f06b000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:04.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.130+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0014620 con 0x7f06c40b3e70 2024-05-09T05:06:04.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.130+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06b0019070 con 0x7f06c40b3e70 2024-05-09T05:06:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.130+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c4145110 con 0x7f06c40b3e70 2024-05-09T05:06:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.130+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0014a00 con 0x7f06c40b3e70 2024-05-09T05:06:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.130+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c41456d0 con 0x7f06c40b3e70 2024-05-09T05:06:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.131+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c406a5c0 con 0x7f06c40b3e70 2024-05-09T05:06:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.132+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06b0014ba0 con 0x7f06c40b3e70 2024-05-09T05:06:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.133+0000 7f06ba000640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06a4076300 0x7f06a40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.134+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f06b0097fa0 con 0x7f06c40b3e70 2024-05-09T05:06:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.134+0000 7f06c1e00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06a4076300 0x7f06a40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.134+0000 7f06c1e00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06a4076300 0x7f06a40787c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f06b400b7f0 tx=0x7f06b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:04.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.138+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06b0061860 con 0x7f06c40b3e70 2024-05-09T05:06:04.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.347+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06c4073f40 con 0x7f06c40b3e70 2024-05-09T05:06:04.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.348+0000 7f06ba000640 1 -- 172.21.15.100:0/1544080389 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16693 (secure 0 0 0) 0x7f06b0061160 con 0x7f06c40b3e70 2024-05-09T05:06:04.351 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:04.351 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":47,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:06:01.396772+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:04.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06a4076300 msgr2=0x7f06a40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06a4076300 0x7f06a40787c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f06b400b7f0 tx=0x7f06b4008040 comp rx=0 tx=0).stop 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 msgr2=0x7f06c4145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 0x7f06c4145ed0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f06b0007f20 tx=0x7f06b000e570 comp rx=0 tx=0).stop 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 shutdown_connections 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f06a4076300 0x7f06a40787c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c415e5b0 0x7f06c4143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06c40b3e70 0x7f06c4145ed0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 --2- 172.21.15.100:0/1544080389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c40b1230 0x7f06c40cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 >> 172.21.15.100:0/1544080389 conn(0x7f06c406d6c0 msgr2=0x7f06c4070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 shutdown_connections 2024-05-09T05:06:04.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.352+0000 7f06c8a00640 1 -- 172.21.15.100:0/1544080389 wait complete. 2024-05-09T05:06:04.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:06:04.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:04.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.574+0000 7fb443600640 1 Processor -- start 2024-05-09T05:06:04.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.574+0000 7fb443600640 1 -- start start 2024-05-09T05:06:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb443600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb43c073840 0x7fb43c073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb443600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c06f390 con 0x7fb43c06fd60 2024-05-09T05:06:04.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb443600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c06e810 con 0x7fb43c0aee10 2024-05-09T05:06:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb443600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c06eaf0 con 0x7fb43c073840 2024-05-09T05:06:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb440c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb43c06fd60 0x7fb43c070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43792/0 (socket says 172.21.15.100:43792) 2024-05-09T05:06:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb440c00640 1 -- 172.21.15.100:0/118775013 learned_addr learned my addr 172.21.15.100:0/118775013 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43be00640 1 --2- 172.21.15.100:0/118775013 >> v2:172.21.15.133:3300/0 conn(0x7fb43c073840 0x7fb43c073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553289971 0 0) 0x7fb43c06f390 con 0x7fb43c06fd60 2024-05-09T05:06:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb424003520 con 0x7fb43c06fd60 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1362071270 0 0) 0x7fb424003520 con 0x7fb43c06fd60 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 >> v2:172.21.15.133:3300/0 conn(0x7fb43c073840 msgr2=0x7fb43c073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 --2- 172.21.15.100:0/118775013 >> v2:172.21.15.133:3300/0 conn(0x7fb43c073840 0x7fb43c073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 >> v1:172.21.15.133:6789/0 conn(0x7fb43c0aee10 legacy=0x7fb43c0af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c06edd0 con 0x7fb43c06fd60 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fb4300016f0 con 0x7fb43c06fd60 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 >> v1:172.21.15.100:6789/0 conn(0x7fb43c06fd60 legacy=0x7fb43c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb424003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb424004800 0x7fb424004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4240051c0 0x7fb42400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c06eaf0 con 0x7fb424003a50 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb42400c160 con 0x7fb424004800 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.576+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb42400c360 con 0x7fb4240051c0 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb440c00640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb424003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb43be00640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb424004800 0x7fb424004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb441600640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4240051c0 0x7fb42400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb440c00640 1 -- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4240051c0 msgr2=0x7fb42400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb440c00640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4240051c0 0x7fb42400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb440c00640 1 -- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb424004800 msgr2=0x7fb424004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb440c00640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb424004800 0x7fb424004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb440c00640 1 -- 172.21.15.100:0/118775013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb424003520 con 0x7fb424003a50 2024-05-09T05:06:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb441600640 1 -- 172.21.15.100:0/118775013 reap_dead start 2024-05-09T05:06:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.577+0000 7fb43be00640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb424004800 0x7fb424004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.578+0000 7fb440c00640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb424003e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb43000c210 tx=0x7fb424005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d38637c0d4e549 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:04.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430007d10 con 0x7fb424003a50 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb430005ad0 con 0x7fb424003a50 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb43b400640 1 -- 172.21.15.100:0/118775013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430007070 con 0x7fb424003a50 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 -- 172.21.15.100:0/118775013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 msgr2=0x7fb424003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb424003e70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb43000c210 tx=0x7fb424005830 comp rx=0 tx=0).stop 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 -- 172.21.15.100:0/118775013 shutdown_connections 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 --2- 172.21.15.100:0/118775013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb424003e70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 -- 172.21.15.100:0/118775013 >> 172.21.15.100:0/118775013 conn(0x7fb43c0b31e0 msgr2=0x7fb43c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 -- 172.21.15.100:0/118775013 shutdown_connections 2024-05-09T05:06:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.579+0000 7fb443600640 1 -- 172.21.15.100:0/118775013 wait complete. 2024-05-09T05:06:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.581+0000 7fb443600640 1 Processor -- start 2024-05-09T05:06:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.581+0000 7fb443600640 1 -- start start 2024-05-09T05:06:04.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb443600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb43c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb443600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb43c1e7070 0x7fb43c1e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb443600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb43c09c920 0x7fb43c09cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb443600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c159f00 con 0x7fb424003a50 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb443600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c06e4a0 con 0x7fb43c09c920 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb443600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c09d7f0 con 0x7fb43c1e7070 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.582+0000 7fb440c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb43c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb43c151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52752/0 (socket says 172.21.15.100:52752) 2024-05-09T05:06:04.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 -- 172.21.15.100:0/881608697 learned_addr learned my addr 172.21.15.100:0/881608697 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb43be00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb43c1e7070 0x7fb43c1e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 -- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb43c1e7070 msgr2=0x7fb43c1e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb43c1e7070 0x7fb43c1e74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 -- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb43c09c920 msgr2=0x7fb43c09cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb43c09c920 0x7fb43c09cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 -- 172.21.15.100:0/881608697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c09dad0 con 0x7fb424003a50 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb440c00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb43c151c70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb43002ad50 tx=0x7fb430000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:04.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.583+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430037040 con 0x7fb424003a50 2024-05-09T05:06:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.584+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4300014f0 con 0x7fb424003a50 2024-05-09T05:06:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.584+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4300047e0 con 0x7fb424003a50 2024-05-09T05:06:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.584+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c09ddb0 con 0x7fb424003a50 2024-05-09T05:06:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.584+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c153b10 con 0x7fb424003a50 2024-05-09T05:06:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.585+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c076070 con 0x7fb424003a50 2024-05-09T05:06:04.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.586+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb430043020 con 0x7fb424003a50 2024-05-09T05:06:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.588+0000 7fb438c00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb41c0762d0 0x7fb41c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:04.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.588+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fb4300b6d30 con 0x7fb424003a50 2024-05-09T05:06:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.588+0000 7fb43be00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb41c0762d0 0x7fb41c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.589+0000 7fb43be00640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb41c0762d0 0x7fb41c078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb43c1e7cb0 tx=0x7fb428008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:04.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.592+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4300805f0 con 0x7fb424003a50 2024-05-09T05:06:04.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.779+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb43c06a5c0 con 0x7fb41c0762d0 2024-05-09T05:06:04.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.796+0000 7fb438c00640 1 -- 172.21.15.100:0/881608697 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7fb43c06a5c0 con 0x7fb41c0762d0 2024-05-09T05:06:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:04.802 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:04.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb41c0762d0 msgr2=0x7fb41c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb41c0762d0 0x7fb41c078790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb43c1e7cb0 tx=0x7fb428008040 comp rx=0 tx=0).stop 2024-05-09T05:06:04.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 msgr2=0x7fb43c151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb43c151c70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb43002ad50 tx=0x7fb430000fe0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 shutdown_connections 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb41c0762d0 0x7fb41c078790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb43c09c920 0x7fb43c09cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb43c1e7070 0x7fb43c1e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 --2- 172.21.15.100:0/881608697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb424003a50 0x7fb43c151c70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 >> 172.21.15.100:0/881608697 conn(0x7fb43c0b31e0 msgr2=0x7fb43c15b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 shutdown_connections 2024-05-09T05:06:04.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:04.802+0000 7fb443600640 1 -- 172.21.15.100:0/881608697 wait complete. 2024-05-09T05:06:04.821 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-05-09T05:06:03.910715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230016,"kb_used_data":5504,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744704,"statfs":{"total":773094113280,"available":772858576896,"internally_reserved":0,"allocated":5636096,"data_stored":2986476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.565716"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919804+0000","last_change":"2024-05-09T05:06:00.415449+0000","last_active":"2024-05-09T05:06:01.919804+0000","last_peered":"2024-05-09T05:06:01.919804+0000","last_clean":"2024-05-09T05:06:01.919804+0000","last_became_active":"2024-05-09T05:06:00.415177+0000","last_became_peered":"2024-05-09T05:06:00.415177+0000","last_unstale":"2024-05-09T05:06:01.919804+0000","last_undegraded":"2024-05-09T05:06:01.919804+0000","last_fullsized":"2024-05-09T05:06:01.919804+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:50:46.166003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415710+0000","last_change":"2024-05-09T05:06:00.413769+0000","last_active":"2024-05-09T05:06:01.415710+0000","last_peered":"2024-05-09T05:06:01.415710+0000","last_clean":"2024-05-09T05:06:01.415710+0000","last_became_active":"2024-05-09T05:06:00.413242+0000","last_became_peered":"2024-05-09T05:06:00.413242+0000","last_unstale":"2024-05-09T05:06:01.415710+0000","last_undegraded":"2024-05-09T05:06:01.415710+0000","last_fullsized":"2024-05-09T05:06:01.415710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:53.382480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415313+0000","last_change":"2024-05-09T05:06:00.431514+0000","last_active":"2024-05-09T05:06:01.415313+0000","last_peered":"2024-05-09T05:06:01.415313+0000","last_clean":"2024-05-09T05:06:01.415313+0000","last_became_active":"2024-05-09T05:06:00.431302+0000","last_became_peered":"2024-05-09T05:06:00.431302+0000","last_unstale":"2024-05-09T05:06:01.415313+0000","last_undegraded":"2024-05-09T05:06:01.415313+0000","last_fullsized":"2024-05-09T05:06:01.415313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:16.636429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415772+0000","last_change":"2024-05-09T05:06:00.415911+0000","last_active":"2024-05-09T05:06:01.415772+0000","last_peered":"2024-05-09T05:06:01.415772+0000","last_clean":"2024-05-09T05:06:01.415772+0000","last_became_active":"2024-05-09T05:06:00.415638+0000","last_became_peered":"2024-05-09T05:06:00.415638+0000","last_unstale":"2024-05-09T05:06:01.415772+0000","last_undegraded":"2024-05-09T05:06:01.415772+0000","last_fullsized":"2024-05-09T05:06:01.415772+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:46.788287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923234+0000","last_change":"2024-05-09T05:06:00.409434+0000","last_active":"2024-05-09T05:06:01.923234+0000","last_peered":"2024-05-09T05:06:01.923234+0000","last_clean":"2024-05-09T05:06:01.923234+0000","last_became_active":"2024-05-09T05:06:00.408893+0000","last_became_peered":"2024-05-09T05:06:00.408893+0000","last_unstale":"2024-05-09T05:06:01.923234+0000","last_undegraded":"2024-05-09T05:06:01.923234+0000","last_fullsized":"2024-05-09T05:06:01.923234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:10.483297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919301+0000","last_change":"2024-05-09T05:06:00.409899+0000","last_active":"2024-05-09T05:06:01.919301+0000","last_peered":"2024-05-09T05:06:01.919301+0000","last_clean":"2024-05-09T05:06:01.919301+0000","last_became_active":"2024-05-09T05:06:00.409374+0000","last_became_peered":"2024-05-09T05:06:00.409374+0000","last_unstale":"2024-05-09T05:06:01.919301+0000","last_undegraded":"2024-05-09T05:06:01.919301+0000","last_fullsized":"2024-05-09T05:06:01.919301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:35.667696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413731+0000","last_change":"2024-05-09T05:06:00.428982+0000","last_active":"2024-05-09T05:06:01.413731+0000","last_peered":"2024-05-09T05:06:01.413731+0000","last_clean":"2024-05-09T05:06:01.413731+0000","last_became_active":"2024-05-09T05:06:00.428692+0000","last_became_peered":"2024-05-09T05:06:00.428692+0000","last_unstale":"2024-05-09T05:06:01.413731+0000","last_undegraded":"2024-05-09T05:06:01.413731+0000","last_fullsized":"2024-05-09T05:06:01.413731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:46.561576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418493+0000","last_change":"2024-05-09T05:06:00.412436+0000","last_active":"2024-05-09T05:06:01.418493+0000","last_peered":"2024-05-09T05:06:01.418493+0000","last_clean":"2024-05-09T05:06:01.418493+0000","last_became_active":"2024-05-09T05:06:00.412125+0000","last_became_peered":"2024-05-09T05:06:00.412125+0000","last_unstale":"2024-05-09T05:06:01.418493+0000","last_undegraded":"2024-05-09T05:06:01.418493+0000","last_fullsized":"2024-05-09T05:06:01.418493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:05.262460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.420099+0000","last_change":"2024-05-09T05:06:00.427335+0000","last_active":"2024-05-09T05:06:01.420099+0000","last_peered":"2024-05-09T05:06:01.420099+0000","last_clean":"2024-05-09T05:06:01.420099+0000","last_became_active":"2024-05-09T05:06:00.427005+0000","last_became_peered":"2024-05-09T05:06:00.427005+0000","last_unstale":"2024-05-09T05:06:01.420099+0000","last_undegraded":"2024-05-09T05:06:01.420099+0000","last_fullsized":"2024-05-09T05:06:01.420099+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:34.906497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919801+0000","last_change":"2024-05-09T05:06:00.410044+0000","last_active":"2024-05-09T05:06:01.919801+0000","last_peered":"2024-05-09T05:06:01.919801+0000","last_clean":"2024-05-09T05:06:01.919801+0000","last_became_active":"2024-05-09T05:06:00.409720+0000","last_became_peered":"2024-05-09T05:06:00.409720+0000","last_unstale":"2024-05-09T05:06:01.919801+0000","last_undegraded":"2024-05-09T05:06:01.919801+0000","last_fullsized":"2024-05-09T05:06:01.919801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:14.442061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921929+0000","last_change":"2024-05-09T05:06:00.413286+0000","last_active":"2024-05-09T05:06:01.921929+0000","last_peered":"2024-05-09T05:06:01.921929+0000","last_clean":"2024-05-09T05:06:01.921929+0000","last_became_active":"2024-05-09T05:06:00.413011+0000","last_became_peered":"2024-05-09T05:06:00.413011+0000","last_unstale":"2024-05-09T05:06:01.921929+0000","last_undegraded":"2024-05-09T05:06:01.921929+0000","last_fullsized":"2024-05-09T05:06:01.921929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:23.162468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419428+0000","last_change":"2024-05-09T05:06:00.418389+0000","last_active":"2024-05-09T05:06:01.419428+0000","last_peered":"2024-05-09T05:06:01.419428+0000","last_clean":"2024-05-09T05:06:01.419428+0000","last_became_active":"2024-05-09T05:06:00.417705+0000","last_became_peered":"2024-05-09T05:06:00.417705+0000","last_unstale":"2024-05-09T05:06:01.419428+0000","last_undegraded":"2024-05-09T05:06:01.419428+0000","last_fullsized":"2024-05-09T05:06:01.419428+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:10:43.470960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919454+0000","last_change":"2024-05-09T05:06:00.412212+0000","last_active":"2024-05-09T05:06:01.919454+0000","last_peered":"2024-05-09T05:06:01.919454+0000","last_clean":"2024-05-09T05:06:01.919454+0000","last_became_active":"2024-05-09T05:06:00.410197+0000","last_became_peered":"2024-05-09T05:06:00.410197+0000","last_unstale":"2024-05-09T05:06:01.919454+0000","last_undegraded":"2024-05-09T05:06:01.919454+0000","last_fullsized":"2024-05-09T05:06:01.919454+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:42.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413738+0000","last_change":"2024-05-09T05:06:00.432320+0000","last_active":"2024-05-09T05:06:01.413738+0000","last_peered":"2024-05-09T05:06:01.413738+0000","last_clean":"2024-05-09T05:06:01.413738+0000","last_became_active":"2024-05-09T05:06:00.432010+0000","last_became_peered":"2024-05-09T05:06:00.432010+0000","last_unstale":"2024-05-09T05:06:01.413738+0000","last_undegraded":"2024-05-09T05:06:01.413738+0000","last_fullsized":"2024-05-09T05:06:01.413738+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:33.121649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416046+0000","last_change":"2024-05-09T05:06:00.418749+0000","last_active":"2024-05-09T05:06:01.416046+0000","last_peered":"2024-05-09T05:06:01.416046+0000","last_clean":"2024-05-09T05:06:01.416046+0000","last_became_active":"2024-05-09T05:06:00.418453+0000","last_became_peered":"2024-05-09T05:06:00.418453+0000","last_unstale":"2024-05-09T05:06:01.416046+0000","last_undegraded":"2024-05-09T05:06:01.416046+0000","last_fullsized":"2024-05-09T05:06:01.416046+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:27.888610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919278+0000","last_change":"2024-05-09T05:06:00.412818+0000","last_active":"2024-05-09T05:06:01.919278+0000","last_peered":"2024-05-09T05:06:01.919278+0000","last_clean":"2024-05-09T05:06:01.919278+0000","last_became_active":"2024-05-09T05:06:00.410026+0000","last_became_peered":"2024-05-09T05:06:00.410026+0000","last_unstale":"2024-05-09T05:06:01.919278+0000","last_undegraded":"2024-05-09T05:06:01.919278+0000","last_fullsized":"2024-05-09T05:06:01.919278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:44.761881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416204+0000","last_change":"2024-05-09T05:06:00.427184+0000","last_active":"2024-05-09T05:06:01.416204+0000","last_peered":"2024-05-09T05:06:01.416204+0000","last_clean":"2024-05-09T05:06:01.416204+0000","last_became_active":"2024-05-09T05:06:00.426632+0000","last_became_peered":"2024-05-09T05:06:00.426632+0000","last_unstale":"2024-05-09T05:06:01.416204+0000","last_undegraded":"2024-05-09T05:06:01.416204+0000","last_fullsized":"2024-05-09T05:06:01.416204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:46.788287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415990+0000","last_change":"2024-05-09T05:06:00.413507+0000","last_active":"2024-05-09T05:06:01.415990+0000","last_peered":"2024-05-09T05:06:01.415990+0000","last_clean":"2024-05-09T05:06:01.415990+0000","last_became_active":"2024-05-09T05:06:00.412898+0000","last_became_peered":"2024-05-09T05:06:00.412898+0000","last_unstale":"2024-05-09T05:06:01.415990+0000","last_undegraded":"2024-05-09T05:06:01.415990+0000","last_fullsized":"2024-05-09T05:06:01.415990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:05.262460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415730+0000","last_change":"2024-05-09T05:06:00.425901+0000","last_active":"2024-05-09T05:06:01.415730+0000","last_peered":"2024-05-09T05:06:01.415730+0000","last_clean":"2024-05-09T05:06:01.415730+0000","last_became_active":"2024-05-09T05:06:00.424220+0000","last_became_peered":"2024-05-09T05:06:00.424220+0000","last_unstale":"2024-05-09T05:06:01.415730+0000","last_undegraded":"2024-05-09T05:06:01.415730+0000","last_fullsized":"2024-05-09T05:06:01.415730+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:11:20.471362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921599+0000","last_change":"2024-05-09T05:06:00.413238+0000","last_active":"2024-05-09T05:06:01.921599+0000","last_peered":"2024-05-09T05:06:01.921599+0000","last_clean":"2024-05-09T05:06:01.921599+0000","last_became_active":"2024-05-09T05:06:00.412948+0000","last_became_peered":"2024-05-09T05:06:00.412948+0000","last_unstale":"2024-05-09T05:06:01.921599+0000","last_undegraded":"2024-05-09T05:06:01.921599+0000","last_fullsized":"2024-05-09T05:06:01.921599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:13.205847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920440+0000","last_change":"2024-05-09T05:06:00.413855+0000","last_active":"2024-05-09T05:06:01.920440+0000","last_peered":"2024-05-09T05:06:01.920440+0000","last_clean":"2024-05-09T05:06:01.920440+0000","last_became_active":"2024-05-09T05:06:00.413549+0000","last_became_peered":"2024-05-09T05:06:00.413549+0000","last_unstale":"2024-05-09T05:06:01.920440+0000","last_undegraded":"2024-05-09T05:06:01.920440+0000","last_fullsized":"2024-05-09T05:06:01.920440+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:09.300349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418347+0000","last_change":"2024-05-09T05:06:00.425052+0000","last_active":"2024-05-09T05:06:01.418347+0000","last_peered":"2024-05-09T05:06:01.418347+0000","last_clean":"2024-05-09T05:06:01.418347+0000","last_became_active":"2024-05-09T05:06:00.424735+0000","last_became_peered":"2024-05-09T05:06:00.424735+0000","last_unstale":"2024-05-09T05:06:01.418347+0000","last_undegraded":"2024-05-09T05:06:01.418347+0000","last_fullsized":"2024-05-09T05:06:01.418347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:46.788287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921177+0000","last_change":"2024-05-09T05:06:00.415658+0000","last_active":"2024-05-09T05:06:01.921177+0000","last_peered":"2024-05-09T05:06:01.921177+0000","last_clean":"2024-05-09T05:06:01.921177+0000","last_became_active":"2024-05-09T05:06:00.415326+0000","last_became_peered":"2024-05-09T05:06:00.415326+0000","last_unstale":"2024-05-09T05:06:01.921177+0000","last_undegraded":"2024-05-09T05:06:01.921177+0000","last_fullsized":"2024-05-09T05:06:01.921177+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:26.223358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413320+0000","last_change":"2024-05-09T05:06:00.423496+0000","last_active":"2024-05-09T05:06:01.413320+0000","last_peered":"2024-05-09T05:06:01.413320+0000","last_clean":"2024-05-09T05:06:01.413320+0000","last_became_active":"2024-05-09T05:06:00.410913+0000","last_became_peered":"2024-05-09T05:06:00.410913+0000","last_unstale":"2024-05-09T05:06:01.413320+0000","last_undegraded":"2024-05-09T05:06:01.413320+0000","last_fullsized":"2024-05-09T05:06:01.413320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:37.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416587+0000","last_change":"2024-05-09T05:06:00.426299+0000","last_active":"2024-05-09T05:06:01.416587+0000","last_peered":"2024-05-09T05:06:01.416587+0000","last_clean":"2024-05-09T05:06:01.416587+0000","last_became_active":"2024-05-09T05:06:00.425576+0000","last_became_peered":"2024-05-09T05:06:00.425576+0000","last_unstale":"2024-05-09T05:06:01.416587+0000","last_undegraded":"2024-05-09T05:06:01.416587+0000","last_fullsized":"2024-05-09T05:06:01.416587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:14.202982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419050+0000","last_change":"2024-05-09T05:06:00.431201+0000","last_active":"2024-05-09T05:06:01.419050+0000","last_peered":"2024-05-09T05:06:01.419050+0000","last_clean":"2024-05-09T05:06:01.419050+0000","last_became_active":"2024-05-09T05:06:00.430901+0000","last_became_peered":"2024-05-09T05:06:00.430901+0000","last_unstale":"2024-05-09T05:06:01.419050+0000","last_undegraded":"2024-05-09T05:06:01.419050+0000","last_fullsized":"2024-05-09T05:06:01.419050+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:33:10.926725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920535+0000","last_change":"2024-05-09T05:06:00.425124+0000","last_active":"2024-05-09T05:06:01.920535+0000","last_peered":"2024-05-09T05:06:01.920535+0000","last_clean":"2024-05-09T05:06:01.920535+0000","last_became_active":"2024-05-09T05:06:00.424842+0000","last_became_peered":"2024-05-09T05:06:00.424842+0000","last_unstale":"2024-05-09T05:06:01.920535+0000","last_undegraded":"2024-05-09T05:06:01.920535+0000","last_fullsized":"2024-05-09T05:06:01.920535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:47.090787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921596+0000","last_change":"2024-05-09T05:06:00.403135+0000","last_active":"2024-05-09T05:06:01.921596+0000","last_peered":"2024-05-09T05:06:01.921596+0000","last_clean":"2024-05-09T05:06:01.921596+0000","last_became_active":"2024-05-09T05:06:00.402839+0000","last_became_peered":"2024-05-09T05:06:00.402839+0000","last_unstale":"2024-05-09T05:06:01.921596+0000","last_undegraded":"2024-05-09T05:06:01.921596+0000","last_fullsized":"2024-05-09T05:06:01.921596+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:24.532734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414995+0000","last_change":"2024-05-09T05:06:00.428619+0000","last_active":"2024-05-09T05:06:01.414995+0000","last_peered":"2024-05-09T05:06:01.414995+0000","last_clean":"2024-05-09T05:06:01.414995+0000","last_became_active":"2024-05-09T05:06:00.428054+0000","last_became_peered":"2024-05-09T05:06:00.428054+0000","last_unstale":"2024-05-09T05:06:01.414995+0000","last_undegraded":"2024-05-09T05:06:01.414995+0000","last_fullsized":"2024-05-09T05:06:01.414995+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:39.264565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415722+0000","last_change":"2024-05-09T05:06:00.410214+0000","last_active":"2024-05-09T05:06:01.415722+0000","last_peered":"2024-05-09T05:06:01.415722+0000","last_clean":"2024-05-09T05:06:01.415722+0000","last_became_active":"2024-05-09T05:06:00.409903+0000","last_became_peered":"2024-05-09T05:06:00.409903+0000","last_unstale":"2024-05-09T05:06:01.415722+0000","last_undegraded":"2024-05-09T05:06:01.415722+0000","last_fullsized":"2024-05-09T05:06:01.415722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:21.475740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414028+0000","last_change":"2024-05-09T05:06:00.428981+0000","last_active":"2024-05-09T05:06:01.414028+0000","last_peered":"2024-05-09T05:06:01.414028+0000","last_clean":"2024-05-09T05:06:01.414028+0000","last_became_active":"2024-05-09T05:06:00.428284+0000","last_became_peered":"2024-05-09T05:06:00.428284+0000","last_unstale":"2024-05-09T05:06:01.414028+0000","last_undegraded":"2024-05-09T05:06:01.414028+0000","last_fullsized":"2024-05-09T05:06:01.414028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:28.669728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919816+0000","last_change":"2024-05-09T05:06:00.405192+0000","last_active":"2024-05-09T05:06:01.919816+0000","last_peered":"2024-05-09T05:06:01.919816+0000","last_clean":"2024-05-09T05:06:01.919816+0000","last_became_active":"2024-05-09T05:06:00.403549+0000","last_became_peered":"2024-05-09T05:06:00.403549+0000","last_unstale":"2024-05-09T05:06:01.919816+0000","last_undegraded":"2024-05-09T05:06:01.919816+0000","last_fullsized":"2024-05-09T05:06:01.919816+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:23.903795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416230+0000","last_change":"2024-05-09T05:06:00.413492+0000","last_active":"2024-05-09T05:06:01.416230+0000","last_peered":"2024-05-09T05:06:01.416230+0000","last_clean":"2024-05-09T05:06:01.416230+0000","last_became_active":"2024-05-09T05:06:00.413150+0000","last_became_peered":"2024-05-09T05:06:00.413150+0000","last_unstale":"2024-05-09T05:06:01.416230+0000","last_undegraded":"2024-05-09T05:06:01.416230+0000","last_fullsized":"2024-05-09T05:06:01.416230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:17.901153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921051+0000","last_change":"2024-05-09T05:05:59.387887+0000","last_active":"2024-05-09T05:06:01.921051+0000","last_peered":"2024-05-09T05:06:01.921051+0000","last_clean":"2024-05-09T05:06:01.921051+0000","last_became_active":"2024-05-09T05:05:59.387576+0000","last_became_peered":"2024-05-09T05:05:59.387576+0000","last_unstale":"2024-05-09T05:06:01.921051+0000","last_undegraded":"2024-05-09T05:06:01.921051+0000","last_fullsized":"2024-05-09T05:06:01.921051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:37.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921790+0000","last_change":"2024-05-09T05:06:00.410256+0000","last_active":"2024-05-09T05:06:01.921790+0000","last_peered":"2024-05-09T05:06:01.921790+0000","last_clean":"2024-05-09T05:06:01.921790+0000","last_became_active":"2024-05-09T05:06:00.403881+0000","last_became_peered":"2024-05-09T05:06:00.403881+0000","last_unstale":"2024-05-09T05:06:01.921790+0000","last_undegraded":"2024-05-09T05:06:01.921790+0000","last_fullsized":"2024-05-09T05:06:01.921790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:33.121649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920088+0000","last_change":"2024-05-09T05:05:59.394062+0000","last_active":"2024-05-09T05:06:01.920088+0000","last_peered":"2024-05-09T05:06:01.920088+0000","last_clean":"2024-05-09T05:06:01.920088+0000","last_became_active":"2024-05-09T05:05:59.393592+0000","last_became_peered":"2024-05-09T05:05:59.393592+0000","last_unstale":"2024-05-09T05:06:01.920088+0000","last_undegraded":"2024-05-09T05:06:01.920088+0000","last_fullsized":"2024-05-09T05:06:01.920088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:02.163027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922055+0000","last_change":"2024-05-09T05:06:00.410246+0000","last_active":"2024-05-09T05:06:01.922055+0000","last_peered":"2024-05-09T05:06:01.922055+0000","last_clean":"2024-05-09T05:06:01.922055+0000","last_became_active":"2024-05-09T05:06:00.409973+0000","last_became_peered":"2024-05-09T05:06:00.409973+0000","last_unstale":"2024-05-09T05:06:01.922055+0000","last_undegraded":"2024-05-09T05:06:01.922055+0000","last_fullsized":"2024-05-09T05:06:01.922055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:00.347786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920418+0000","last_change":"2024-05-09T05:05:59.392290+0000","last_active":"2024-05-09T05:06:01.920418+0000","last_peered":"2024-05-09T05:06:01.920418+0000","last_clean":"2024-05-09T05:06:01.920418+0000","last_became_active":"2024-05-09T05:05:59.392013+0000","last_became_peered":"2024-05-09T05:05:59.392013+0000","last_unstale":"2024-05-09T05:06:01.920418+0000","last_undegraded":"2024-05-09T05:06:01.920418+0000","last_fullsized":"2024-05-09T05:06:01.920418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:12.190553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418484+0000","last_change":"2024-05-09T05:06:00.408611+0000","last_active":"2024-05-09T05:06:01.418484+0000","last_peered":"2024-05-09T05:06:01.418484+0000","last_clean":"2024-05-09T05:06:01.418484+0000","last_became_active":"2024-05-09T05:06:00.405727+0000","last_became_peered":"2024-05-09T05:06:00.405727+0000","last_unstale":"2024-05-09T05:06:01.418484+0000","last_undegraded":"2024-05-09T05:06:01.418484+0000","last_fullsized":"2024-05-09T05:06:01.418484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:14.202982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920966+0000","last_change":"2024-05-09T05:05:59.373825+0000","last_active":"2024-05-09T05:06:01.920966+0000","last_peered":"2024-05-09T05:06:01.920966+0000","last_clean":"2024-05-09T05:06:01.920966+0000","last_became_active":"2024-05-09T05:05:59.373333+0000","last_became_peered":"2024-05-09T05:05:59.373333+0000","last_unstale":"2024-05-09T05:06:01.920966+0000","last_undegraded":"2024-05-09T05:06:01.920966+0000","last_fullsized":"2024-05-09T05:06:01.920966+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:19.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923315+0000","last_change":"2024-05-09T05:06:00.417488+0000","last_active":"2024-05-09T05:06:01.923315+0000","last_peered":"2024-05-09T05:06:01.923315+0000","last_clean":"2024-05-09T05:06:01.923315+0000","last_became_active":"2024-05-09T05:06:00.417242+0000","last_became_peered":"2024-05-09T05:06:00.417242+0000","last_unstale":"2024-05-09T05:06:01.923315+0000","last_undegraded":"2024-05-09T05:06:01.923315+0000","last_fullsized":"2024-05-09T05:06:01.923315+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:44.761881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414536+0000","last_change":"2024-05-09T05:05:59.384694+0000","last_active":"2024-05-09T05:06:01.414536+0000","last_peered":"2024-05-09T05:06:01.414536+0000","last_clean":"2024-05-09T05:06:01.414536+0000","last_became_active":"2024-05-09T05:05:59.384184+0000","last_became_peered":"2024-05-09T05:05:59.384184+0000","last_unstale":"2024-05-09T05:06:01.414536+0000","last_undegraded":"2024-05-09T05:06:01.414536+0000","last_fullsized":"2024-05-09T05:06:01.414536+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:23.517440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415931+0000","last_change":"2024-05-09T05:06:00.410395+0000","last_active":"2024-05-09T05:06:01.415931+0000","last_peered":"2024-05-09T05:06:01.415931+0000","last_clean":"2024-05-09T05:06:01.415931+0000","last_became_active":"2024-05-09T05:06:00.410049+0000","last_became_peered":"2024-05-09T05:06:00.410049+0000","last_unstale":"2024-05-09T05:06:01.415931+0000","last_undegraded":"2024-05-09T05:06:01.415931+0000","last_fullsized":"2024-05-09T05:06:01.415931+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:14.202982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922817+0000","last_change":"2024-05-09T05:05:59.390949+0000","last_active":"2024-05-09T05:06:01.922817+0000","last_peered":"2024-05-09T05:06:01.922817+0000","last_clean":"2024-05-09T05:06:01.922817+0000","last_became_active":"2024-05-09T05:05:59.390138+0000","last_became_peered":"2024-05-09T05:05:59.390138+0000","last_unstale":"2024-05-09T05:06:01.922817+0000","last_undegraded":"2024-05-09T05:06:01.922817+0000","last_fullsized":"2024-05-09T05:06:01.922817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:12.190553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419242+0000","last_change":"2024-05-09T05:06:00.417197+0000","last_active":"2024-05-09T05:06:01.419242+0000","last_peered":"2024-05-09T05:06:01.419242+0000","last_clean":"2024-05-09T05:06:01.419242+0000","last_became_active":"2024-05-09T05:06:00.416942+0000","last_became_peered":"2024-05-09T05:06:00.416942+0000","last_unstale":"2024-05-09T05:06:01.419242+0000","last_undegraded":"2024-05-09T05:06:01.419242+0000","last_fullsized":"2024-05-09T05:06:01.419242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:49.488003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920998+0000","last_change":"2024-05-09T05:05:59.385582+0000","last_active":"2024-05-09T05:06:01.920998+0000","last_peered":"2024-05-09T05:06:01.920998+0000","last_clean":"2024-05-09T05:06:01.920998+0000","last_became_active":"2024-05-09T05:05:59.384595+0000","last_became_peered":"2024-05-09T05:05:59.384595+0000","last_unstale":"2024-05-09T05:06:01.920998+0000","last_undegraded":"2024-05-09T05:06:01.920998+0000","last_fullsized":"2024-05-09T05:06:01.920998+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:12.387362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415512+0000","last_change":"2024-05-09T05:06:00.427234+0000","last_active":"2024-05-09T05:06:01.415512+0000","last_peered":"2024-05-09T05:06:01.415512+0000","last_clean":"2024-05-09T05:06:01.415512+0000","last_became_active":"2024-05-09T05:06:00.426876+0000","last_became_peered":"2024-05-09T05:06:00.426876+0000","last_unstale":"2024-05-09T05:06:01.415512+0000","last_undegraded":"2024-05-09T05:06:01.415512+0000","last_fullsized":"2024-05-09T05:06:01.415512+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:46.380711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413428+0000","last_change":"2024-05-09T05:05:59.386713+0000","last_active":"2024-05-09T05:06:01.413428+0000","last_peered":"2024-05-09T05:06:01.413428+0000","last_clean":"2024-05-09T05:06:01.413428+0000","last_became_active":"2024-05-09T05:05:59.386453+0000","last_became_peered":"2024-05-09T05:05:59.386453+0000","last_unstale":"2024-05-09T05:06:01.413428+0000","last_undegraded":"2024-05-09T05:06:01.413428+0000","last_fullsized":"2024-05-09T05:06:01.413428+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:47.256663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920673+0000","last_change":"2024-05-09T05:06:00.416394+0000","last_active":"2024-05-09T05:06:01.920673+0000","last_peered":"2024-05-09T05:06:01.920673+0000","last_clean":"2024-05-09T05:06:01.920673+0000","last_became_active":"2024-05-09T05:06:00.414909+0000","last_became_peered":"2024-05-09T05:06:00.414909+0000","last_unstale":"2024-05-09T05:06:01.920673+0000","last_undegraded":"2024-05-09T05:06:01.920673+0000","last_fullsized":"2024-05-09T05:06:01.920673+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:05.007652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415938+0000","last_change":"2024-05-09T05:05:59.391715+0000","last_active":"2024-05-09T05:06:01.415938+0000","last_peered":"2024-05-09T05:06:01.415938+0000","last_clean":"2024-05-09T05:06:01.415938+0000","last_became_active":"2024-05-09T05:05:59.390698+0000","last_became_peered":"2024-05-09T05:05:59.390698+0000","last_unstale":"2024-05-09T05:06:01.415938+0000","last_undegraded":"2024-05-09T05:06:01.415938+0000","last_fullsized":"2024-05-09T05:06:01.415938+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:46.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919842+0000","last_change":"2024-05-09T05:06:00.410511+0000","last_active":"2024-05-09T05:06:01.919842+0000","last_peered":"2024-05-09T05:06:01.919842+0000","last_clean":"2024-05-09T05:06:01.919842+0000","last_became_active":"2024-05-09T05:06:00.409015+0000","last_became_peered":"2024-05-09T05:06:00.409015+0000","last_unstale":"2024-05-09T05:06:01.919842+0000","last_undegraded":"2024-05-09T05:06:01.919842+0000","last_fullsized":"2024-05-09T05:06:01.919842+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:23.190809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923389+0000","last_change":"2024-05-09T05:05:59.391411+0000","last_active":"2024-05-09T05:06:01.923389+0000","last_peered":"2024-05-09T05:06:01.923389+0000","last_clean":"2024-05-09T05:06:01.923389+0000","last_became_active":"2024-05-09T05:05:59.389551+0000","last_became_peered":"2024-05-09T05:05:59.389551+0000","last_unstale":"2024-05-09T05:06:01.923389+0000","last_undegraded":"2024-05-09T05:06:01.923389+0000","last_fullsized":"2024-05-09T05:06:01.923389+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:23.517440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414558+0000","last_change":"2024-05-09T05:06:00.432050+0000","last_active":"2024-05-09T05:06:01.414558+0000","last_peered":"2024-05-09T05:06:01.414558+0000","last_clean":"2024-05-09T05:06:01.414558+0000","last_became_active":"2024-05-09T05:06:00.431721+0000","last_became_peered":"2024-05-09T05:06:00.431721+0000","last_unstale":"2024-05-09T05:06:01.414558+0000","last_undegraded":"2024-05-09T05:06:01.414558+0000","last_fullsized":"2024-05-09T05:06:01.414558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:18:22.561331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416016+0000","last_change":"2024-05-09T05:05:59.398459+0000","last_active":"2024-05-09T05:06:01.416016+0000","last_peered":"2024-05-09T05:06:01.416016+0000","last_clean":"2024-05-09T05:06:01.416016+0000","last_became_active":"2024-05-09T05:05:59.398204+0000","last_became_peered":"2024-05-09T05:05:59.398204+0000","last_unstale":"2024-05-09T05:06:01.416016+0000","last_undegraded":"2024-05-09T05:06:01.416016+0000","last_fullsized":"2024-05-09T05:06:01.416016+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:36.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923037+0000","last_change":"2024-05-09T05:06:00.409190+0000","last_active":"2024-05-09T05:06:01.923037+0000","last_peered":"2024-05-09T05:06:01.923037+0000","last_clean":"2024-05-09T05:06:01.923037+0000","last_became_active":"2024-05-09T05:06:00.408853+0000","last_became_peered":"2024-05-09T05:06:00.408853+0000","last_unstale":"2024-05-09T05:06:01.923037+0000","last_undegraded":"2024-05-09T05:06:01.923037+0000","last_fullsized":"2024-05-09T05:06:01.923037+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:31.887623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419475+0000","last_change":"2024-05-09T05:05:59.383439+0000","last_active":"2024-05-09T05:06:01.419475+0000","last_peered":"2024-05-09T05:06:01.419475+0000","last_clean":"2024-05-09T05:06:01.419475+0000","last_became_active":"2024-05-09T05:05:59.383036+0000","last_became_peered":"2024-05-09T05:05:59.383036+0000","last_unstale":"2024-05-09T05:06:01.419475+0000","last_undegraded":"2024-05-09T05:06:01.419475+0000","last_fullsized":"2024-05-09T05:06:01.419475+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:36.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920248+0000","last_change":"2024-05-09T05:06:00.403775+0000","last_active":"2024-05-09T05:06:01.920248+0000","last_peered":"2024-05-09T05:06:01.920248+0000","last_clean":"2024-05-09T05:06:01.920248+0000","last_became_active":"2024-05-09T05:06:00.403449+0000","last_became_peered":"2024-05-09T05:06:00.403449+0000","last_unstale":"2024-05-09T05:06:01.920248+0000","last_undegraded":"2024-05-09T05:06:01.920248+0000","last_fullsized":"2024-05-09T05:06:01.920248+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:47.090787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415249+0000","last_change":"2024-05-09T05:05:59.384485+0000","last_active":"2024-05-09T05:06:01.415249+0000","last_peered":"2024-05-09T05:06:01.415249+0000","last_clean":"2024-05-09T05:06:01.415249+0000","last_became_active":"2024-05-09T05:05:59.383801+0000","last_became_peered":"2024-05-09T05:05:59.383801+0000","last_unstale":"2024-05-09T05:06:01.415249+0000","last_undegraded":"2024-05-09T05:06:01.415249+0000","last_fullsized":"2024-05-09T05:06:01.415249+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:20:59.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416198+0000","last_change":"2024-05-09T05:06:00.422391+0000","last_active":"2024-05-09T05:06:01.416198+0000","last_peered":"2024-05-09T05:06:01.416198+0000","last_clean":"2024-05-09T05:06:01.416198+0000","last_became_active":"2024-05-09T05:06:00.422122+0000","last_became_peered":"2024-05-09T05:06:00.422122+0000","last_unstale":"2024-05-09T05:06:01.416198+0000","last_undegraded":"2024-05-09T05:06:01.416198+0000","last_fullsized":"2024-05-09T05:06:01.416198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:21.475740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922103+0000","last_change":"2024-05-09T05:05:59.391424+0000","last_active":"2024-05-09T05:06:01.922103+0000","last_peered":"2024-05-09T05:06:01.922103+0000","last_clean":"2024-05-09T05:06:01.922103+0000","last_became_active":"2024-05-09T05:05:59.391106+0000","last_became_peered":"2024-05-09T05:05:59.391106+0000","last_unstale":"2024-05-09T05:06:01.922103+0000","last_undegraded":"2024-05-09T05:06:01.922103+0000","last_fullsized":"2024-05-09T05:06:01.922103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:57.971085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419347+0000","last_change":"2024-05-09T05:06:00.415021+0000","last_active":"2024-05-09T05:06:01.419347+0000","last_peered":"2024-05-09T05:06:01.419347+0000","last_clean":"2024-05-09T05:06:01.419347+0000","last_became_active":"2024-05-09T05:06:00.409141+0000","last_became_peered":"2024-05-09T05:06:00.409141+0000","last_unstale":"2024-05-09T05:06:01.419347+0000","last_undegraded":"2024-05-09T05:06:01.419347+0000","last_fullsized":"2024-05-09T05:06:01.419347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:29.041062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415354+0000","last_change":"2024-05-09T05:05:59.391286+0000","last_active":"2024-05-09T05:06:01.415354+0000","last_peered":"2024-05-09T05:06:01.415354+0000","last_clean":"2024-05-09T05:06:01.415354+0000","last_became_active":"2024-05-09T05:05:59.390621+0000","last_became_peered":"2024-05-09T05:05:59.390621+0000","last_unstale":"2024-05-09T05:06:01.415354+0000","last_undegraded":"2024-05-09T05:06:01.415354+0000","last_fullsized":"2024-05-09T05:06:01.415354+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:22.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416183+0000","last_change":"2024-05-09T05:06:00.426916+0000","last_active":"2024-05-09T05:06:01.416183+0000","last_peered":"2024-05-09T05:06:01.416183+0000","last_clean":"2024-05-09T05:06:01.416183+0000","last_became_active":"2024-05-09T05:06:00.425897+0000","last_became_peered":"2024-05-09T05:06:00.425897+0000","last_unstale":"2024-05-09T05:06:01.416183+0000","last_undegraded":"2024-05-09T05:06:01.416183+0000","last_fullsized":"2024-05-09T05:06:01.416183+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:53.382480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418784+0000","last_change":"2024-05-09T05:05:59.376319+0000","last_active":"2024-05-09T05:06:01.418784+0000","last_peered":"2024-05-09T05:06:01.418784+0000","last_clean":"2024-05-09T05:06:01.418784+0000","last_became_active":"2024-05-09T05:05:59.376018+0000","last_became_peered":"2024-05-09T05:05:59.376018+0000","last_unstale":"2024-05-09T05:06:01.418784+0000","last_undegraded":"2024-05-09T05:06:01.418784+0000","last_fullsized":"2024-05-09T05:06:01.418784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:22.888502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418819+0000","last_change":"2024-05-09T05:06:00.411205+0000","last_active":"2024-05-09T05:06:01.418819+0000","last_peered":"2024-05-09T05:06:01.418819+0000","last_clean":"2024-05-09T05:06:01.418819+0000","last_became_active":"2024-05-09T05:06:00.409128+0000","last_became_peered":"2024-05-09T05:06:00.409128+0000","last_unstale":"2024-05-09T05:06:01.418819+0000","last_undegraded":"2024-05-09T05:06:01.418819+0000","last_fullsized":"2024-05-09T05:06:01.418819+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:17.901153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416508+0000","last_change":"2024-05-09T05:05:59.376639+0000","last_active":"2024-05-09T05:06:01.416508+0000","last_peered":"2024-05-09T05:06:01.416508+0000","last_clean":"2024-05-09T05:06:01.416508+0000","last_became_active":"2024-05-09T05:05:59.376304+0000","last_became_peered":"2024-05-09T05:05:59.376304+0000","last_unstale":"2024-05-09T05:06:01.416508+0000","last_undegraded":"2024-05-09T05:06:01.416508+0000","last_fullsized":"2024-05-09T05:06:01.416508+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:19.148596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919187+0000","last_change":"2024-05-09T05:06:00.408396+0000","last_active":"2024-05-09T05:06:01.919187+0000","last_peered":"2024-05-09T05:06:01.919187+0000","last_clean":"2024-05-09T05:06:01.919187+0000","last_became_active":"2024-05-09T05:06:00.408158+0000","last_became_peered":"2024-05-09T05:06:00.408158+0000","last_unstale":"2024-05-09T05:06:01.919187+0000","last_undegraded":"2024-05-09T05:06:01.919187+0000","last_fullsized":"2024-05-09T05:06:01.919187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:31.887623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922003+0000","last_change":"2024-05-09T05:05:59.386002+0000","last_active":"2024-05-09T05:06:01.922003+0000","last_peered":"2024-05-09T05:06:01.922003+0000","last_clean":"2024-05-09T05:06:01.922003+0000","last_became_active":"2024-05-09T05:05:59.385694+0000","last_became_peered":"2024-05-09T05:05:59.385694+0000","last_unstale":"2024-05-09T05:06:01.922003+0000","last_undegraded":"2024-05-09T05:06:01.922003+0000","last_fullsized":"2024-05-09T05:06:01.922003+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:41.205763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922508+0000","last_change":"2024-05-09T05:06:00.432714+0000","last_active":"2024-05-09T05:06:01.922508+0000","last_peered":"2024-05-09T05:06:01.922508+0000","last_clean":"2024-05-09T05:06:01.922508+0000","last_became_active":"2024-05-09T05:06:00.432368+0000","last_became_peered":"2024-05-09T05:06:00.432368+0000","last_unstale":"2024-05-09T05:06:01.922508+0000","last_undegraded":"2024-05-09T05:06:01.922508+0000","last_fullsized":"2024-05-09T05:06:01.922508+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:20.942801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921424+0000","last_change":"2024-05-09T05:05:59.396051+0000","last_active":"2024-05-09T05:06:01.921424+0000","last_peered":"2024-05-09T05:06:01.921424+0000","last_clean":"2024-05-09T05:06:01.921424+0000","last_became_active":"2024-05-09T05:05:59.395717+0000","last_became_peered":"2024-05-09T05:05:59.395717+0000","last_unstale":"2024-05-09T05:06:01.921424+0000","last_undegraded":"2024-05-09T05:06:01.921424+0000","last_fullsized":"2024-05-09T05:06:01.921424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:07.076842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919416+0000","last_change":"2024-05-09T05:06:00.414943+0000","last_active":"2024-05-09T05:06:01.919416+0000","last_peered":"2024-05-09T05:06:01.919416+0000","last_clean":"2024-05-09T05:06:01.919416+0000","last_became_active":"2024-05-09T05:06:00.414619+0000","last_became_peered":"2024-05-09T05:06:00.414619+0000","last_unstale":"2024-05-09T05:06:01.919416+0000","last_undegraded":"2024-05-09T05:06:01.919416+0000","last_fullsized":"2024-05-09T05:06:01.919416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:46.523012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921936+0000","last_change":"2024-05-09T05:05:59.389001+0000","last_active":"2024-05-09T05:06:01.921936+0000","last_peered":"2024-05-09T05:06:01.921936+0000","last_clean":"2024-05-09T05:06:01.921936+0000","last_became_active":"2024-05-09T05:05:59.387839+0000","last_became_peered":"2024-05-09T05:05:59.387839+0000","last_unstale":"2024-05-09T05:06:01.921936+0000","last_undegraded":"2024-05-09T05:06:01.921936+0000","last_fullsized":"2024-05-09T05:06:01.921936+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:53:59.252899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920684+0000","last_change":"2024-05-09T05:06:00.411656+0000","last_active":"2024-05-09T05:06:01.920684+0000","last_peered":"2024-05-09T05:06:01.920684+0000","last_clean":"2024-05-09T05:06:01.920684+0000","last_became_active":"2024-05-09T05:06:00.411278+0000","last_became_peered":"2024-05-09T05:06:00.411278+0000","last_unstale":"2024-05-09T05:06:01.920684+0000","last_undegraded":"2024-05-09T05:06:01.920684+0000","last_fullsized":"2024-05-09T05:06:01.920684+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:37.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919718+0000","last_change":"2024-05-09T05:05:59.391807+0000","last_active":"2024-05-09T05:06:01.919718+0000","last_peered":"2024-05-09T05:06:01.919718+0000","last_clean":"2024-05-09T05:06:01.919718+0000","last_became_active":"2024-05-09T05:05:59.391468+0000","last_became_peered":"2024-05-09T05:05:59.391468+0000","last_unstale":"2024-05-09T05:06:01.919718+0000","last_undegraded":"2024-05-09T05:06:01.919718+0000","last_fullsized":"2024-05-09T05:06:01.919718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:47.256663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921141+0000","last_change":"2024-05-09T05:06:00.408127+0000","last_active":"2024-05-09T05:06:01.921141+0000","last_peered":"2024-05-09T05:06:01.921141+0000","last_clean":"2024-05-09T05:06:01.921141+0000","last_became_active":"2024-05-09T05:06:00.407825+0000","last_became_peered":"2024-05-09T05:06:00.407825+0000","last_unstale":"2024-05-09T05:06:01.921141+0000","last_undegraded":"2024-05-09T05:06:01.921141+0000","last_fullsized":"2024-05-09T05:06:01.921141+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:03.178320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418264+0000","last_change":"2024-05-09T05:05:59.378685+0000","last_active":"2024-05-09T05:06:01.418264+0000","last_peered":"2024-05-09T05:06:01.418264+0000","last_clean":"2024-05-09T05:06:01.418264+0000","last_became_active":"2024-05-09T05:05:59.378371+0000","last_became_peered":"2024-05-09T05:05:59.378371+0000","last_unstale":"2024-05-09T05:06:01.418264+0000","last_undegraded":"2024-05-09T05:06:01.418264+0000","last_fullsized":"2024-05-09T05:06:01.418264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:22.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415880+0000","last_change":"2024-05-09T05:06:00.421985+0000","last_active":"2024-05-09T05:06:01.415880+0000","last_peered":"2024-05-09T05:06:01.415880+0000","last_clean":"2024-05-09T05:06:01.415880+0000","last_became_active":"2024-05-09T05:06:00.421656+0000","last_became_peered":"2024-05-09T05:06:00.421656+0000","last_unstale":"2024-05-09T05:06:01.415880+0000","last_undegraded":"2024-05-09T05:06:01.415880+0000","last_fullsized":"2024-05-09T05:06:01.415880+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:46.380711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414001+0000","last_change":"2024-05-09T05:05:59.385513+0000","last_active":"2024-05-09T05:06:01.414001+0000","last_peered":"2024-05-09T05:06:01.414001+0000","last_clean":"2024-05-09T05:06:01.414001+0000","last_became_active":"2024-05-09T05:05:59.384110+0000","last_became_peered":"2024-05-09T05:05:59.384110+0000","last_unstale":"2024-05-09T05:06:01.414001+0000","last_undegraded":"2024-05-09T05:06:01.414001+0000","last_fullsized":"2024-05-09T05:06:01.414001+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:02.163027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919938+0000","last_change":"2024-05-09T05:06:00.418155+0000","last_active":"2024-05-09T05:06:01.919938+0000","last_peered":"2024-05-09T05:06:01.919938+0000","last_clean":"2024-05-09T05:06:01.919938+0000","last_became_active":"2024-05-09T05:06:00.417867+0000","last_became_peered":"2024-05-09T05:06:00.417867+0000","last_unstale":"2024-05-09T05:06:01.919938+0000","last_undegraded":"2024-05-09T05:06:01.919938+0000","last_fullsized":"2024-05-09T05:06:01.919938+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:23.190809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920812+0000","last_change":"2024-05-09T05:05:59.384533+0000","last_active":"2024-05-09T05:06:01.920812+0000","last_peered":"2024-05-09T05:06:01.920812+0000","last_clean":"2024-05-09T05:06:01.920812+0000","last_became_active":"2024-05-09T05:05:59.384250+0000","last_became_peered":"2024-05-09T05:05:59.384250+0000","last_unstale":"2024-05-09T05:06:01.920812+0000","last_undegraded":"2024-05-09T05:06:01.920812+0000","last_fullsized":"2024-05-09T05:06:01.920812+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:39.020821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919808+0000","last_change":"2024-05-09T05:06:00.403156+0000","last_active":"2024-05-09T05:06:01.919808+0000","last_peered":"2024-05-09T05:06:01.919808+0000","last_clean":"2024-05-09T05:06:01.919808+0000","last_became_active":"2024-05-09T05:06:00.399948+0000","last_became_peered":"2024-05-09T05:06:00.399948+0000","last_unstale":"2024-05-09T05:06:01.919808+0000","last_undegraded":"2024-05-09T05:06:01.919808+0000","last_fullsized":"2024-05-09T05:06:01.919808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:50:46.166003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921367+0000","last_change":"2024-05-09T05:05:59.384549+0000","last_active":"2024-05-09T05:06:01.921367+0000","last_peered":"2024-05-09T05:06:01.921367+0000","last_clean":"2024-05-09T05:06:01.921367+0000","last_became_active":"2024-05-09T05:05:59.382852+0000","last_became_peered":"2024-05-09T05:05:59.382852+0000","last_unstale":"2024-05-09T05:06:01.921367+0000","last_undegraded":"2024-05-09T05:06:01.921367+0000","last_fullsized":"2024-05-09T05:06:01.921367+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:39.550521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919936+0000","last_change":"2024-05-09T05:06:00.404121+0000","last_active":"2024-05-09T05:06:01.919936+0000","last_peered":"2024-05-09T05:06:01.919936+0000","last_clean":"2024-05-09T05:06:01.919936+0000","last_became_active":"2024-05-09T05:06:00.403302+0000","last_became_peered":"2024-05-09T05:06:00.403302+0000","last_unstale":"2024-05-09T05:06:01.919936+0000","last_undegraded":"2024-05-09T05:06:01.919936+0000","last_fullsized":"2024-05-09T05:06:01.919936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:23.903795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416086+0000","last_change":"2024-05-09T05:05:59.393971+0000","last_active":"2024-05-09T05:06:01.416086+0000","last_peered":"2024-05-09T05:06:01.416086+0000","last_clean":"2024-05-09T05:06:01.416086+0000","last_became_active":"2024-05-09T05:05:59.393645+0000","last_became_peered":"2024-05-09T05:05:59.393645+0000","last_unstale":"2024-05-09T05:06:01.416086+0000","last_undegraded":"2024-05-09T05:06:01.416086+0000","last_fullsized":"2024-05-09T05:06:01.416086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:45.546282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418786+0000","last_change":"2024-05-09T05:06:00.414546+0000","last_active":"2024-05-09T05:06:01.418786+0000","last_peered":"2024-05-09T05:06:01.418786+0000","last_clean":"2024-05-09T05:06:01.418786+0000","last_became_active":"2024-05-09T05:06:00.414246+0000","last_became_peered":"2024-05-09T05:06:00.414246+0000","last_unstale":"2024-05-09T05:06:01.418786+0000","last_undegraded":"2024-05-09T05:06:01.418786+0000","last_fullsized":"2024-05-09T05:06:01.418786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:27.888610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415365+0000","last_change":"2024-05-09T05:05:59.380274+0000","last_active":"2024-05-09T05:06:01.415365+0000","last_peered":"2024-05-09T05:06:01.415365+0000","last_clean":"2024-05-09T05:06:01.415365+0000","last_became_active":"2024-05-09T05:05:59.379926+0000","last_became_peered":"2024-05-09T05:05:59.379926+0000","last_unstale":"2024-05-09T05:06:01.415365+0000","last_undegraded":"2024-05-09T05:06:01.415365+0000","last_fullsized":"2024-05-09T05:06:01.415365+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:12.190553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415398+0000","last_change":"2024-05-09T05:06:00.424026+0000","last_active":"2024-05-09T05:06:01.415398+0000","last_peered":"2024-05-09T05:06:01.415398+0000","last_clean":"2024-05-09T05:06:01.415398+0000","last_became_active":"2024-05-09T05:06:00.423698+0000","last_became_peered":"2024-05-09T05:06:00.423698+0000","last_unstale":"2024-05-09T05:06:01.415398+0000","last_undegraded":"2024-05-09T05:06:01.415398+0000","last_fullsized":"2024-05-09T05:06:01.415398+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:32.518272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418716+0000","last_change":"2024-05-09T05:05:59.382742+0000","last_active":"2024-05-09T05:06:01.418716+0000","last_peered":"2024-05-09T05:06:01.418716+0000","last_clean":"2024-05-09T05:06:01.418716+0000","last_became_active":"2024-05-09T05:05:59.382431+0000","last_became_peered":"2024-05-09T05:05:59.382431+0000","last_unstale":"2024-05-09T05:06:01.418716+0000","last_undegraded":"2024-05-09T05:06:01.418716+0000","last_fullsized":"2024-05-09T05:06:01.418716+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:45.546282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921362+0000","last_change":"2024-05-09T05:06:00.404296+0000","last_active":"2024-05-09T05:06:01.921362+0000","last_peered":"2024-05-09T05:06:01.921362+0000","last_clean":"2024-05-09T05:06:01.921362+0000","last_became_active":"2024-05-09T05:06:00.404005+0000","last_became_peered":"2024-05-09T05:06:00.404005+0000","last_unstale":"2024-05-09T05:06:01.921362+0000","last_undegraded":"2024-05-09T05:06:01.921362+0000","last_fullsized":"2024-05-09T05:06:01.921362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:46.561576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418499+0000","last_change":"2024-05-09T05:05:59.386148+0000","last_active":"2024-05-09T05:06:01.418499+0000","last_peered":"2024-05-09T05:06:01.418499+0000","last_clean":"2024-05-09T05:06:01.418499+0000","last_became_active":"2024-05-09T05:05:59.385911+0000","last_became_peered":"2024-05-09T05:05:59.385911+0000","last_unstale":"2024-05-09T05:06:01.418499+0000","last_undegraded":"2024-05-09T05:06:01.418499+0000","last_fullsized":"2024-05-09T05:06:01.418499+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:46.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415521+0000","last_change":"2024-05-09T05:06:00.428771+0000","last_active":"2024-05-09T05:06:01.415521+0000","last_peered":"2024-05-09T05:06:01.415521+0000","last_clean":"2024-05-09T05:06:01.415521+0000","last_became_active":"2024-05-09T05:06:00.428128+0000","last_became_peered":"2024-05-09T05:06:00.428128+0000","last_unstale":"2024-05-09T05:06:01.415521+0000","last_undegraded":"2024-05-09T05:06:01.415521+0000","last_fullsized":"2024-05-09T05:06:01.415521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:28.193154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922469+0000","last_change":"2024-05-09T05:05:59.382487+0000","last_active":"2024-05-09T05:06:01.922469+0000","last_peered":"2024-05-09T05:06:01.922469+0000","last_clean":"2024-05-09T05:06:01.922469+0000","last_became_active":"2024-05-09T05:05:59.382194+0000","last_became_peered":"2024-05-09T05:05:59.382194+0000","last_unstale":"2024-05-09T05:06:01.922469+0000","last_undegraded":"2024-05-09T05:06:01.922469+0000","last_fullsized":"2024-05-09T05:06:01.922469+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:02.163027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.420329+0000","last_change":"2024-05-09T05:06:00.430565+0000","last_active":"2024-05-09T05:06:01.420329+0000","last_peered":"2024-05-09T05:06:01.420329+0000","last_clean":"2024-05-09T05:06:01.420329+0000","last_became_active":"2024-05-09T05:06:00.430305+0000","last_became_peered":"2024-05-09T05:06:00.430305+0000","last_unstale":"2024-05-09T05:06:01.420329+0000","last_undegraded":"2024-05-09T05:06:01.420329+0000","last_fullsized":"2024-05-09T05:06:01.420329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:07:05.365371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920442+0000","last_change":"2024-05-09T05:05:59.393040+0000","last_active":"2024-05-09T05:06:01.920442+0000","last_peered":"2024-05-09T05:06:01.920442+0000","last_clean":"2024-05-09T05:06:01.920442+0000","last_became_active":"2024-05-09T05:05:59.392735+0000","last_became_peered":"2024-05-09T05:05:59.392735+0000","last_unstale":"2024-05-09T05:06:01.920442+0000","last_undegraded":"2024-05-09T05:06:01.920442+0000","last_fullsized":"2024-05-09T05:06:01.920442+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:03.992359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920721+0000","last_change":"2024-05-09T05:06:00.414815+0000","last_active":"2024-05-09T05:06:01.920721+0000","last_peered":"2024-05-09T05:06:01.920721+0000","last_clean":"2024-05-09T05:06:01.920721+0000","last_became_active":"2024-05-09T05:06:00.414544+0000","last_became_peered":"2024-05-09T05:06:00.414544+0000","last_unstale":"2024-05-09T05:06:01.920721+0000","last_undegraded":"2024-05-09T05:06:01.920721+0000","last_fullsized":"2024-05-09T05:06:01.920721+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:48.271957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415625+0000","last_change":"2024-05-09T05:05:59.383278+0000","last_active":"2024-05-09T05:06:01.415625+0000","last_peered":"2024-05-09T05:06:01.415625+0000","last_clean":"2024-05-09T05:06:01.415625+0000","last_became_active":"2024-05-09T05:05:59.382979+0000","last_became_peered":"2024-05-09T05:05:59.382979+0000","last_unstale":"2024-05-09T05:06:01.415625+0000","last_undegraded":"2024-05-09T05:06:01.415625+0000","last_fullsized":"2024-05-09T05:06:01.415625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:58.735690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":161,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415216+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:06:01.415216+0000","last_peered":"2024-05-09T05:06:01.415216+0000","last_clean":"2024-05-09T05:06:01.415216+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:01.415216+0000","last_undegraded":"2024-05-09T05:06:01.415216+0000","last_fullsized":"2024-05-09T05:06:01.415216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":820332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":224192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":223540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":224122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":225174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":557056,"data_stored":225152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":223700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1159168,"data_stored":820264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:04.826 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:05.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.064+0000 7f6f97e00640 1 Processor -- start 2024-05-09T05:06:05.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.064+0000 7f6f97e00640 1 -- start start 2024-05-09T05:06:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f97e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f98143710 0x7f6f98161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f97e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f9815db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f97e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f98143af0 con 0x7f6f980cdc20 2024-05-09T05:06:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f97e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6f98160ce0 con 0x7f6f98143710 2024-05-09T05:06:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f97e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6f98161c70 con 0x7f6f9815d6c0 2024-05-09T05:06:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f96a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f98143710 0x7f6f98161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f96a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f98143710 0x7f6f98161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52764/0 (socket says 172.21.15.100:52764) 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f96a00640 1 -- 172.21.15.100:0/607241240 learned_addr learned my addr 172.21.15.100:0/607241240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.066+0000 7f6f96000640 1 --2- 172.21.15.100:0/607241240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f9815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.067+0000 7f6f96a00640 1 -- 172.21.15.100:0/607241240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 msgr2=0x7f6f9815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.067+0000 7f6f96a00640 1 --2- 172.21.15.100:0/607241240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f9815db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.067+0000 7f6f96a00640 1 -- 172.21.15.100:0/607241240 >> v1:172.21.15.133:6789/0 conn(0x7f6f980cdc20 legacy=0x7f6f980cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:05.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.067+0000 7f6f96a00640 1 -- 172.21.15.100:0/607241240 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9815e240 con 0x7f6f98143710 2024-05-09T05:06:05.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.068+0000 7f6f96a00640 1 --2- 172.21.15.100:0/607241240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f98143710 0x7f6f98161730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009870 tx=0x7f6f8802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e5b4b9c1e5370e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.068+0000 7f6f95600640 1 -- 172.21.15.100:0/607241240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88037070 con 0x7f6f98143710 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.068+0000 7f6f95600640 1 -- 172.21.15.100:0/607241240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f88032440 con 0x7f6f98143710 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.068+0000 7f6f95600640 1 -- 172.21.15.100:0/607241240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88032810 con 0x7f6f98143710 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 -- 172.21.15.100:0/607241240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f98143710 msgr2=0x7f6f98161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 --2- 172.21.15.100:0/607241240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f98143710 0x7f6f98161730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009870 tx=0x7f6f8802a130 comp rx=0 tx=0).stop 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 -- 172.21.15.100:0/607241240 shutdown_connections 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 --2- 172.21.15.100:0/607241240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f9815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 --2- 172.21.15.100:0/607241240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f98143710 0x7f6f98161730 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 -- 172.21.15.100:0/607241240 >> 172.21.15.100:0/607241240 conn(0x7f6f9806c7f0 msgr2=0x7f6f9806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 -- 172.21.15.100:0/607241240 shutdown_connections 2024-05-09T05:06:05.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.069+0000 7f6f97e00640 1 -- 172.21.15.100:0/607241240 wait complete. 2024-05-09T05:06:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.071+0000 7f6f97e00640 1 Processor -- start 2024-05-09T05:06:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.071+0000 7f6f97e00640 1 -- start start 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f97e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 0x7f6f9813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f97e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f98143710 0x7f6f98146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f97e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f980c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f97e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98161210 con 0x7f6f980cdc20 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f97e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98160f30 con 0x7f6f98143710 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f97e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6f98072490 con 0x7f6f9815d6c0 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 0x7f6f9813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 0x7f6f9813e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52768/0 (socket says 172.21.15.100:52768) 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 -- 172.21.15.100:0/2623874963 learned_addr learned my addr 172.21.15.100:0/2623874963 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 -- 172.21.15.100:0/2623874963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 msgr2=0x7f6f980c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f980c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 -- 172.21.15.100:0/2623874963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f98143710 msgr2=0x7f6f98146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f98143710 0x7f6f98146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.072+0000 7f6f96a00640 1 -- 172.21.15.100:0/2623874963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9813ef20 con 0x7f6f980cdc20 2024-05-09T05:06:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.073+0000 7f6f96a00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 0x7f6f9813e9e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6f88000c00 tx=0x7f6f880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.073+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88041020 con 0x7f6f980cdc20 2024-05-09T05:06:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.073+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f880306c0 con 0x7f6f980cdc20 2024-05-09T05:06:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.073+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88037040 con 0x7f6f980cdc20 2024-05-09T05:06:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.073+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f98144c20 con 0x7f6f980cdc20 2024-05-09T05:06:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.073+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f981451e0 con 0x7f6f980cdc20 2024-05-09T05:06:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.074+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9806a550 con 0x7f6f980cdc20 2024-05-09T05:06:05.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.075+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6f88044020 con 0x7f6f980cdc20 2024-05-09T05:06:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.076+0000 7f6f8ea00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6f780762d0 0x7f6f78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.077+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f6f880b7e70 con 0x7f6f980cdc20 2024-05-09T05:06:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.077+0000 7f6f96000640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6f780762d0 0x7f6f78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.077+0000 7f6f96000640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6f780762d0 0x7f6f78078790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f84006fd0 tx=0x7f6f84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:05.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.081+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6f8804b030 con 0x7f6f980cdc20 2024-05-09T05:06:05.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.284+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f9806fc30 con 0x7f6f780762d0 2024-05-09T05:06:05.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.293+0000 7f6f8ea00640 1 -- 172.21.15.100:0/2623874963 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f6f9806fc30 con 0x7f6f780762d0 2024-05-09T05:06:05.296 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:05.299 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:05.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6f780762d0 msgr2=0x7f6f78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6f780762d0 0x7f6f78078790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f84006fd0 tx=0x7f6f84008040 comp rx=0 tx=0).stop 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 msgr2=0x7f6f9813e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 0x7f6f9813e9e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6f88000c00 tx=0x7f6f880046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 shutdown_connections 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6f780762d0 0x7f6f78078790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9815d6c0 0x7f6f980c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f98143710 0x7f6f98146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 --2- 172.21.15.100:0/2623874963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f980cdc20 0x7f6f9813e9e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 >> 172.21.15.100:0/2623874963 conn(0x7f6f9806c7f0 msgr2=0x7f6f9815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 shutdown_connections 2024-05-09T05:06:05.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.300+0000 7f6f97e00640 1 -- 172.21.15.100:0/2623874963 wait complete. 2024-05-09T05:06:05.320 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-05-09T05:06:03.910715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230016,"kb_used_data":5504,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744704,"statfs":{"total":773094113280,"available":772858576896,"internally_reserved":0,"allocated":5636096,"data_stored":2986476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.565716"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919804+0000","last_change":"2024-05-09T05:06:00.415449+0000","last_active":"2024-05-09T05:06:01.919804+0000","last_peered":"2024-05-09T05:06:01.919804+0000","last_clean":"2024-05-09T05:06:01.919804+0000","last_became_active":"2024-05-09T05:06:00.415177+0000","last_became_peered":"2024-05-09T05:06:00.415177+0000","last_unstale":"2024-05-09T05:06:01.919804+0000","last_undegraded":"2024-05-09T05:06:01.919804+0000","last_fullsized":"2024-05-09T05:06:01.919804+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:50:46.166003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415710+0000","last_change":"2024-05-09T05:06:00.413769+0000","last_active":"2024-05-09T05:06:01.415710+0000","last_peered":"2024-05-09T05:06:01.415710+0000","last_clean":"2024-05-09T05:06:01.415710+0000","last_became_active":"2024-05-09T05:06:00.413242+0000","last_became_peered":"2024-05-09T05:06:00.413242+0000","last_unstale":"2024-05-09T05:06:01.415710+0000","last_undegraded":"2024-05-09T05:06:01.415710+0000","last_fullsized":"2024-05-09T05:06:01.415710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:53.382480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415313+0000","last_change":"2024-05-09T05:06:00.431514+0000","last_active":"2024-05-09T05:06:01.415313+0000","last_peered":"2024-05-09T05:06:01.415313+0000","last_clean":"2024-05-09T05:06:01.415313+0000","last_became_active":"2024-05-09T05:06:00.431302+0000","last_became_peered":"2024-05-09T05:06:00.431302+0000","last_unstale":"2024-05-09T05:06:01.415313+0000","last_undegraded":"2024-05-09T05:06:01.415313+0000","last_fullsized":"2024-05-09T05:06:01.415313+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:32:16.636429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415772+0000","last_change":"2024-05-09T05:06:00.415911+0000","last_active":"2024-05-09T05:06:01.415772+0000","last_peered":"2024-05-09T05:06:01.415772+0000","last_clean":"2024-05-09T05:06:01.415772+0000","last_became_active":"2024-05-09T05:06:00.415638+0000","last_became_peered":"2024-05-09T05:06:00.415638+0000","last_unstale":"2024-05-09T05:06:01.415772+0000","last_undegraded":"2024-05-09T05:06:01.415772+0000","last_fullsized":"2024-05-09T05:06:01.415772+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:46.788287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923234+0000","last_change":"2024-05-09T05:06:00.409434+0000","last_active":"2024-05-09T05:06:01.923234+0000","last_peered":"2024-05-09T05:06:01.923234+0000","last_clean":"2024-05-09T05:06:01.923234+0000","last_became_active":"2024-05-09T05:06:00.408893+0000","last_became_peered":"2024-05-09T05:06:00.408893+0000","last_unstale":"2024-05-09T05:06:01.923234+0000","last_undegraded":"2024-05-09T05:06:01.923234+0000","last_fullsized":"2024-05-09T05:06:01.923234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:33:10.483297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919301+0000","last_change":"2024-05-09T05:06:00.409899+0000","last_active":"2024-05-09T05:06:01.919301+0000","last_peered":"2024-05-09T05:06:01.919301+0000","last_clean":"2024-05-09T05:06:01.919301+0000","last_became_active":"2024-05-09T05:06:00.409374+0000","last_became_peered":"2024-05-09T05:06:00.409374+0000","last_unstale":"2024-05-09T05:06:01.919301+0000","last_undegraded":"2024-05-09T05:06:01.919301+0000","last_fullsized":"2024-05-09T05:06:01.919301+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:15:35.667696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413731+0000","last_change":"2024-05-09T05:06:00.428982+0000","last_active":"2024-05-09T05:06:01.413731+0000","last_peered":"2024-05-09T05:06:01.413731+0000","last_clean":"2024-05-09T05:06:01.413731+0000","last_became_active":"2024-05-09T05:06:00.428692+0000","last_became_peered":"2024-05-09T05:06:00.428692+0000","last_unstale":"2024-05-09T05:06:01.413731+0000","last_undegraded":"2024-05-09T05:06:01.413731+0000","last_fullsized":"2024-05-09T05:06:01.413731+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:46.561576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418493+0000","last_change":"2024-05-09T05:06:00.412436+0000","last_active":"2024-05-09T05:06:01.418493+0000","last_peered":"2024-05-09T05:06:01.418493+0000","last_clean":"2024-05-09T05:06:01.418493+0000","last_became_active":"2024-05-09T05:06:00.412125+0000","last_became_peered":"2024-05-09T05:06:00.412125+0000","last_unstale":"2024-05-09T05:06:01.418493+0000","last_undegraded":"2024-05-09T05:06:01.418493+0000","last_fullsized":"2024-05-09T05:06:01.418493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:05.262460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.420099+0000","last_change":"2024-05-09T05:06:00.427335+0000","last_active":"2024-05-09T05:06:01.420099+0000","last_peered":"2024-05-09T05:06:01.420099+0000","last_clean":"2024-05-09T05:06:01.420099+0000","last_became_active":"2024-05-09T05:06:00.427005+0000","last_became_peered":"2024-05-09T05:06:00.427005+0000","last_unstale":"2024-05-09T05:06:01.420099+0000","last_undegraded":"2024-05-09T05:06:01.420099+0000","last_fullsized":"2024-05-09T05:06:01.420099+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:22:34.906497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919801+0000","last_change":"2024-05-09T05:06:00.410044+0000","last_active":"2024-05-09T05:06:01.919801+0000","last_peered":"2024-05-09T05:06:01.919801+0000","last_clean":"2024-05-09T05:06:01.919801+0000","last_became_active":"2024-05-09T05:06:00.409720+0000","last_became_peered":"2024-05-09T05:06:00.409720+0000","last_unstale":"2024-05-09T05:06:01.919801+0000","last_undegraded":"2024-05-09T05:06:01.919801+0000","last_fullsized":"2024-05-09T05:06:01.919801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:14.442061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921929+0000","last_change":"2024-05-09T05:06:00.413286+0000","last_active":"2024-05-09T05:06:01.921929+0000","last_peered":"2024-05-09T05:06:01.921929+0000","last_clean":"2024-05-09T05:06:01.921929+0000","last_became_active":"2024-05-09T05:06:00.413011+0000","last_became_peered":"2024-05-09T05:06:00.413011+0000","last_unstale":"2024-05-09T05:06:01.921929+0000","last_undegraded":"2024-05-09T05:06:01.921929+0000","last_fullsized":"2024-05-09T05:06:01.921929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:07:23.162468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419428+0000","last_change":"2024-05-09T05:06:00.418389+0000","last_active":"2024-05-09T05:06:01.419428+0000","last_peered":"2024-05-09T05:06:01.419428+0000","last_clean":"2024-05-09T05:06:01.419428+0000","last_became_active":"2024-05-09T05:06:00.417705+0000","last_became_peered":"2024-05-09T05:06:00.417705+0000","last_unstale":"2024-05-09T05:06:01.419428+0000","last_undegraded":"2024-05-09T05:06:01.419428+0000","last_fullsized":"2024-05-09T05:06:01.419428+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:10:43.470960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919454+0000","last_change":"2024-05-09T05:06:00.412212+0000","last_active":"2024-05-09T05:06:01.919454+0000","last_peered":"2024-05-09T05:06:01.919454+0000","last_clean":"2024-05-09T05:06:01.919454+0000","last_became_active":"2024-05-09T05:06:00.410197+0000","last_became_peered":"2024-05-09T05:06:00.410197+0000","last_unstale":"2024-05-09T05:06:01.919454+0000","last_undegraded":"2024-05-09T05:06:01.919454+0000","last_fullsized":"2024-05-09T05:06:01.919454+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:42.681369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413738+0000","last_change":"2024-05-09T05:06:00.432320+0000","last_active":"2024-05-09T05:06:01.413738+0000","last_peered":"2024-05-09T05:06:01.413738+0000","last_clean":"2024-05-09T05:06:01.413738+0000","last_became_active":"2024-05-09T05:06:00.432010+0000","last_became_peered":"2024-05-09T05:06:00.432010+0000","last_unstale":"2024-05-09T05:06:01.413738+0000","last_undegraded":"2024-05-09T05:06:01.413738+0000","last_fullsized":"2024-05-09T05:06:01.413738+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:33.121649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416046+0000","last_change":"2024-05-09T05:06:00.418749+0000","last_active":"2024-05-09T05:06:01.416046+0000","last_peered":"2024-05-09T05:06:01.416046+0000","last_clean":"2024-05-09T05:06:01.416046+0000","last_became_active":"2024-05-09T05:06:00.418453+0000","last_became_peered":"2024-05-09T05:06:00.418453+0000","last_unstale":"2024-05-09T05:06:01.416046+0000","last_undegraded":"2024-05-09T05:06:01.416046+0000","last_fullsized":"2024-05-09T05:06:01.416046+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:27.888610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919278+0000","last_change":"2024-05-09T05:06:00.412818+0000","last_active":"2024-05-09T05:06:01.919278+0000","last_peered":"2024-05-09T05:06:01.919278+0000","last_clean":"2024-05-09T05:06:01.919278+0000","last_became_active":"2024-05-09T05:06:00.410026+0000","last_became_peered":"2024-05-09T05:06:00.410026+0000","last_unstale":"2024-05-09T05:06:01.919278+0000","last_undegraded":"2024-05-09T05:06:01.919278+0000","last_fullsized":"2024-05-09T05:06:01.919278+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:44.761881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416204+0000","last_change":"2024-05-09T05:06:00.427184+0000","last_active":"2024-05-09T05:06:01.416204+0000","last_peered":"2024-05-09T05:06:01.416204+0000","last_clean":"2024-05-09T05:06:01.416204+0000","last_became_active":"2024-05-09T05:06:00.426632+0000","last_became_peered":"2024-05-09T05:06:00.426632+0000","last_unstale":"2024-05-09T05:06:01.416204+0000","last_undegraded":"2024-05-09T05:06:01.416204+0000","last_fullsized":"2024-05-09T05:06:01.416204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:46.788287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415990+0000","last_change":"2024-05-09T05:06:00.413507+0000","last_active":"2024-05-09T05:06:01.415990+0000","last_peered":"2024-05-09T05:06:01.415990+0000","last_clean":"2024-05-09T05:06:01.415990+0000","last_became_active":"2024-05-09T05:06:00.412898+0000","last_became_peered":"2024-05-09T05:06:00.412898+0000","last_unstale":"2024-05-09T05:06:01.415990+0000","last_undegraded":"2024-05-09T05:06:01.415990+0000","last_fullsized":"2024-05-09T05:06:01.415990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:05.262460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415730+0000","last_change":"2024-05-09T05:06:00.425901+0000","last_active":"2024-05-09T05:06:01.415730+0000","last_peered":"2024-05-09T05:06:01.415730+0000","last_clean":"2024-05-09T05:06:01.415730+0000","last_became_active":"2024-05-09T05:06:00.424220+0000","last_became_peered":"2024-05-09T05:06:00.424220+0000","last_unstale":"2024-05-09T05:06:01.415730+0000","last_undegraded":"2024-05-09T05:06:01.415730+0000","last_fullsized":"2024-05-09T05:06:01.415730+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:11:20.471362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921599+0000","last_change":"2024-05-09T05:06:00.413238+0000","last_active":"2024-05-09T05:06:01.921599+0000","last_peered":"2024-05-09T05:06:01.921599+0000","last_clean":"2024-05-09T05:06:01.921599+0000","last_became_active":"2024-05-09T05:06:00.412948+0000","last_became_peered":"2024-05-09T05:06:00.412948+0000","last_unstale":"2024-05-09T05:06:01.921599+0000","last_undegraded":"2024-05-09T05:06:01.921599+0000","last_fullsized":"2024-05-09T05:06:01.921599+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:13.205847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920440+0000","last_change":"2024-05-09T05:06:00.413855+0000","last_active":"2024-05-09T05:06:01.920440+0000","last_peered":"2024-05-09T05:06:01.920440+0000","last_clean":"2024-05-09T05:06:01.920440+0000","last_became_active":"2024-05-09T05:06:00.413549+0000","last_became_peered":"2024-05-09T05:06:00.413549+0000","last_unstale":"2024-05-09T05:06:01.920440+0000","last_undegraded":"2024-05-09T05:06:01.920440+0000","last_fullsized":"2024-05-09T05:06:01.920440+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:09.300349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418347+0000","last_change":"2024-05-09T05:06:00.425052+0000","last_active":"2024-05-09T05:06:01.418347+0000","last_peered":"2024-05-09T05:06:01.418347+0000","last_clean":"2024-05-09T05:06:01.418347+0000","last_became_active":"2024-05-09T05:06:00.424735+0000","last_became_peered":"2024-05-09T05:06:00.424735+0000","last_unstale":"2024-05-09T05:06:01.418347+0000","last_undegraded":"2024-05-09T05:06:01.418347+0000","last_fullsized":"2024-05-09T05:06:01.418347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:35:46.788287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921177+0000","last_change":"2024-05-09T05:06:00.415658+0000","last_active":"2024-05-09T05:06:01.921177+0000","last_peered":"2024-05-09T05:06:01.921177+0000","last_clean":"2024-05-09T05:06:01.921177+0000","last_became_active":"2024-05-09T05:06:00.415326+0000","last_became_peered":"2024-05-09T05:06:00.415326+0000","last_unstale":"2024-05-09T05:06:01.921177+0000","last_undegraded":"2024-05-09T05:06:01.921177+0000","last_fullsized":"2024-05-09T05:06:01.921177+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:13:26.223358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413320+0000","last_change":"2024-05-09T05:06:00.423496+0000","last_active":"2024-05-09T05:06:01.413320+0000","last_peered":"2024-05-09T05:06:01.413320+0000","last_clean":"2024-05-09T05:06:01.413320+0000","last_became_active":"2024-05-09T05:06:00.410913+0000","last_became_peered":"2024-05-09T05:06:00.410913+0000","last_unstale":"2024-05-09T05:06:01.413320+0000","last_undegraded":"2024-05-09T05:06:01.413320+0000","last_fullsized":"2024-05-09T05:06:01.413320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:37.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416587+0000","last_change":"2024-05-09T05:06:00.426299+0000","last_active":"2024-05-09T05:06:01.416587+0000","last_peered":"2024-05-09T05:06:01.416587+0000","last_clean":"2024-05-09T05:06:01.416587+0000","last_became_active":"2024-05-09T05:06:00.425576+0000","last_became_peered":"2024-05-09T05:06:00.425576+0000","last_unstale":"2024-05-09T05:06:01.416587+0000","last_undegraded":"2024-05-09T05:06:01.416587+0000","last_fullsized":"2024-05-09T05:06:01.416587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:14.202982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419050+0000","last_change":"2024-05-09T05:06:00.431201+0000","last_active":"2024-05-09T05:06:01.419050+0000","last_peered":"2024-05-09T05:06:01.419050+0000","last_clean":"2024-05-09T05:06:01.419050+0000","last_became_active":"2024-05-09T05:06:00.430901+0000","last_became_peered":"2024-05-09T05:06:00.430901+0000","last_unstale":"2024-05-09T05:06:01.419050+0000","last_undegraded":"2024-05-09T05:06:01.419050+0000","last_fullsized":"2024-05-09T05:06:01.419050+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:33:10.926725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920535+0000","last_change":"2024-05-09T05:06:00.425124+0000","last_active":"2024-05-09T05:06:01.920535+0000","last_peered":"2024-05-09T05:06:01.920535+0000","last_clean":"2024-05-09T05:06:01.920535+0000","last_became_active":"2024-05-09T05:06:00.424842+0000","last_became_peered":"2024-05-09T05:06:00.424842+0000","last_unstale":"2024-05-09T05:06:01.920535+0000","last_undegraded":"2024-05-09T05:06:01.920535+0000","last_fullsized":"2024-05-09T05:06:01.920535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:47.090787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921596+0000","last_change":"2024-05-09T05:06:00.403135+0000","last_active":"2024-05-09T05:06:01.921596+0000","last_peered":"2024-05-09T05:06:01.921596+0000","last_clean":"2024-05-09T05:06:01.921596+0000","last_became_active":"2024-05-09T05:06:00.402839+0000","last_became_peered":"2024-05-09T05:06:00.402839+0000","last_unstale":"2024-05-09T05:06:01.921596+0000","last_undegraded":"2024-05-09T05:06:01.921596+0000","last_fullsized":"2024-05-09T05:06:01.921596+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:24.532734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414995+0000","last_change":"2024-05-09T05:06:00.428619+0000","last_active":"2024-05-09T05:06:01.414995+0000","last_peered":"2024-05-09T05:06:01.414995+0000","last_clean":"2024-05-09T05:06:01.414995+0000","last_became_active":"2024-05-09T05:06:00.428054+0000","last_became_peered":"2024-05-09T05:06:00.428054+0000","last_unstale":"2024-05-09T05:06:01.414995+0000","last_undegraded":"2024-05-09T05:06:01.414995+0000","last_fullsized":"2024-05-09T05:06:01.414995+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:07:39.264565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415722+0000","last_change":"2024-05-09T05:06:00.410214+0000","last_active":"2024-05-09T05:06:01.415722+0000","last_peered":"2024-05-09T05:06:01.415722+0000","last_clean":"2024-05-09T05:06:01.415722+0000","last_became_active":"2024-05-09T05:06:00.409903+0000","last_became_peered":"2024-05-09T05:06:00.409903+0000","last_unstale":"2024-05-09T05:06:01.415722+0000","last_undegraded":"2024-05-09T05:06:01.415722+0000","last_fullsized":"2024-05-09T05:06:01.415722+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:21.475740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414028+0000","last_change":"2024-05-09T05:06:00.428981+0000","last_active":"2024-05-09T05:06:01.414028+0000","last_peered":"2024-05-09T05:06:01.414028+0000","last_clean":"2024-05-09T05:06:01.414028+0000","last_became_active":"2024-05-09T05:06:00.428284+0000","last_became_peered":"2024-05-09T05:06:00.428284+0000","last_unstale":"2024-05-09T05:06:01.414028+0000","last_undegraded":"2024-05-09T05:06:01.414028+0000","last_fullsized":"2024-05-09T05:06:01.414028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:47:28.669728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919816+0000","last_change":"2024-05-09T05:06:00.405192+0000","last_active":"2024-05-09T05:06:01.919816+0000","last_peered":"2024-05-09T05:06:01.919816+0000","last_clean":"2024-05-09T05:06:01.919816+0000","last_became_active":"2024-05-09T05:06:00.403549+0000","last_became_peered":"2024-05-09T05:06:00.403549+0000","last_unstale":"2024-05-09T05:06:01.919816+0000","last_undegraded":"2024-05-09T05:06:01.919816+0000","last_fullsized":"2024-05-09T05:06:01.919816+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:23.903795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416230+0000","last_change":"2024-05-09T05:06:00.413492+0000","last_active":"2024-05-09T05:06:01.416230+0000","last_peered":"2024-05-09T05:06:01.416230+0000","last_clean":"2024-05-09T05:06:01.416230+0000","last_became_active":"2024-05-09T05:06:00.413150+0000","last_became_peered":"2024-05-09T05:06:00.413150+0000","last_unstale":"2024-05-09T05:06:01.416230+0000","last_undegraded":"2024-05-09T05:06:01.416230+0000","last_fullsized":"2024-05-09T05:06:01.416230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:17.901153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":18,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921051+0000","last_change":"2024-05-09T05:05:59.387887+0000","last_active":"2024-05-09T05:06:01.921051+0000","last_peered":"2024-05-09T05:06:01.921051+0000","last_clean":"2024-05-09T05:06:01.921051+0000","last_became_active":"2024-05-09T05:05:59.387576+0000","last_became_peered":"2024-05-09T05:05:59.387576+0000","last_unstale":"2024-05-09T05:06:01.921051+0000","last_undegraded":"2024-05-09T05:06:01.921051+0000","last_fullsized":"2024-05-09T05:06:01.921051+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:37.102480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921790+0000","last_change":"2024-05-09T05:06:00.410256+0000","last_active":"2024-05-09T05:06:01.921790+0000","last_peered":"2024-05-09T05:06:01.921790+0000","last_clean":"2024-05-09T05:06:01.921790+0000","last_became_active":"2024-05-09T05:06:00.403881+0000","last_became_peered":"2024-05-09T05:06:00.403881+0000","last_unstale":"2024-05-09T05:06:01.921790+0000","last_undegraded":"2024-05-09T05:06:01.921790+0000","last_fullsized":"2024-05-09T05:06:01.921790+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:25:33.121649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920088+0000","last_change":"2024-05-09T05:05:59.394062+0000","last_active":"2024-05-09T05:06:01.920088+0000","last_peered":"2024-05-09T05:06:01.920088+0000","last_clean":"2024-05-09T05:06:01.920088+0000","last_became_active":"2024-05-09T05:05:59.393592+0000","last_became_peered":"2024-05-09T05:05:59.393592+0000","last_unstale":"2024-05-09T05:06:01.920088+0000","last_undegraded":"2024-05-09T05:06:01.920088+0000","last_fullsized":"2024-05-09T05:06:01.920088+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:02.163027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922055+0000","last_change":"2024-05-09T05:06:00.410246+0000","last_active":"2024-05-09T05:06:01.922055+0000","last_peered":"2024-05-09T05:06:01.922055+0000","last_clean":"2024-05-09T05:06:01.922055+0000","last_became_active":"2024-05-09T05:06:00.409973+0000","last_became_peered":"2024-05-09T05:06:00.409973+0000","last_unstale":"2024-05-09T05:06:01.922055+0000","last_undegraded":"2024-05-09T05:06:01.922055+0000","last_fullsized":"2024-05-09T05:06:01.922055+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:00.347786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920418+0000","last_change":"2024-05-09T05:05:59.392290+0000","last_active":"2024-05-09T05:06:01.920418+0000","last_peered":"2024-05-09T05:06:01.920418+0000","last_clean":"2024-05-09T05:06:01.920418+0000","last_became_active":"2024-05-09T05:05:59.392013+0000","last_became_peered":"2024-05-09T05:05:59.392013+0000","last_unstale":"2024-05-09T05:06:01.920418+0000","last_undegraded":"2024-05-09T05:06:01.920418+0000","last_fullsized":"2024-05-09T05:06:01.920418+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:12.190553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418484+0000","last_change":"2024-05-09T05:06:00.408611+0000","last_active":"2024-05-09T05:06:01.418484+0000","last_peered":"2024-05-09T05:06:01.418484+0000","last_clean":"2024-05-09T05:06:01.418484+0000","last_became_active":"2024-05-09T05:06:00.405727+0000","last_became_peered":"2024-05-09T05:06:00.405727+0000","last_unstale":"2024-05-09T05:06:01.418484+0000","last_undegraded":"2024-05-09T05:06:01.418484+0000","last_fullsized":"2024-05-09T05:06:01.418484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:14.202982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920966+0000","last_change":"2024-05-09T05:05:59.373825+0000","last_active":"2024-05-09T05:06:01.920966+0000","last_peered":"2024-05-09T05:06:01.920966+0000","last_clean":"2024-05-09T05:06:01.920966+0000","last_became_active":"2024-05-09T05:05:59.373333+0000","last_became_peered":"2024-05-09T05:05:59.373333+0000","last_unstale":"2024-05-09T05:06:01.920966+0000","last_undegraded":"2024-05-09T05:06:01.920966+0000","last_fullsized":"2024-05-09T05:06:01.920966+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:19.927508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923315+0000","last_change":"2024-05-09T05:06:00.417488+0000","last_active":"2024-05-09T05:06:01.923315+0000","last_peered":"2024-05-09T05:06:01.923315+0000","last_clean":"2024-05-09T05:06:01.923315+0000","last_became_active":"2024-05-09T05:06:00.417242+0000","last_became_peered":"2024-05-09T05:06:00.417242+0000","last_unstale":"2024-05-09T05:06:01.923315+0000","last_undegraded":"2024-05-09T05:06:01.923315+0000","last_fullsized":"2024-05-09T05:06:01.923315+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:44.761881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414536+0000","last_change":"2024-05-09T05:05:59.384694+0000","last_active":"2024-05-09T05:06:01.414536+0000","last_peered":"2024-05-09T05:06:01.414536+0000","last_clean":"2024-05-09T05:06:01.414536+0000","last_became_active":"2024-05-09T05:05:59.384184+0000","last_became_peered":"2024-05-09T05:05:59.384184+0000","last_unstale":"2024-05-09T05:06:01.414536+0000","last_undegraded":"2024-05-09T05:06:01.414536+0000","last_fullsized":"2024-05-09T05:06:01.414536+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:23.517440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415931+0000","last_change":"2024-05-09T05:06:00.410395+0000","last_active":"2024-05-09T05:06:01.415931+0000","last_peered":"2024-05-09T05:06:01.415931+0000","last_clean":"2024-05-09T05:06:01.415931+0000","last_became_active":"2024-05-09T05:06:00.410049+0000","last_became_peered":"2024-05-09T05:06:00.410049+0000","last_unstale":"2024-05-09T05:06:01.415931+0000","last_undegraded":"2024-05-09T05:06:01.415931+0000","last_fullsized":"2024-05-09T05:06:01.415931+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:45:14.202982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922817+0000","last_change":"2024-05-09T05:05:59.390949+0000","last_active":"2024-05-09T05:06:01.922817+0000","last_peered":"2024-05-09T05:06:01.922817+0000","last_clean":"2024-05-09T05:06:01.922817+0000","last_became_active":"2024-05-09T05:05:59.390138+0000","last_became_peered":"2024-05-09T05:05:59.390138+0000","last_unstale":"2024-05-09T05:06:01.922817+0000","last_undegraded":"2024-05-09T05:06:01.922817+0000","last_fullsized":"2024-05-09T05:06:01.922817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:12.190553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419242+0000","last_change":"2024-05-09T05:06:00.417197+0000","last_active":"2024-05-09T05:06:01.419242+0000","last_peered":"2024-05-09T05:06:01.419242+0000","last_clean":"2024-05-09T05:06:01.419242+0000","last_became_active":"2024-05-09T05:06:00.416942+0000","last_became_peered":"2024-05-09T05:06:00.416942+0000","last_unstale":"2024-05-09T05:06:01.419242+0000","last_undegraded":"2024-05-09T05:06:01.419242+0000","last_fullsized":"2024-05-09T05:06:01.419242+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:49.488003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920998+0000","last_change":"2024-05-09T05:05:59.385582+0000","last_active":"2024-05-09T05:06:01.920998+0000","last_peered":"2024-05-09T05:06:01.920998+0000","last_clean":"2024-05-09T05:06:01.920998+0000","last_became_active":"2024-05-09T05:05:59.384595+0000","last_became_peered":"2024-05-09T05:05:59.384595+0000","last_unstale":"2024-05-09T05:06:01.920998+0000","last_undegraded":"2024-05-09T05:06:01.920998+0000","last_fullsized":"2024-05-09T05:06:01.920998+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:12.387362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415512+0000","last_change":"2024-05-09T05:06:00.427234+0000","last_active":"2024-05-09T05:06:01.415512+0000","last_peered":"2024-05-09T05:06:01.415512+0000","last_clean":"2024-05-09T05:06:01.415512+0000","last_became_active":"2024-05-09T05:06:00.426876+0000","last_became_peered":"2024-05-09T05:06:00.426876+0000","last_unstale":"2024-05-09T05:06:01.415512+0000","last_undegraded":"2024-05-09T05:06:01.415512+0000","last_fullsized":"2024-05-09T05:06:01.415512+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:46.380711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.413428+0000","last_change":"2024-05-09T05:05:59.386713+0000","last_active":"2024-05-09T05:06:01.413428+0000","last_peered":"2024-05-09T05:06:01.413428+0000","last_clean":"2024-05-09T05:06:01.413428+0000","last_became_active":"2024-05-09T05:05:59.386453+0000","last_became_peered":"2024-05-09T05:05:59.386453+0000","last_unstale":"2024-05-09T05:06:01.413428+0000","last_undegraded":"2024-05-09T05:06:01.413428+0000","last_fullsized":"2024-05-09T05:06:01.413428+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:47.256663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920673+0000","last_change":"2024-05-09T05:06:00.416394+0000","last_active":"2024-05-09T05:06:01.920673+0000","last_peered":"2024-05-09T05:06:01.920673+0000","last_clean":"2024-05-09T05:06:01.920673+0000","last_became_active":"2024-05-09T05:06:00.414909+0000","last_became_peered":"2024-05-09T05:06:00.414909+0000","last_unstale":"2024-05-09T05:06:01.920673+0000","last_undegraded":"2024-05-09T05:06:01.920673+0000","last_fullsized":"2024-05-09T05:06:01.920673+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:05.007652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415938+0000","last_change":"2024-05-09T05:05:59.391715+0000","last_active":"2024-05-09T05:06:01.415938+0000","last_peered":"2024-05-09T05:06:01.415938+0000","last_clean":"2024-05-09T05:06:01.415938+0000","last_became_active":"2024-05-09T05:05:59.390698+0000","last_became_peered":"2024-05-09T05:05:59.390698+0000","last_unstale":"2024-05-09T05:06:01.415938+0000","last_undegraded":"2024-05-09T05:06:01.415938+0000","last_fullsized":"2024-05-09T05:06:01.415938+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:46.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919842+0000","last_change":"2024-05-09T05:06:00.410511+0000","last_active":"2024-05-09T05:06:01.919842+0000","last_peered":"2024-05-09T05:06:01.919842+0000","last_clean":"2024-05-09T05:06:01.919842+0000","last_became_active":"2024-05-09T05:06:00.409015+0000","last_became_peered":"2024-05-09T05:06:00.409015+0000","last_unstale":"2024-05-09T05:06:01.919842+0000","last_undegraded":"2024-05-09T05:06:01.919842+0000","last_fullsized":"2024-05-09T05:06:01.919842+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:23.190809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923389+0000","last_change":"2024-05-09T05:05:59.391411+0000","last_active":"2024-05-09T05:06:01.923389+0000","last_peered":"2024-05-09T05:06:01.923389+0000","last_clean":"2024-05-09T05:06:01.923389+0000","last_became_active":"2024-05-09T05:05:59.389551+0000","last_became_peered":"2024-05-09T05:05:59.389551+0000","last_unstale":"2024-05-09T05:06:01.923389+0000","last_undegraded":"2024-05-09T05:06:01.923389+0000","last_fullsized":"2024-05-09T05:06:01.923389+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:05:23.517440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414558+0000","last_change":"2024-05-09T05:06:00.432050+0000","last_active":"2024-05-09T05:06:01.414558+0000","last_peered":"2024-05-09T05:06:01.414558+0000","last_clean":"2024-05-09T05:06:01.414558+0000","last_became_active":"2024-05-09T05:06:00.431721+0000","last_became_peered":"2024-05-09T05:06:00.431721+0000","last_unstale":"2024-05-09T05:06:01.414558+0000","last_undegraded":"2024-05-09T05:06:01.414558+0000","last_fullsized":"2024-05-09T05:06:01.414558+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:18:22.561331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416016+0000","last_change":"2024-05-09T05:05:59.398459+0000","last_active":"2024-05-09T05:06:01.416016+0000","last_peered":"2024-05-09T05:06:01.416016+0000","last_clean":"2024-05-09T05:06:01.416016+0000","last_became_active":"2024-05-09T05:05:59.398204+0000","last_became_peered":"2024-05-09T05:05:59.398204+0000","last_unstale":"2024-05-09T05:06:01.416016+0000","last_undegraded":"2024-05-09T05:06:01.416016+0000","last_fullsized":"2024-05-09T05:06:01.416016+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:36.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.923037+0000","last_change":"2024-05-09T05:06:00.409190+0000","last_active":"2024-05-09T05:06:01.923037+0000","last_peered":"2024-05-09T05:06:01.923037+0000","last_clean":"2024-05-09T05:06:01.923037+0000","last_became_active":"2024-05-09T05:06:00.408853+0000","last_became_peered":"2024-05-09T05:06:00.408853+0000","last_unstale":"2024-05-09T05:06:01.923037+0000","last_undegraded":"2024-05-09T05:06:01.923037+0000","last_fullsized":"2024-05-09T05:06:01.923037+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:31.887623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":20,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419475+0000","last_change":"2024-05-09T05:05:59.383439+0000","last_active":"2024-05-09T05:06:01.419475+0000","last_peered":"2024-05-09T05:06:01.419475+0000","last_clean":"2024-05-09T05:06:01.419475+0000","last_became_active":"2024-05-09T05:05:59.383036+0000","last_became_peered":"2024-05-09T05:05:59.383036+0000","last_unstale":"2024-05-09T05:06:01.419475+0000","last_undegraded":"2024-05-09T05:06:01.419475+0000","last_fullsized":"2024-05-09T05:06:01.419475+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:36.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920248+0000","last_change":"2024-05-09T05:06:00.403775+0000","last_active":"2024-05-09T05:06:01.920248+0000","last_peered":"2024-05-09T05:06:01.920248+0000","last_clean":"2024-05-09T05:06:01.920248+0000","last_became_active":"2024-05-09T05:06:00.403449+0000","last_became_peered":"2024-05-09T05:06:00.403449+0000","last_unstale":"2024-05-09T05:06:01.920248+0000","last_undegraded":"2024-05-09T05:06:01.920248+0000","last_fullsized":"2024-05-09T05:06:01.920248+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:47.090787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415249+0000","last_change":"2024-05-09T05:05:59.384485+0000","last_active":"2024-05-09T05:06:01.415249+0000","last_peered":"2024-05-09T05:06:01.415249+0000","last_clean":"2024-05-09T05:06:01.415249+0000","last_became_active":"2024-05-09T05:05:59.383801+0000","last_became_peered":"2024-05-09T05:05:59.383801+0000","last_unstale":"2024-05-09T05:06:01.415249+0000","last_undegraded":"2024-05-09T05:06:01.415249+0000","last_fullsized":"2024-05-09T05:06:01.415249+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:20:59.332493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416198+0000","last_change":"2024-05-09T05:06:00.422391+0000","last_active":"2024-05-09T05:06:01.416198+0000","last_peered":"2024-05-09T05:06:01.416198+0000","last_clean":"2024-05-09T05:06:01.416198+0000","last_became_active":"2024-05-09T05:06:00.422122+0000","last_became_peered":"2024-05-09T05:06:00.422122+0000","last_unstale":"2024-05-09T05:06:01.416198+0000","last_undegraded":"2024-05-09T05:06:01.416198+0000","last_fullsized":"2024-05-09T05:06:01.416198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:26:21.475740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922103+0000","last_change":"2024-05-09T05:05:59.391424+0000","last_active":"2024-05-09T05:06:01.922103+0000","last_peered":"2024-05-09T05:06:01.922103+0000","last_clean":"2024-05-09T05:06:01.922103+0000","last_became_active":"2024-05-09T05:05:59.391106+0000","last_became_peered":"2024-05-09T05:05:59.391106+0000","last_unstale":"2024-05-09T05:06:01.922103+0000","last_undegraded":"2024-05-09T05:06:01.922103+0000","last_fullsized":"2024-05-09T05:06:01.922103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:33:57.971085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.419347+0000","last_change":"2024-05-09T05:06:00.415021+0000","last_active":"2024-05-09T05:06:01.419347+0000","last_peered":"2024-05-09T05:06:01.419347+0000","last_clean":"2024-05-09T05:06:01.419347+0000","last_became_active":"2024-05-09T05:06:00.409141+0000","last_became_peered":"2024-05-09T05:06:00.409141+0000","last_unstale":"2024-05-09T05:06:01.419347+0000","last_undegraded":"2024-05-09T05:06:01.419347+0000","last_fullsized":"2024-05-09T05:06:01.419347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:57:29.041062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415354+0000","last_change":"2024-05-09T05:05:59.391286+0000","last_active":"2024-05-09T05:06:01.415354+0000","last_peered":"2024-05-09T05:06:01.415354+0000","last_clean":"2024-05-09T05:06:01.415354+0000","last_became_active":"2024-05-09T05:05:59.390621+0000","last_became_peered":"2024-05-09T05:05:59.390621+0000","last_unstale":"2024-05-09T05:06:01.415354+0000","last_undegraded":"2024-05-09T05:06:01.415354+0000","last_fullsized":"2024-05-09T05:06:01.415354+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:22.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416183+0000","last_change":"2024-05-09T05:06:00.426916+0000","last_active":"2024-05-09T05:06:01.416183+0000","last_peered":"2024-05-09T05:06:01.416183+0000","last_clean":"2024-05-09T05:06:01.416183+0000","last_became_active":"2024-05-09T05:06:00.425897+0000","last_became_peered":"2024-05-09T05:06:00.425897+0000","last_unstale":"2024-05-09T05:06:01.416183+0000","last_undegraded":"2024-05-09T05:06:01.416183+0000","last_fullsized":"2024-05-09T05:06:01.416183+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:53.382480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":22,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418784+0000","last_change":"2024-05-09T05:05:59.376319+0000","last_active":"2024-05-09T05:06:01.418784+0000","last_peered":"2024-05-09T05:06:01.418784+0000","last_clean":"2024-05-09T05:06:01.418784+0000","last_became_active":"2024-05-09T05:05:59.376018+0000","last_became_peered":"2024-05-09T05:05:59.376018+0000","last_unstale":"2024-05-09T05:06:01.418784+0000","last_undegraded":"2024-05-09T05:06:01.418784+0000","last_fullsized":"2024-05-09T05:06:01.418784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:22.888502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418819+0000","last_change":"2024-05-09T05:06:00.411205+0000","last_active":"2024-05-09T05:06:01.418819+0000","last_peered":"2024-05-09T05:06:01.418819+0000","last_clean":"2024-05-09T05:06:01.418819+0000","last_became_active":"2024-05-09T05:06:00.409128+0000","last_became_peered":"2024-05-09T05:06:00.409128+0000","last_unstale":"2024-05-09T05:06:01.418819+0000","last_undegraded":"2024-05-09T05:06:01.418819+0000","last_fullsized":"2024-05-09T05:06:01.418819+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:30:17.901153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416508+0000","last_change":"2024-05-09T05:05:59.376639+0000","last_active":"2024-05-09T05:06:01.416508+0000","last_peered":"2024-05-09T05:06:01.416508+0000","last_clean":"2024-05-09T05:06:01.416508+0000","last_became_active":"2024-05-09T05:05:59.376304+0000","last_became_peered":"2024-05-09T05:05:59.376304+0000","last_unstale":"2024-05-09T05:06:01.416508+0000","last_undegraded":"2024-05-09T05:06:01.416508+0000","last_fullsized":"2024-05-09T05:06:01.416508+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:21:19.148596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919187+0000","last_change":"2024-05-09T05:06:00.408396+0000","last_active":"2024-05-09T05:06:01.919187+0000","last_peered":"2024-05-09T05:06:01.919187+0000","last_clean":"2024-05-09T05:06:01.919187+0000","last_became_active":"2024-05-09T05:06:00.408158+0000","last_became_peered":"2024-05-09T05:06:00.408158+0000","last_unstale":"2024-05-09T05:06:01.919187+0000","last_undegraded":"2024-05-09T05:06:01.919187+0000","last_fullsized":"2024-05-09T05:06:01.919187+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:43:31.887623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922003+0000","last_change":"2024-05-09T05:05:59.386002+0000","last_active":"2024-05-09T05:06:01.922003+0000","last_peered":"2024-05-09T05:06:01.922003+0000","last_clean":"2024-05-09T05:06:01.922003+0000","last_became_active":"2024-05-09T05:05:59.385694+0000","last_became_peered":"2024-05-09T05:05:59.385694+0000","last_unstale":"2024-05-09T05:06:01.922003+0000","last_undegraded":"2024-05-09T05:06:01.922003+0000","last_fullsized":"2024-05-09T05:06:01.922003+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:35:41.205763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922508+0000","last_change":"2024-05-09T05:06:00.432714+0000","last_active":"2024-05-09T05:06:01.922508+0000","last_peered":"2024-05-09T05:06:01.922508+0000","last_clean":"2024-05-09T05:06:01.922508+0000","last_became_active":"2024-05-09T05:06:00.432368+0000","last_became_peered":"2024-05-09T05:06:00.432368+0000","last_unstale":"2024-05-09T05:06:01.922508+0000","last_undegraded":"2024-05-09T05:06:01.922508+0000","last_fullsized":"2024-05-09T05:06:01.922508+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:23:20.942801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921424+0000","last_change":"2024-05-09T05:05:59.396051+0000","last_active":"2024-05-09T05:06:01.921424+0000","last_peered":"2024-05-09T05:06:01.921424+0000","last_clean":"2024-05-09T05:06:01.921424+0000","last_became_active":"2024-05-09T05:05:59.395717+0000","last_became_peered":"2024-05-09T05:05:59.395717+0000","last_unstale":"2024-05-09T05:06:01.921424+0000","last_undegraded":"2024-05-09T05:06:01.921424+0000","last_fullsized":"2024-05-09T05:06:01.921424+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:56:07.076842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919416+0000","last_change":"2024-05-09T05:06:00.414943+0000","last_active":"2024-05-09T05:06:01.919416+0000","last_peered":"2024-05-09T05:06:01.919416+0000","last_clean":"2024-05-09T05:06:01.919416+0000","last_became_active":"2024-05-09T05:06:00.414619+0000","last_became_peered":"2024-05-09T05:06:00.414619+0000","last_unstale":"2024-05-09T05:06:01.919416+0000","last_undegraded":"2024-05-09T05:06:01.919416+0000","last_fullsized":"2024-05-09T05:06:01.919416+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:22:46.523012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921936+0000","last_change":"2024-05-09T05:05:59.389001+0000","last_active":"2024-05-09T05:06:01.921936+0000","last_peered":"2024-05-09T05:06:01.921936+0000","last_clean":"2024-05-09T05:06:01.921936+0000","last_became_active":"2024-05-09T05:05:59.387839+0000","last_became_peered":"2024-05-09T05:05:59.387839+0000","last_unstale":"2024-05-09T05:06:01.921936+0000","last_undegraded":"2024-05-09T05:06:01.921936+0000","last_fullsized":"2024-05-09T05:06:01.921936+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:53:59.252899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920684+0000","last_change":"2024-05-09T05:06:00.411656+0000","last_active":"2024-05-09T05:06:01.920684+0000","last_peered":"2024-05-09T05:06:01.920684+0000","last_clean":"2024-05-09T05:06:01.920684+0000","last_became_active":"2024-05-09T05:06:00.411278+0000","last_became_peered":"2024-05-09T05:06:00.411278+0000","last_unstale":"2024-05-09T05:06:01.920684+0000","last_undegraded":"2024-05-09T05:06:01.920684+0000","last_fullsized":"2024-05-09T05:06:01.920684+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:57:37.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919718+0000","last_change":"2024-05-09T05:05:59.391807+0000","last_active":"2024-05-09T05:06:01.919718+0000","last_peered":"2024-05-09T05:06:01.919718+0000","last_clean":"2024-05-09T05:06:01.919718+0000","last_became_active":"2024-05-09T05:05:59.391468+0000","last_became_peered":"2024-05-09T05:05:59.391468+0000","last_unstale":"2024-05-09T05:06:01.919718+0000","last_undegraded":"2024-05-09T05:06:01.919718+0000","last_fullsized":"2024-05-09T05:06:01.919718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:47.256663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921141+0000","last_change":"2024-05-09T05:06:00.408127+0000","last_active":"2024-05-09T05:06:01.921141+0000","last_peered":"2024-05-09T05:06:01.921141+0000","last_clean":"2024-05-09T05:06:01.921141+0000","last_became_active":"2024-05-09T05:06:00.407825+0000","last_became_peered":"2024-05-09T05:06:00.407825+0000","last_unstale":"2024-05-09T05:06:01.921141+0000","last_undegraded":"2024-05-09T05:06:01.921141+0000","last_fullsized":"2024-05-09T05:06:01.921141+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:03.178320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418264+0000","last_change":"2024-05-09T05:05:59.378685+0000","last_active":"2024-05-09T05:06:01.418264+0000","last_peered":"2024-05-09T05:06:01.418264+0000","last_clean":"2024-05-09T05:06:01.418264+0000","last_became_active":"2024-05-09T05:05:59.378371+0000","last_became_peered":"2024-05-09T05:05:59.378371+0000","last_unstale":"2024-05-09T05:06:01.418264+0000","last_undegraded":"2024-05-09T05:06:01.418264+0000","last_fullsized":"2024-05-09T05:06:01.418264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:22.175515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415880+0000","last_change":"2024-05-09T05:06:00.421985+0000","last_active":"2024-05-09T05:06:01.415880+0000","last_peered":"2024-05-09T05:06:01.415880+0000","last_clean":"2024-05-09T05:06:01.415880+0000","last_became_active":"2024-05-09T05:06:00.421656+0000","last_became_peered":"2024-05-09T05:06:00.421656+0000","last_unstale":"2024-05-09T05:06:01.415880+0000","last_undegraded":"2024-05-09T05:06:01.415880+0000","last_fullsized":"2024-05-09T05:06:01.415880+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:46.380711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.414001+0000","last_change":"2024-05-09T05:05:59.385513+0000","last_active":"2024-05-09T05:06:01.414001+0000","last_peered":"2024-05-09T05:06:01.414001+0000","last_clean":"2024-05-09T05:06:01.414001+0000","last_became_active":"2024-05-09T05:05:59.384110+0000","last_became_peered":"2024-05-09T05:05:59.384110+0000","last_unstale":"2024-05-09T05:06:01.414001+0000","last_undegraded":"2024-05-09T05:06:01.414001+0000","last_fullsized":"2024-05-09T05:06:01.414001+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:02.163027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919938+0000","last_change":"2024-05-09T05:06:00.418155+0000","last_active":"2024-05-09T05:06:01.919938+0000","last_peered":"2024-05-09T05:06:01.919938+0000","last_clean":"2024-05-09T05:06:01.919938+0000","last_became_active":"2024-05-09T05:06:00.417867+0000","last_became_peered":"2024-05-09T05:06:00.417867+0000","last_unstale":"2024-05-09T05:06:01.919938+0000","last_undegraded":"2024-05-09T05:06:01.919938+0000","last_fullsized":"2024-05-09T05:06:01.919938+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:23.190809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920812+0000","last_change":"2024-05-09T05:05:59.384533+0000","last_active":"2024-05-09T05:06:01.920812+0000","last_peered":"2024-05-09T05:06:01.920812+0000","last_clean":"2024-05-09T05:06:01.920812+0000","last_became_active":"2024-05-09T05:05:59.384250+0000","last_became_peered":"2024-05-09T05:05:59.384250+0000","last_unstale":"2024-05-09T05:06:01.920812+0000","last_undegraded":"2024-05-09T05:06:01.920812+0000","last_fullsized":"2024-05-09T05:06:01.920812+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:11:39.020821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919808+0000","last_change":"2024-05-09T05:06:00.403156+0000","last_active":"2024-05-09T05:06:01.919808+0000","last_peered":"2024-05-09T05:06:01.919808+0000","last_clean":"2024-05-09T05:06:01.919808+0000","last_became_active":"2024-05-09T05:06:00.399948+0000","last_became_peered":"2024-05-09T05:06:00.399948+0000","last_unstale":"2024-05-09T05:06:01.919808+0000","last_undegraded":"2024-05-09T05:06:01.919808+0000","last_fullsized":"2024-05-09T05:06:01.919808+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:50:46.166003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921367+0000","last_change":"2024-05-09T05:05:59.384549+0000","last_active":"2024-05-09T05:06:01.921367+0000","last_peered":"2024-05-09T05:06:01.921367+0000","last_clean":"2024-05-09T05:06:01.921367+0000","last_became_active":"2024-05-09T05:05:59.382852+0000","last_became_peered":"2024-05-09T05:05:59.382852+0000","last_unstale":"2024-05-09T05:06:01.921367+0000","last_undegraded":"2024-05-09T05:06:01.921367+0000","last_fullsized":"2024-05-09T05:06:01.921367+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:39.550521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.919936+0000","last_change":"2024-05-09T05:06:00.404121+0000","last_active":"2024-05-09T05:06:01.919936+0000","last_peered":"2024-05-09T05:06:01.919936+0000","last_clean":"2024-05-09T05:06:01.919936+0000","last_became_active":"2024-05-09T05:06:00.403302+0000","last_became_peered":"2024-05-09T05:06:00.403302+0000","last_unstale":"2024-05-09T05:06:01.919936+0000","last_undegraded":"2024-05-09T05:06:01.919936+0000","last_fullsized":"2024-05-09T05:06:01.919936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:23.903795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.416086+0000","last_change":"2024-05-09T05:05:59.393971+0000","last_active":"2024-05-09T05:06:01.416086+0000","last_peered":"2024-05-09T05:06:01.416086+0000","last_clean":"2024-05-09T05:06:01.416086+0000","last_became_active":"2024-05-09T05:05:59.393645+0000","last_became_peered":"2024-05-09T05:05:59.393645+0000","last_unstale":"2024-05-09T05:06:01.416086+0000","last_undegraded":"2024-05-09T05:06:01.416086+0000","last_fullsized":"2024-05-09T05:06:01.416086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:45.546282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418786+0000","last_change":"2024-05-09T05:06:00.414546+0000","last_active":"2024-05-09T05:06:01.418786+0000","last_peered":"2024-05-09T05:06:01.418786+0000","last_clean":"2024-05-09T05:06:01.418786+0000","last_became_active":"2024-05-09T05:06:00.414246+0000","last_became_peered":"2024-05-09T05:06:00.414246+0000","last_unstale":"2024-05-09T05:06:01.418786+0000","last_undegraded":"2024-05-09T05:06:01.418786+0000","last_fullsized":"2024-05-09T05:06:01.418786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:46:27.888610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415365+0000","last_change":"2024-05-09T05:05:59.380274+0000","last_active":"2024-05-09T05:06:01.415365+0000","last_peered":"2024-05-09T05:06:01.415365+0000","last_clean":"2024-05-09T05:06:01.415365+0000","last_became_active":"2024-05-09T05:05:59.379926+0000","last_became_peered":"2024-05-09T05:05:59.379926+0000","last_unstale":"2024-05-09T05:06:01.415365+0000","last_undegraded":"2024-05-09T05:06:01.415365+0000","last_fullsized":"2024-05-09T05:06:01.415365+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:58:12.190553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415398+0000","last_change":"2024-05-09T05:06:00.424026+0000","last_active":"2024-05-09T05:06:01.415398+0000","last_peered":"2024-05-09T05:06:01.415398+0000","last_clean":"2024-05-09T05:06:01.415398+0000","last_became_active":"2024-05-09T05:06:00.423698+0000","last_became_peered":"2024-05-09T05:06:00.423698+0000","last_unstale":"2024-05-09T05:06:01.415398+0000","last_undegraded":"2024-05-09T05:06:01.415398+0000","last_fullsized":"2024-05-09T05:06:01.415398+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:38:32.518272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418716+0000","last_change":"2024-05-09T05:05:59.382742+0000","last_active":"2024-05-09T05:06:01.418716+0000","last_peered":"2024-05-09T05:06:01.418716+0000","last_clean":"2024-05-09T05:06:01.418716+0000","last_became_active":"2024-05-09T05:05:59.382431+0000","last_became_peered":"2024-05-09T05:05:59.382431+0000","last_unstale":"2024-05-09T05:06:01.418716+0000","last_undegraded":"2024-05-09T05:06:01.418716+0000","last_fullsized":"2024-05-09T05:06:01.418716+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:45.546282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.921362+0000","last_change":"2024-05-09T05:06:00.404296+0000","last_active":"2024-05-09T05:06:01.921362+0000","last_peered":"2024-05-09T05:06:01.921362+0000","last_clean":"2024-05-09T05:06:01.921362+0000","last_became_active":"2024-05-09T05:06:00.404005+0000","last_became_peered":"2024-05-09T05:06:00.404005+0000","last_unstale":"2024-05-09T05:06:01.921362+0000","last_undegraded":"2024-05-09T05:06:01.921362+0000","last_fullsized":"2024-05-09T05:06:01.921362+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:46:46.561576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.418499+0000","last_change":"2024-05-09T05:05:59.386148+0000","last_active":"2024-05-09T05:06:01.418499+0000","last_peered":"2024-05-09T05:06:01.418499+0000","last_clean":"2024-05-09T05:06:01.418499+0000","last_became_active":"2024-05-09T05:05:59.385911+0000","last_became_peered":"2024-05-09T05:05:59.385911+0000","last_unstale":"2024-05-09T05:06:01.418499+0000","last_undegraded":"2024-05-09T05:06:01.418499+0000","last_fullsized":"2024-05-09T05:06:01.418499+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:38:46.075494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415521+0000","last_change":"2024-05-09T05:06:00.428771+0000","last_active":"2024-05-09T05:06:01.415521+0000","last_peered":"2024-05-09T05:06:01.415521+0000","last_clean":"2024-05-09T05:06:01.415521+0000","last_became_active":"2024-05-09T05:06:00.428128+0000","last_became_peered":"2024-05-09T05:06:00.428128+0000","last_unstale":"2024-05-09T05:06:01.415521+0000","last_undegraded":"2024-05-09T05:06:01.415521+0000","last_fullsized":"2024-05-09T05:06:01.415521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:30:28.193154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.922469+0000","last_change":"2024-05-09T05:05:59.382487+0000","last_active":"2024-05-09T05:06:01.922469+0000","last_peered":"2024-05-09T05:06:01.922469+0000","last_clean":"2024-05-09T05:06:01.922469+0000","last_became_active":"2024-05-09T05:05:59.382194+0000","last_became_peered":"2024-05-09T05:05:59.382194+0000","last_unstale":"2024-05-09T05:06:01.922469+0000","last_undegraded":"2024-05-09T05:06:01.922469+0000","last_fullsized":"2024-05-09T05:06:01.922469+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:02.163027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.420329+0000","last_change":"2024-05-09T05:06:00.430565+0000","last_active":"2024-05-09T05:06:01.420329+0000","last_peered":"2024-05-09T05:06:01.420329+0000","last_clean":"2024-05-09T05:06:01.420329+0000","last_became_active":"2024-05-09T05:06:00.430305+0000","last_became_peered":"2024-05-09T05:06:00.430305+0000","last_unstale":"2024-05-09T05:06:01.420329+0000","last_undegraded":"2024-05-09T05:06:01.420329+0000","last_fullsized":"2024-05-09T05:06:01.420329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:07:05.365371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920442+0000","last_change":"2024-05-09T05:05:59.393040+0000","last_active":"2024-05-09T05:06:01.920442+0000","last_peered":"2024-05-09T05:06:01.920442+0000","last_clean":"2024-05-09T05:06:01.920442+0000","last_became_active":"2024-05-09T05:05:59.392735+0000","last_became_peered":"2024-05-09T05:05:59.392735+0000","last_unstale":"2024-05-09T05:06:01.920442+0000","last_undegraded":"2024-05-09T05:06:01.920442+0000","last_fullsized":"2024-05-09T05:06:01.920442+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:36:03.992359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.920721+0000","last_change":"2024-05-09T05:06:00.414815+0000","last_active":"2024-05-09T05:06:01.920721+0000","last_peered":"2024-05-09T05:06:01.920721+0000","last_clean":"2024-05-09T05:06:01.920721+0000","last_became_active":"2024-05-09T05:06:00.414544+0000","last_became_peered":"2024-05-09T05:06:00.414544+0000","last_unstale":"2024-05-09T05:06:01.920721+0000","last_undegraded":"2024-05-09T05:06:01.920721+0000","last_fullsized":"2024-05-09T05:06:01.920721+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:59.343388+0000","last_clean_scrub_stamp":"2024-05-09T05:05:59.343388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:48.271957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415625+0000","last_change":"2024-05-09T05:05:59.383278+0000","last_active":"2024-05-09T05:06:01.415625+0000","last_peered":"2024-05-09T05:06:01.415625+0000","last_clean":"2024-05-09T05:06:01.415625+0000","last_became_active":"2024-05-09T05:05:59.382979+0000","last_became_peered":"2024-05-09T05:05:59.382979+0000","last_unstale":"2024-05-09T05:06:01.415625+0000","last_undegraded":"2024-05-09T05:06:01.415625+0000","last_fullsized":"2024-05-09T05:06:01.415625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:05:58.328094+0000","last_clean_scrub_stamp":"2024-05-09T05:05:58.328094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:10:58.735690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":161,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-05-09T05:06:01.415216+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:06:01.415216+0000","last_peered":"2024-05-09T05:06:01.415216+0000","last_clean":"2024-05-09T05:06:01.415216+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:01.415216+0000","last_undegraded":"2024-05-09T05:06:01.415216+0000","last_fullsized":"2024-05-09T05:06:01.415216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28152,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343688,"statfs":{"total":96636764160,"available":96607936512,"internally_reserved":0,"allocated":1159168,"data_stored":820332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":224192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":223540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":224122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":561152,"data_stored":225174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":557056,"data_stored":225152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":552960,"data_stored":223700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1159168,"data_stored":820264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:05.324 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:06:05.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-09T05:06:05.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.572+0000 7f57a0a00640 1 Processor -- start 2024-05-09T05:06:05.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.573+0000 7f57a0a00640 1 -- start start 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.574+0000 7f57a0a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 0x7f579c073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.574+0000 7f57a0a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f579c14cf90 0x7f579c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.574+0000 7f57a0a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c14c7a0 con 0x7f579c0b3060 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.574+0000 7f57a0a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f579c0b34d0 con 0x7f579c14cf90 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.574+0000 7f57a0a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f579c073db0 con 0x7f579c14c3c0 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f579c0b3060 0x7f579c072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43794/0 (socket says 172.21.15.100:43794) 2024-05-09T05:06:05.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579be00640 1 -- 172.21.15.100:0/2567241667 learned_addr learned my addr 172.21.15.100:0/2567241667 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:05.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579b400640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 0x7f579c073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579aa00640 1 --2- 172.21.15.100:0/2567241667 >> v2:172.21.15.133:3300/0 conn(0x7f579c14cf90 0x7f579c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859373835 0 0) 0x7f579c14c7a0 con 0x7f579c0b3060 2024-05-09T05:06:05.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5780003520 con 0x7f579c0b3060 2024-05-09T05:06:05.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3741507373 0 0) 0x7f5780003520 con 0x7f579c0b3060 2024-05-09T05:06:05.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 msgr2=0x7f579c073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 0x7f579c073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 >> v2:172.21.15.133:3300/0 conn(0x7f579c14cf90 msgr2=0x7f579c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 --2- 172.21.15.100:0/2567241667 >> v2:172.21.15.133:3300/0 conn(0x7f579c14cf90 0x7f579c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c0b40e0 con 0x7f579c0b3060 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f57940016f0 con 0x7f579c0b3060 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.575+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 >> v1:172.21.15.100:6789/0 conn(0x7f579c0b3060 legacy=0x7f579c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579a000640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5780003a50 0x7f5780003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579a000640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5780004800 0x7f5780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579a000640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 0x7f57800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0b34d0 con 0x7f5780004800 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f578000b9c0 con 0x7f5780003a50 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f578000bb90 con 0x7f579c14c3c0 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579aa00640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5780004800 0x7f5780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579be00640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 0x7f57800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579b400640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5780003a50 0x7f5780003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579aa00640 1 -- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 msgr2=0x7f57800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579aa00640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f579c14c3c0 0x7f57800051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579aa00640 1 -- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5780003a50 msgr2=0x7f5780003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579aa00640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5780003a50 0x7f5780003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579aa00640 1 -- 172.21.15.100:0/2567241667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5780003520 con 0x7f5780004800 2024-05-09T05:06:05.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.576+0000 7f579b400640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5780003a50 0x7f5780003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.577+0000 7f579aa00640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5780004800 0x7f5780004c80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f578c009fc0 tx=0x7f5780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a362acd6b913d18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.577+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c009c10 con 0x7f5780004800 2024-05-09T05:06:05.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.577+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578c036070 con 0x7f5780004800 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.577+0000 7f579a000640 1 -- 172.21.15.100:0/2567241667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c02d070 con 0x7f5780004800 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f57a0a00640 1 -- 172.21.15.100:0/2567241667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5780004800 msgr2=0x7f5780004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f57a0a00640 1 --2- 172.21.15.100:0/2567241667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5780004800 0x7f5780004c80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f578c009fc0 tx=0x7f5780005830 comp rx=0 tx=0).stop 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f579be00640 1 -- 172.21.15.100:0/2567241667 reap_dead start 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f57a0a00640 1 -- 172.21.15.100:0/2567241667 shutdown_connections 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f57a0a00640 1 -- 172.21.15.100:0/2567241667 >> 172.21.15.100:0/2567241667 conn(0x7f579c06f8a0 msgr2=0x7f579c06fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f57a0a00640 1 -- 172.21.15.100:0/2567241667 shutdown_connections 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.578+0000 7f57a0a00640 1 -- 172.21.15.100:0/2567241667 wait complete. 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.580+0000 7f57a0a00640 1 Processor -- start 2024-05-09T05:06:05.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.580+0000 7f57a0a00640 1 -- start start 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f57a0a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5780004800 0x7f579c144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f57a0a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c145350 0x7f579c1fac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f57a0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 0x7f579c1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f57a0a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0b46a0 con 0x7f579c1fb1c0 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f57a0a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f579c0b3e90 con 0x7f579c145350 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f57a0a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f579c0b4980 con 0x7f5780004800 2024-05-09T05:06:05.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f579be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 0x7f579c1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f579be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 0x7f579c1461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52788/0 (socket says 172.21.15.100:52788) 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.581+0000 7f579be00640 1 -- 172.21.15.100:0/3557976572 learned_addr learned my addr 172.21.15.100:0/3557976572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579b400640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5780004800 0x7f579c144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579be00640 1 -- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5780004800 msgr2=0x7f579c144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579aa00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c145350 0x7f579c1fac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579be00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5780004800 0x7f579c144e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579be00640 1 -- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c145350 msgr2=0x7f579c1fac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579be00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c145350 0x7f579c1fac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579be00640 1 -- 172.21.15.100:0/3557976572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c143d70 con 0x7f579c1fb1c0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f579be00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 0x7f579c1461f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f579c06f110 tx=0x7f579400d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794007440 con 0x7f579c1fb1c0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57940075e0 con 0x7f579c1fb1c0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794004a20 con 0x7f579c1fb1c0 2024-05-09T05:06:05.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c144050 con 0x7f579c1fb1c0 2024-05-09T05:06:05.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.582+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c144610 con 0x7f579c1fb1c0 2024-05-09T05:06:05.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.583+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f579c0ced90 con 0x7f579c1fb1c0 2024-05-09T05:06:05.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.585+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f579401b020 con 0x7f579c1fb1c0 2024-05-09T05:06:05.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.585+0000 7f5793400640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f577c076300 0x7f577c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:05.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.586+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5794096fe0 con 0x7f579c1fb1c0 2024-05-09T05:06:05.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.586+0000 7f579b400640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f577c076300 0x7f577c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:05.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.586+0000 7f579b400640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f577c076300 0x7f577c0787c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f579c0d0180 tx=0x7f5788008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:05.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.590+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f579c0ced90 con 0x7f579c1fb1c0 2024-05-09T05:06:05.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.871+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f579c069760 con 0x7f579c1fb1c0 2024-05-09T05:06:05.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.876+0000 7f5793400640 1 -- 172.21.15.100:0/3557976572 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f579c069760 con 0x7f579c1fb1c0 2024-05-09T05:06:05.877 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-05-09T05:06:05.877 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQATWTxm/8wxGBAA16AyM9b+UYE5joYlLTmgZA== 2024-05-09T05:06:05.877 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-05-09T05:06:05.877 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-05-09T05:06:05.877 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-09T05:06:05.877 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-05-09T05:06:05.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.878+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f577c076300 msgr2=0x7f577c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.878+0000 7f57a0a00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f577c076300 0x7f577c0787c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f579c0d0180 tx=0x7f5788008040 comp rx=0 tx=0).stop 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 msgr2=0x7f579c1461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 0x7f579c1461f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f579c06f110 tx=0x7f579400d950 comp rx=0 tx=0).stop 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 shutdown_connections 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f577c076300 0x7f577c0787c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f579c1fb1c0 0x7f579c1461f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c145350 0x7f579c1fac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 --2- 172.21.15.100:0/3557976572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5780004800 0x7f579c144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 >> 172.21.15.100:0/3557976572 conn(0x7f579c06f8a0 msgr2=0x7f579c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 shutdown_connections 2024-05-09T05:06:05.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:05.879+0000 7f57a0a00640 1 -- 172.21.15.100:0/3557976572 wait complete. 2024-05-09T05:06:05.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.097+0000 7fd4dda00640 1 Processor -- start 2024-05-09T05:06:06.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.098+0000 7fd4dda00640 1 -- start start 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.099+0000 7fd4dda00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd4d809c120 0x7fd4d80d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.099+0000 7fd4dda00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d80b29c0 con 0x7fd4d815f810 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.099+0000 7fd4dda00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4d80720f0 con 0x7fd4d80b21e0 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.099+0000 7fd4dda00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd4d8072670 con 0x7fd4d809c120 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4d6a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd4d815f810 0x7fd4d809ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43810/0 (socket says 172.21.15.100:43810) 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4d6a00640 1 -- 172.21.15.100:0/3070458951 learned_addr learned my addr 172.21.15.100:0/3070458951 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4ce000640 1 --2- 172.21.15.100:0/3070458951 >> v2:172.21.15.100:3300/0 conn(0x7fd4d809c120 0x7fd4d80d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4d6000640 1 -- 172.21.15.100:0/3070458951 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945032978 0 0) 0x7fd4d80b29c0 con 0x7fd4d815f810 2024-05-09T05:06:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4ce000640 1 -- 172.21.15.100:0/3070458951 >> v1:172.21.15.133:6789/0 conn(0x7fd4d80b21e0 legacy=0x7fd4d80707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4ce000640 1 -- 172.21.15.100:0/3070458951 >> v1:172.21.15.100:6789/0 conn(0x7fd4d815f810 legacy=0x7fd4d809ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.100+0000 7fd4ce000640 1 -- 172.21.15.100:0/3070458951 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d8072390 con 0x7fd4d809c120 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.101+0000 7fd4ce000640 1 --2- 172.21.15.100:0/3070458951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d80d3c40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00097a0 tx=0x7fd4c002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665aab33fbd2ca44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.101+0000 7fd4d6000640 1 -- 172.21.15.100:0/3070458951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0037070 con 0x7fd4d809c120 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.101+0000 7fd4d6000640 1 -- 172.21.15.100:0/3070458951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c002ae50 con 0x7fd4d809c120 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.101+0000 7fd4d6000640 1 -- 172.21.15.100:0/3070458951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0032660 con 0x7fd4d809c120 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 -- 172.21.15.100:0/3070458951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 msgr2=0x7fd4d80d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3070458951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d80d3c40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00097a0 tx=0x7fd4c002a100 comp rx=0 tx=0).stop 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 -- 172.21.15.100:0/3070458951 shutdown_connections 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3070458951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d80d3c40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 -- 172.21.15.100:0/3070458951 >> 172.21.15.100:0/3070458951 conn(0x7fd4d80d3120 msgr2=0x7fd4d80d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 -- 172.21.15.100:0/3070458951 shutdown_connections 2024-05-09T05:06:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.102+0000 7fd4dda00640 1 -- 172.21.15.100:0/3070458951 wait complete. 2024-05-09T05:06:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.104+0000 7fd4dda00640 1 Processor -- start 2024-05-09T05:06:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.104+0000 7fd4dda00640 1 -- start start 2024-05-09T05:06:06.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4dda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4dda00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4d80b21e0 0x7fd4d80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4dda00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4d815f810 0x7fd4d80b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4dda00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d815fbf0 con 0x7fd4d809c120 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4dda00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d806e9a0 con 0x7fd4d80b21e0 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4dda00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d806eec0 con 0x7fd4d815f810 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4d6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4d6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d814e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52796/0 (socket says 172.21.15.100:52796) 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.105+0000 7fd4d6a00640 1 -- 172.21.15.100:0/3581447568 learned_addr learned my addr 172.21.15.100:0/3581447568 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4d6a00640 1 -- 172.21.15.100:0/3581447568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4d815f810 msgr2=0x7fd4d80b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4d6a00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4d815f810 0x7fd4d80b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4d6a00640 1 -- 172.21.15.100:0/3581447568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4d80b21e0 msgr2=0x7fd4d80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4d6a00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4d80b21e0 0x7fd4d80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4d6a00640 1 -- 172.21.15.100:0/3581447568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d80b0c60 con 0x7fd4d809c120 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4d6a00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d814e700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c400 tx=0x7fd4c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8017070 con 0x7fd4d809c120 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c8005ce0 con 0x7fd4d809c120 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8007310 con 0x7fd4d809c120 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d80b0f40 con 0x7fd4d809c120 2024-05-09T05:06:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.106+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d80b1500 con 0x7fd4d809c120 2024-05-09T05:06:06.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.108+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d806a5c0 con 0x7fd4d809c120 2024-05-09T05:06:06.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.109+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd4c801a070 con 0x7fd4d809c120 2024-05-09T05:06:06.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.110+0000 7fd4cf400640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4b40762d0 0x7fd4b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:06.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.110+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fd4c8096a00 con 0x7fd4d809c120 2024-05-09T05:06:06.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.110+0000 7fd4ce000640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4b40762d0 0x7fd4b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:06.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.111+0000 7fd4ce000640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4b40762d0 0x7fd4b4078790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0034000 tx=0x7fd4c002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.114+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd4c8060310 con 0x7fd4d809c120 2024-05-09T05:06:06.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.358+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4d80c69e0 con 0x7fd4d809c120 2024-05-09T05:06:06.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.359+0000 7fd4cf400640 1 -- 172.21.15.100:0/3581447568 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5193 (secure 0 0 0) 0x7fd4c805fc10 con 0x7fd4d809c120 2024-05-09T05:06:06.360 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:06.360 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:02.911152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:06.360 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 28 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4b40762d0 msgr2=0x7fd4b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4b40762d0 0x7fd4b4078790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0034000 tx=0x7fd4c002c000 comp rx=0 tx=0).stop 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 msgr2=0x7fd4d814e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d814e700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c400 tx=0x7fd4c800c8c0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 shutdown_connections 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd4b40762d0 0x7fd4b4078790 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4d815f810 0x7fd4d80b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4d80b21e0 0x7fd4d80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 --2- 172.21.15.100:0/3581447568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4d809c120 0x7fd4d814e700 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 >> 172.21.15.100:0/3581447568 conn(0x7fd4d80d3120 msgr2=0x7fd4d80d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 shutdown_connections 2024-05-09T05:06:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:06.362+0000 7fd4dda00640 1 -- 172.21.15.100:0/3581447568 wait complete. 2024-05-09T05:06:06.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-09T05:05:59.823443+0000', 'modified': '2024-05-09T05:06:02.911152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5286}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5286': {'gid': 5286, 'name': 'b', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/3578202714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6833', 'nonce': 3578202714}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 3578202714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5286, 'qdb_cluster': [5286]} 2024-05-09T05:06:06.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-09T05:06:06.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T05:06:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.002+0000 7fafc4a00640 1 Processor -- start 2024-05-09T05:06:07.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.002+0000 7fafc4a00640 1 -- start start 2024-05-09T05:06:07.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafc4a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafc0073c90 0x7fafc00b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafc4a00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fafc00b6050 0x7fafc006ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafc4a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00d07b0 0x7fafc006f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafc4a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fafc00b4650 con 0x7fafc0073c90 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafc4a00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fafc00cd320 con 0x7fafc00b6050 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafc4a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fafc00cd600 con 0x7fafc00d07b0 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafbde00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafc0073c90 0x7fafc00b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafbde00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafc0073c90 0x7fafc00b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52800/0 (socket says 172.21.15.100:52800) 2024-05-09T05:06:07.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.004+0000 7fafbde00640 1 -- 172.21.15.100:0/2137851110 learned_addr learned my addr 172.21.15.100:0/2137851110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.005+0000 7fafbde00640 1 -- 172.21.15.100:0/2137851110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00d07b0 msgr2=0x7fafc006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.005+0000 7fafbde00640 1 --2- 172.21.15.100:0/2137851110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00d07b0 0x7fafc006f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.005+0000 7fafbde00640 1 -- 172.21.15.100:0/2137851110 >> v2:172.21.15.133:3300/0 conn(0x7fafc00b6050 msgr2=0x7fafc006ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.005+0000 7fafbde00640 1 --2- 172.21.15.100:0/2137851110 >> v2:172.21.15.133:3300/0 conn(0x7fafc00b6050 0x7fafc006ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.005+0000 7fafbde00640 1 -- 172.21.15.100:0/2137851110 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc00745b0 con 0x7fafc0073c90 2024-05-09T05:06:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.006+0000 7fafbde00640 1 --2- 172.21.15.100:0/2137851110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc0073c90 0x7fafc00b5b10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fafc0070900 tx=0x7fafb002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245f8ea0699bc2db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.006+0000 7fafbca00640 1 -- 172.21.15.100:0/2137851110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0037070 con 0x7fafc0073c90 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.006+0000 7fafbca00640 1 -- 172.21.15.100:0/2137851110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb002ae00 con 0x7fafc0073c90 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.006+0000 7fafbca00640 1 -- 172.21.15.100:0/2137851110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0032660 con 0x7fafc0073c90 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.006+0000 7fafc4a00640 1 -- 172.21.15.100:0/2137851110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc0073c90 msgr2=0x7fafc00b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2137851110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc0073c90 0x7fafc00b5b10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fafc0070900 tx=0x7fafb002a0b0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 -- 172.21.15.100:0/2137851110 shutdown_connections 2024-05-09T05:06:07.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2137851110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00d07b0 0x7fafc006f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2137851110 >> v2:172.21.15.133:3300/0 conn(0x7fafc00b6050 0x7fafc006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2137851110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc0073c90 0x7fafc00b5b10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 -- 172.21.15.100:0/2137851110 >> 172.21.15.100:0/2137851110 conn(0x7fafc00b2c90 msgr2=0x7fafc00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 -- 172.21.15.100:0/2137851110 shutdown_connections 2024-05-09T05:06:07.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.007+0000 7fafc4a00640 1 -- 172.21.15.100:0/2137851110 wait complete. 2024-05-09T05:06:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.008+0000 7fafc4a00640 1 Processor -- start 2024-05-09T05:06:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.009+0000 7fafc4a00640 1 -- start start 2024-05-09T05:06:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.009+0000 7fafc4a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafc0073c90 0x7fafc014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.009+0000 7fafc4a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00b6050 0x7fafc015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.009+0000 7fafc4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 0x7fafc00c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafc4a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00cda60 con 0x7fafc00d07b0 2024-05-09T05:06:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafc4a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00cd8e0 con 0x7fafc0073c90 2024-05-09T05:06:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafc4a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fafc00cdbe0 con 0x7fafc00b6050 2024-05-09T05:06:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 0x7fafc00c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 0x7fafc00c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52804/0 (socket says 172.21.15.100:52804) 2024-05-09T05:06:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 -- 172.21.15.100:0/2669166461 learned_addr learned my addr 172.21.15.100:0/2669166461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbd400640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00b6050 0x7fafc015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 -- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00b6050 msgr2=0x7fafc015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbde00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafc0073c90 0x7fafc014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00b6050 0x7fafc015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 -- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafc0073c90 msgr2=0x7fafc014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafc0073c90 0x7fafc014c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbe800640 1 -- 172.21.15.100:0/2669166461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc015ab10 con 0x7fafc00d07b0 2024-05-09T05:06:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.010+0000 7fafbd400640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00b6050 0x7fafc015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.011+0000 7fafbe800640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 0x7fafc00c8800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fafb800b9a0 tx=0x7fafb800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.011+0000 7fafb6000640 1 -- 172.21.15.100:0/2669166461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8019070 con 0x7fafc00d07b0 2024-05-09T05:06:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.011+0000 7fafb6000640 1 -- 172.21.15.100:0/2669166461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb800cbc0 con 0x7fafc00d07b0 2024-05-09T05:06:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.011+0000 7fafb6000640 1 -- 172.21.15.100:0/2669166461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8014440 con 0x7fafc00d07b0 2024-05-09T05:06:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.011+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc015adf0 con 0x7fafc00d07b0 2024-05-09T05:06:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.011+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc015a800 con 0x7fafc00d07b0 2024-05-09T05:06:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.013+0000 7fafb6000640 1 -- 172.21.15.100:0/2669166461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fafb801c070 con 0x7fafc00d07b0 2024-05-09T05:06:07.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.015+0000 7fafb6000640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fafa00762d0 0x7fafa0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.015+0000 7fafb6000640 1 -- 172.21.15.100:0/2669166461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fafb80973c0 con 0x7fafc00d07b0 2024-05-09T05:06:07.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.015+0000 7fafbde00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fafa00762d0 0x7fafa0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.016+0000 7fafc79ea740 1 Processor -- start 2024-05-09T05:06:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.016+0000 7fafc79ea740 1 -- start start 2024-05-09T05:06:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.016+0000 7fafbde00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fafa00762d0 0x7fafa0078790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fafb0034000 tx=0x7fafb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e002c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649dffd6d0 0x55649e001440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e001dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafc79ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55649df66790 con 0x55649e002840 2024-05-09T05:06:07.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55649df0bf20 con 0x55649e001980 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55649df62750 con 0x55649dffd6d0 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e002c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e002c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52816/0 (socket says 172.21.15.100:52816) 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 -- 172.21.15.100:0/2476179346 learned_addr learned my addr 172.21.15.100:0/2476179346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 -- 172.21.15.100:0/2476179346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649dffd6d0 msgr2=0x55649e001440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649dffd6d0 0x55649e001440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 -- 172.21.15.100:0/2476179346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 msgr2=0x55649e001dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e001dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.017+0000 7fafbde00640 1 -- 172.21.15.100:0/2476179346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649dc782d0 con 0x55649e002840 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.018+0000 7fafbde00640 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e002c20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a6a0 tx=0x7fafb002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3789765ce54e8a26 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.018+0000 7fafaa600640 1 -- 172.21.15.100:0/2476179346 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb004e070 con 0x55649e002840 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.018+0000 7fafaa600640 1 -- 172.21.15.100:0/2476179346 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0032e20 con 0x55649e002840 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.018+0000 7fafaa600640 1 -- 172.21.15.100:0/2476179346 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0037040 con 0x55649e002840 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.018+0000 7fafc79ea740 1 -- 172.21.15.100:0/2476179346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 msgr2=0x55649e002c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.018+0000 7fafc79ea740 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e002c20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a6a0 tx=0x7fafb002c000 comp rx=0 tx=0).stop 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 -- 172.21.15.100:0/2476179346 shutdown_connections 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e001dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649dffd6d0 0x55649e001440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 --2- 172.21.15.100:0/2476179346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e002c20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 -- 172.21.15.100:0/2476179346 >> 172.21.15.100:0/2476179346 conn(0x55649dfff940 msgr2=0x55649e048400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 -- 172.21.15.100:0/2476179346 shutdown_connections 2024-05-09T05:06:07.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 -- 172.21.15.100:0/2476179346 wait complete. 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.019+0000 7fafc79ea740 1 -- start start 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.020+0000 7fafc79ea740 1 Processor -- start 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e001980 0x55649e04bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e0259b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e03e540 0x55649e025ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55649e02e3d0 con 0x55649e002840 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55649df1f9c0 con 0x55649e03e540 2024-05-09T05:06:07.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55649e02d850 con 0x55649e001980 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafc79ea740 10 client.0 _ll_register_callbacks cb 0x55649deec120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e0259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e0259b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52824/0 (socket says 172.21.15.100:52824) 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 -- 172.21.15.100:0/3814191353 learned_addr learned my addr 172.21.15.100:0/3814191353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbe800640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e03e540 0x55649e025ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbde00640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e001980 0x55649e04bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 -- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e001980 msgr2=0x55649e04bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e001980 0x55649e04bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 -- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e03e540 msgr2=0x55649e025ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e03e540 0x55649e025ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbd400640 1 -- 172.21.15.100:0/3814191353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649dd426b0 con 0x55649e002840 2024-05-09T05:06:07.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbe800640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e03e540 0x55649e025ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:07.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.021+0000 7fafbde00640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e001980 0x55649e04bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7fafbd400640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e0259b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fafac00c180 tx=0x7fafac00c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc88aeb6f10657b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7faf9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7faf9ea00640 1 -- 172.21.15.100:0/3814191353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac015070 con 0x55649e002840 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7faf9ea00640 1 -- 172.21.15.100:0/3814191353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fafac011800 con 0x55649e002840 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb0032e20 con 0x55649e002840 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7faf9ea00640 1 -- 172.21.15.100:0/3814191353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafac020050 con 0x55649e002840 2024-05-09T05:06:07.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7fafc79ea740 10 client.5412 fetch_fsmap learned FSMap version 28 2024-05-09T05:06:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55649e01d270 con 0x55649e002840 2024-05-09T05:06:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.022+0000 7faf9ea00640 1 -- 172.21.15.100:0/3814191353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0032e20 con 0x55649e002840 2024-05-09T05:06:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7faf9ea00640 1 -- 172.21.15.100:0/3814191353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7fafac023020 con 0x55649e002840 2024-05-09T05:06:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafc79ea740 10 client.5412 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T05:06:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafc79ea740 10 client.5412 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:06:07.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafc79ea740 20 client.5412 populate_metadata read hostname 'smithi100' 2024-05-09T05:06:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafc79ea740 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e04c470 0x55649e01f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafc79ea740 4 client.5412 mds_command: new command op to 5286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:06:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 --> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55649df743a0 con 0x55649e04c470 2024-05-09T05:06:07.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.023+0000 7fafbde00640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e04c470 0x55649e01f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.024+0000 7faf9ea00640 10 client.5412 ms_handle_connect on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.024+0000 7fafbde00640 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e04c470 0x55649e01f010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363547f96f3c3586 server_cookie=ffb682e6cfc1e435 in_seq=0 out_seq=0 2024-05-09T05:06:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.026+0000 7faf9ea00640 1 -- 172.21.15.100:0/3814191353 <== mds.0 v2:172.21.15.133:6833/3578202714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55649df743a0 con 0x55649e04c470 2024-05-09T05:06:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.026+0000 7faf9ea00640 10 client.5412 handle_command_reply: tid=0 2024-05-09T05:06:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 client.5412 shutdown 2024-05-09T05:06:07.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 msgr2=0x55649e0259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e0259b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fafac00c180 tx=0x7fafac00c640 comp rx=0 tx=0).stop 2024-05-09T05:06:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 shutdown_connections 2024-05-09T05:06:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e04c470 0x55649e01f010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e03e540 0x55649e025ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e002840 0x55649e0259b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 --2- 172.21.15.100:0/3814191353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e001980 0x55649e04bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7faf9ea00640 0 client.5412 ms_handle_reset on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:07.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 >> 172.21.15.100:0/3814191353 conn(0x55649dffd6d0 msgr2=0x55649e003330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 shutdown_connections 2024-05-09T05:06:07.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 1 -- 172.21.15.100:0/3814191353 wait complete. 2024-05-09T05:06:07.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.027+0000 7fafc79ea740 20 client.5412 trim_cache size 0 max 16384 2024-05-09T05:06:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.047+0000 7fafc79ea740 1 Processor -- start 2024-05-09T05:06:07.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.047+0000 7fafc79ea740 1 -- start start 2024-05-09T05:06:07.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.047+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 0x55649e06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e002840 0x55649e025ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e03e540 0x55649e002e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafc79ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fafc014e590 con 0x55649e001980 2024-05-09T05:06:07.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fafc014fa30 con 0x55649e002840 2024-05-09T05:06:07.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fafc014df40 con 0x55649e03e540 2024-05-09T05:06:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 0x55649e06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 0x55649e06c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52840/0 (socket says 172.21.15.100:52840) 2024-05-09T05:06:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 -- 172.21.15.100:0/1901416758 learned_addr learned my addr 172.21.15.100:0/1901416758 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 -- 172.21.15.100:0/1901416758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e03e540 msgr2=0x55649e002e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e03e540 0x55649e002e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 -- 172.21.15.100:0/1901416758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e002840 msgr2=0x55649e025ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e002840 0x55649e025ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 -- 172.21.15.100:0/1901416758 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649e01c380 con 0x55649e001980 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.048+0000 7fafbde00640 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 0x55649e06c130 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009630 tx=0x7fafb003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574684f2d06c275d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafa9c00640 1 -- 172.21.15.100:0/1901416758 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0037030 con 0x55649e001980 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafa9c00640 1 -- 172.21.15.100:0/1901416758 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0004340 con 0x55649e001980 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafa9c00640 1 -- 172.21.15.100:0/1901416758 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb004e040 con 0x55649e001980 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 -- 172.21.15.100:0/1901416758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 msgr2=0x55649e06c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 0x55649e06c130 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009630 tx=0x7fafb003b000 comp rx=0 tx=0).stop 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 -- 172.21.15.100:0/1901416758 shutdown_connections 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e03e540 0x55649e002e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e002840 0x55649e025ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1901416758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e001980 0x55649e06c130 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 -- 172.21.15.100:0/1901416758 >> 172.21.15.100:0/1901416758 conn(0x55649dffd6d0 msgr2=0x55649e01e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.049+0000 7fafc79ea740 1 -- 172.21.15.100:0/1901416758 shutdown_connections 2024-05-09T05:06:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.050+0000 7fafc79ea740 1 -- 172.21.15.100:0/1901416758 wait complete. 2024-05-09T05:06:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.050+0000 7fafc79ea740 1 -- start start 2024-05-09T05:06:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.050+0000 7fafc79ea740 1 Processor -- start 2024-05-09T05:06:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e002840 0x55649e06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 0x55649e0474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55649e01dd40 con 0x55649e03e540 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x55649e04a9a0 con 0x55649e001980 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x55649e04a1c0 con 0x55649e002840 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.051+0000 7fafc79ea740 10 client.0 _ll_register_callbacks cb 0x7fafac00ab60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 0x55649e0474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 0x55649e0474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52856/0 (socket says 172.21.15.100:52856) 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 -- 172.21.15.100:0/1597656922 learned_addr learned my addr 172.21.15.100:0/1597656922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbde00640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 -- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e002840 msgr2=0x55649e06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbd400640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e002840 0x55649e06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e002840 0x55649e06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 -- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 msgr2=0x55649e06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e06ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 -- 172.21.15.100:0/1597656922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649e04b6d0 con 0x55649e03e540 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbde00640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e06ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbd400640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e002840 0x55649e06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafbe800640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 0x55649e0474f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fafb805cbc0 tx=0x7fafb8060bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ed500db091be39 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7faf9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7faf9ea00640 1 -- 172.21.15.100:0/1597656922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb805fa30 con 0x55649e03e540 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7faf9ea00640 1 -- 172.21.15.100:0/1597656922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7fafb8065b10 con 0x55649e03e540 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.052+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb0004340 con 0x55649e03e540 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7faf9ea00640 1 -- 172.21.15.100:0/1597656922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafb8095050 con 0x55649e03e540 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 10 client.5418 fetch_fsmap learned FSMap version 28 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55649dffedf0 con 0x55649e03e540 2024-05-09T05:06:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7faf9ea00640 1 -- 172.21.15.100:0/1597656922 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0004340 con 0x55649e03e540 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7faf9ea00640 1 -- 172.21.15.100:0/1597656922 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7fafb805bf40 con 0x55649e03e540 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 10 client.5418 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 10 client.5418 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 20 client.5418 populate_metadata read hostname 'smithi100' 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e0c6680 0x55649e0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 4 client.5418 mds_command: new command op to 5286 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.053+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 --> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] -- command(tid 0: {"prefix": "status"}) -- 0x55649df6e210 con 0x55649e0c6680 2024-05-09T05:06:07.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.054+0000 7fafbde00640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e0c6680 0x55649e0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.055+0000 7fafbde00640 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e0c6680 0x55649e0c6a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8930700d7159a4ab server_cookie=e9f332e2135a1d70 in_seq=0 out_seq=0 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.055+0000 7faf9ea00640 10 client.5418 ms_handle_connect on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.055+0000 7faf9ea00640 1 -- 172.21.15.100:0/1597656922 <== mds.0 v2:172.21.15.133:6833/3578202714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55649df6e210 con 0x55649e0c6680 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.055+0000 7faf9ea00640 10 client.5418 handle_command_reply: tid=0 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.055+0000 7fafc79ea740 1 client.5418 shutdown 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 msgr2=0x55649e0474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 0x55649e0474f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fafb805cbc0 tx=0x7fafb8060bf0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 shutdown_connections 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x55649e0c6680 0x55649e0c6a60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55649e03e540 0x55649e0474f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55649e002840 0x55649e06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 --2- 172.21.15.100:0/1597656922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55649e001980 0x55649e06ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7faf9ea00640 0 client.5418 ms_handle_reset on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:07.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 >> 172.21.15.100:0/1597656922 conn(0x55649dffd6d0 msgr2=0x55649e01b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 shutdown_connections 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 1 -- 172.21.15.100:0/1597656922 wait complete. 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc79ea740 20 client.5418 trim_cache size 0 max 16384 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "11e43d29-3063-46a7-bef1-2ecadce2fdc5", 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5286, 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-05-09T05:06:07.060 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-05-09T05:06:07.061 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 6.675569286, 2024-05-09T05:06:07.061 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 28, 2024-05-09T05:06:07.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 49, 2024-05-09T05:06:07.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 47, 2024-05-09T05:06:07.061 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 11.114313084999999 2024-05-09T05:06:07.061 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fafa00762d0 msgr2=0x7fafa0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fafa00762d0 0x7fafa0078790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fafb0034000 tx=0x7fafb002e000 comp rx=0 tx=0).stop 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 msgr2=0x7fafc00c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.056+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 0x7fafc00c8800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fafb800b9a0 tx=0x7fafb800be60 comp rx=0 tx=0).stop 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 shutdown_connections 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fafa00762d0 0x7fafa0078790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafc00d07b0 0x7fafc00c8800 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fafc00b6050 0x7fafc015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 --2- 172.21.15.100:0/2669166461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafc0073c90 0x7fafc014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 >> 172.21.15.100:0/2669166461 conn(0x7fafc00b2c90 msgr2=0x7fafc009bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 shutdown_connections 2024-05-09T05:06:07.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.057+0000 7fafc4a00640 1 -- 172.21.15.100:0/2669166461 wait complete. 2024-05-09T05:06:07.073 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-09T05:06:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.260+0000 7f9825800640 1 Processor -- start 2024-05-09T05:06:07.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.260+0000 7f9825800640 1 -- start start 2024-05-09T05:06:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.261+0000 7f9825800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 0x7f9820152520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.261+0000 7f9825800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982015fbb0 con 0x7f982015f2b0 2024-05-09T05:06:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.261+0000 7f9825800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98200cf150 con 0x7f98200742b0 2024-05-09T05:06:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.261+0000 7f9825800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f98200cfd60 con 0x7f982015f720 2024-05-09T05:06:07.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.262+0000 7f981f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f982015f2b0 0x7f9820151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43814/0 (socket says 172.21.15.100:43814) 2024-05-09T05:06:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.262+0000 7f981f400640 1 -- 172.21.15.100:0/1948234711 learned_addr learned my addr 172.21.15.100:0/1948234711 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:07.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.262+0000 7f9824e00640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 0x7f9820152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.262+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3809651273 0 0) 0x7f982015fbb0 con 0x7f982015f2b0 2024-05-09T05:06:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.262+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9804003440 con 0x7f982015f2b0 2024-05-09T05:06:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1866143771 0 0) 0x7f9804003440 con 0x7f982015f2b0 2024-05-09T05:06:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 msgr2=0x7f9820152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 0x7f9820152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 >> v1:172.21.15.133:6789/0 conn(0x7f98200742b0 legacy=0x7f98200b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98200cf430 con 0x7f982015f2b0 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f980c0016f0 con 0x7f982015f2b0 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 >> v1:172.21.15.100:6789/0 conn(0x7f982015f2b0 legacy=0x7f9820151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9804003b70 0x7f9804003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f980400adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 0x7f980400d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f98200cfd60 con 0x7f9804008940 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f980400de00 con 0x7f9804003b70 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f980400e000 con 0x7f982015f720 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981f400640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f980400adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981f400640 1 -- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 msgr2=0x7f980400d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981f400640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f982015f720 0x7f980400d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981f400640 1 -- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9804003b70 msgr2=0x7f9804003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:07.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981f400640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9804003b70 0x7f9804003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.263+0000 7f981f400640 1 -- 172.21.15.100:0/1948234711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9804003440 con 0x7f9804008940 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.264+0000 7f981f400640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f980400adb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c240 tx=0x7f9804003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293b97ab69d747ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c007d60 con 0x7f9804008940 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c005ad0 con 0x7f9804008940 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f981ea00640 1 -- 172.21.15.100:0/1948234711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c007070 con 0x7f9804008940 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9825800640 1 -- 172.21.15.100:0/1948234711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 msgr2=0x7f980400adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9825800640 1 --2- 172.21.15.100:0/1948234711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f980400adb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c240 tx=0x7f9804003730 comp rx=0 tx=0).stop 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9824e00640 1 -- 172.21.15.100:0/1948234711 reap_dead start 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9825800640 1 -- 172.21.15.100:0/1948234711 shutdown_connections 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9825800640 1 -- 172.21.15.100:0/1948234711 >> 172.21.15.100:0/1948234711 conn(0x7f982006c7f0 msgr2=0x7f982006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9825800640 1 -- 172.21.15.100:0/1948234711 shutdown_connections 2024-05-09T05:06:07.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.265+0000 7f9825800640 1 -- 172.21.15.100:0/1948234711 wait complete. 2024-05-09T05:06:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.267+0000 7f9825800640 1 Processor -- start 2024-05-09T05:06:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.267+0000 7f9825800640 1 -- start start 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f9825800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f982014a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f9825800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98200afef0 0x7f9820152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f9825800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98201533b0 0x7f98200ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f9825800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f98200cf9f0 con 0x7f9804008940 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f9825800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f982006f470 con 0x7f98200afef0 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f9825800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f98200d0a20 con 0x7f98201533b0 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f981fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f982014a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f981fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f982014a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52872/0 (socket says 172.21.15.100:52872) 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.268+0000 7f981fe00640 1 -- 172.21.15.100:0/4162312805 learned_addr learned my addr 172.21.15.100:0/4162312805 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f981fe00640 1 -- 172.21.15.100:0/4162312805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98201533b0 msgr2=0x7f98200ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f981fe00640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98201533b0 0x7f98200ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f981fe00640 1 -- 172.21.15.100:0/4162312805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98200afef0 msgr2=0x7f9820152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f981fe00640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98200afef0 0x7f9820152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f981fe00640 1 -- 172.21.15.100:0/4162312805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9820158840 con 0x7f9804008940 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f981fe00640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f982014a000 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f981000c4e0 tx=0x7f981000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810017070 con 0x7f9804008940 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98100052f0 con 0x7f9804008940 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9820073320 con 0x7f9804008940 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810003830 con 0x7f9804008940 2024-05-09T05:06:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.269+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98200738e0 con 0x7f9804008940 2024-05-09T05:06:07.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.270+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98201537d0 con 0x7f9804008940 2024-05-09T05:06:07.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.271+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f981001a070 con 0x7f9804008940 2024-05-09T05:06:07.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.272+0000 7f9817e00640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9800076300 0x7f98000787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:07.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.273+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f9810096a60 con 0x7f9804008940 2024-05-09T05:06:07.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.273+0000 7f981f400640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9800076300 0x7f98000787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:07.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.273+0000 7f981f400640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9800076300 0x7f98000787c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f980c032000 tx=0x7f980c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:07.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.277+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f98100603a0 con 0x7f9804008940 2024-05-09T05:06:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.509+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f982006a550 con 0x7f9804008940 2024-05-09T05:06:07.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.510+0000 7f9817e00640 1 -- 172.21.15.100:0/4162312805 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f9810068390 con 0x7f9804008940 2024-05-09T05:06:07.510 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:06:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9800076300 msgr2=0x7f98000787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9800076300 0x7f98000787c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f980c032000 tx=0x7f980c007000 comp rx=0 tx=0).stop 2024-05-09T05:06:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 msgr2=0x7f982014a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f982014a000 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f981000c4e0 tx=0x7f981000c9a0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 shutdown_connections 2024-05-09T05:06:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9800076300 0x7f98000787c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f98201533b0 0x7f98200ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98200afef0 0x7f9820152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 --2- 172.21.15.100:0/4162312805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9804008940 0x7f982014a000 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 >> 172.21.15.100:0/4162312805 conn(0x7f982006c7f0 msgr2=0x7f982015af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 shutdown_connections 2024-05-09T05:06:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07.513+0000 7f9825800640 1 -- 172.21.15.100:0/4162312805 wait complete. 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:06:07.532 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:06:07.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:07.533 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.582 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42512sec preferred_lft 42512sec 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-09T05:06:07.583 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:e9:b2:ad:ea:5a brd ff:ff:ff:ff:ff:ff 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::f4a7:a4ff:fe5e:5c5/64 scope link 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 8e:e9:b2:ad:ea:5a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::8ce9:b2ff:fead:ea5a/64 scope link 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 96:4e:c8:25:f6:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::944e:c8ff:fe25:f6dc/64 scope link 2024-05-09T05:06:07.584 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:06:07.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:07.585 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:06:07.709 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-05-09T05:06:07.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:07.713 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-05-09T05:06:07.765 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-05-09T05:06:07.765 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:06:07.765 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T05:06:07.765 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T05:06:07.765 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:06:07.766 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:06:07.766 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-05-09T05:06:07.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T05:06:07.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T05:06:07.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T05:06:07.766 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-05-09T05:06:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:06:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:06:07.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:07.973 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:06:08.019 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T05:06:08.019 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-09T05:06:08.019 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:06:08.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:08.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-05-09T05:06:08.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:06:08.102 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T05:06:08.155 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:06:08.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:06:08.155 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:06:08.204 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-09T05:06:08.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:08.205 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:06:08.329 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:06:08.329 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:06:08.329 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:06:08.349 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:06:08.349 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:06:08.349 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:06:08.349 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:06:08.350 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:06:08.377 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-09T05:06:08.377 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-09T05:06:08.377 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-05-09T05:06:08.377 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.133:3300,172.21.15.133:3301" 2024-05-09T05:06:08.377 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-09T05:06:08.377 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790" 2024-05-09T05:06:08.378 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:6789,172.21.15.133:6789,172.21.15.133:6790:/ 2024-05-09T05:06:08.378 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=11e43d29-3063-46a7-bef1-2ecadce2fdc5" will pass to kernel 2024-05-09T05:06:08.379 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T05:06:08.379 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:06:08.379 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:06:08.379 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:06:08.380 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:06:08.383 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:06:08.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:08.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:06:08.457 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:06:08.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:06:08.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:06:08.605 INFO:teuthology.orchestra.run.smithi100.stdout:client4816 2024-05-09T05:06:08.606 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:06:08.606 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:08.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_extra1 --pg_num_min 64 2024-05-09T05:06:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.869+0000 7f1c37600640 1 Processor -- start 2024-05-09T05:06:08.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.869+0000 7f1c37600640 1 -- start start 2024-05-09T05:06:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.870+0000 7f1c37600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c3006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c37600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 0x7f1c3006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c37600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3006f540 con 0x7f1c301531d0 2024-05-09T05:06:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c37600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f1c30160810 con 0x7f1c30160290 2024-05-09T05:06:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c37600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1c30160af0 con 0x7f1c3015fe30 2024-05-09T05:06:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c35600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 0x7f1c3006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c35600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 0x7f1c3006ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:51738/0 (socket says 172.21.15.100:51738) 2024-05-09T05:06:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.871+0000 7f1c35600640 1 -- 172.21.15.100:0/2526138937 learned_addr learned my addr 172.21.15.100:0/2526138937 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.872+0000 7f1c2fe00640 1 --2- 172.21.15.100:0/2526138937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c3006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.872+0000 7f1c2f400640 1 -- 172.21.15.100:0/2526138937 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648198780 0 0) 0x7f1c3006f540 con 0x7f1c301531d0 2024-05-09T05:06:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.872+0000 7f1c2f400640 1 -- 172.21.15.100:0/2526138937 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c18003520 con 0x7f1c301531d0 2024-05-09T05:06:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.872+0000 7f1c2fe00640 1 -- 172.21.15.100:0/2526138937 >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 msgr2=0x7f1c3006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.872+0000 7f1c2fe00640 1 --2- 172.21.15.100:0/2526138937 >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 0x7f1c3006ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.873+0000 7f1c2fe00640 1 -- 172.21.15.100:0/2526138937 >> v1:172.21.15.133:6789/0 conn(0x7f1c301531d0 legacy=0x7f1c3015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.873+0000 7f1c2fe00640 1 -- 172.21.15.100:0/2526138937 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3015ca50 con 0x7f1c3015fe30 2024-05-09T05:06:08.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.873+0000 7f1c35600640 1 --2- 172.21.15.100:0/2526138937 >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 0x7f1c3006ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:06:08.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.874+0000 7f1c2fe00640 1 --2- 172.21.15.100:0/2526138937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c3006e9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0097a0 tx=0x7f1c1c02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeeef2a95742a8b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:08.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.874+0000 7f1c2f400640 1 -- 172.21.15.100:0/2526138937 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c037070 con 0x7f1c3015fe30 2024-05-09T05:06:08.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.874+0000 7f1c2f400640 1 -- 172.21.15.100:0/2526138937 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c02ae40 con 0x7f1c3015fe30 2024-05-09T05:06:08.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.874+0000 7f1c2f400640 1 -- 172.21.15.100:0/2526138937 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c032660 con 0x7f1c3015fe30 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 -- 172.21.15.100:0/2526138937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 msgr2=0x7f1c3006e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 --2- 172.21.15.100:0/2526138937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c3006e9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0097a0 tx=0x7f1c1c02a0f0 comp rx=0 tx=0).stop 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 -- 172.21.15.100:0/2526138937 shutdown_connections 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 --2- 172.21.15.100:0/2526138937 >> v2:172.21.15.133:3300/0 conn(0x7f1c30160290 0x7f1c3006ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 --2- 172.21.15.100:0/2526138937 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c3006e9c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 -- 172.21.15.100:0/2526138937 >> 172.21.15.100:0/2526138937 conn(0x7f1c3006c7f0 msgr2=0x7f1c3006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 -- 172.21.15.100:0/2526138937 shutdown_connections 2024-05-09T05:06:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.875+0000 7f1c37600640 1 -- 172.21.15.100:0/2526138937 wait complete. 2024-05-09T05:06:08.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.877+0000 7f1c37600640 1 Processor -- start 2024-05-09T05:06:08.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.877+0000 7f1c37600640 1 -- start start 2024-05-09T05:06:08.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c37600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 0x7f1c301e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:08.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c37600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c30152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c37600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c30160290 0x7f1c300737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c37600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c30153730 con 0x7f1c301531d0 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c37600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1c301535b0 con 0x7f1c30160290 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c37600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1c300d0b90 con 0x7f1c3015fe30 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c34c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 0x7f1c301e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c34c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 0x7f1c301e64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52886/0 (socket says 172.21.15.100:52886) 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.878+0000 7f1c34c00640 1 -- 172.21.15.100:0/717345183 learned_addr learned my addr 172.21.15.100:0/717345183 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c2fe00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c30152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c35600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c30160290 0x7f1c300737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c34c00640 1 -- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 msgr2=0x7f1c30152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c34c00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c30152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c34c00640 1 -- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c30160290 msgr2=0x7f1c300737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:08.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c34c00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c30160290 0x7f1c300737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:08.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c34c00640 1 -- 172.21.15.100:0/717345183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c30072740 con 0x7f1c301531d0 2024-05-09T05:06:08.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.879+0000 7f1c34c00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 0x7f1c301e64f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c460 tx=0x7f1c2400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:08.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.880+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c240052d0 con 0x7f1c301531d0 2024-05-09T05:06:08.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.880+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c24005490 con 0x7f1c301531d0 2024-05-09T05:06:08.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.880+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24012870 con 0x7f1c301531d0 2024-05-09T05:06:08.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.880+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c30072a20 con 0x7f1c301531d0 2024-05-09T05:06:08.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.880+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c30072fe0 con 0x7f1c301531d0 2024-05-09T05:06:08.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.881+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c30069500 con 0x7f1c301531d0 2024-05-09T05:06:08.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.882+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c24012a10 con 0x7f1c301531d0 2024-05-09T05:06:08.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.883+0000 7f1c2cc00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c100762d0 0x7f1c10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:08.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.883+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5767+0+0 (secure 0 0 0) 0x7f1c240971f0 con 0x7f1c301531d0 2024-05-09T05:06:08.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.883+0000 7f1c2fe00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c100762d0 0x7f1c10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:08.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.884+0000 7f1c2fe00640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c100762d0 0x7f1c10078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c034000 tx=0x7f1c1c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:08.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:08.888+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c24060b00 con 0x7f1c301531d0 2024-05-09T05:06:09.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.096+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_extra1", "pg_num_min": 64} v 0) -- 0x7f1c300d0850 con 0x7f1c301531d0 2024-05-09T05:06:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.486+0000 7f1c2cc00640 1 -- 172.21.15.100:0/717345183 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_extra1", "pg_num_min": 64}]=0 pool 'cephfs_data_extra1' created v50) ==== 144+0+0 (secure 0 0 0) 0x7f1c24060400 con 0x7f1c301531d0 2024-05-09T05:06:09.487 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_extra1' created 2024-05-09T05:06:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.490+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c100762d0 msgr2=0x7f1c10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.490+0000 7f1c37600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c100762d0 0x7f1c10078790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c034000 tx=0x7f1c1c02e000 comp rx=0 tx=0).stop 2024-05-09T05:06:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.490+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 msgr2=0x7f1c301e64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:09.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.490+0000 7f1c37600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 0x7f1c301e64f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c460 tx=0x7f1c2400c920 comp rx=0 tx=0).stop 2024-05-09T05:06:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.491+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 shutdown_connections 2024-05-09T05:06:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.491+0000 7f1c37600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c100762d0 0x7f1c10078790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.491+0000 7f1c37600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c30160290 0x7f1c300737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.491+0000 7f1c37600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c3015fe30 0x7f1c30152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.491+0000 7f1c37600640 1 --2- 172.21.15.100:0/717345183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c301531d0 0x7f1c301e64f0 secure :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c460 tx=0x7f1c2400c920 comp rx=0 tx=0).stop 2024-05-09T05:06:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.491+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 >> 172.21.15.100:0/717345183 conn(0x7f1c3006c7f0 msgr2=0x7f1c3006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.492+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 shutdown_connections 2024-05-09T05:06:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.493+0000 7f1c37600640 1 -- 172.21.15.100:0/717345183 wait complete. 2024-05-09T05:06:09.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_extra1 2024-05-09T05:06:09.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.707+0000 7fb7a9200640 1 Processor -- start 2024-05-09T05:06:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.707+0000 7fb7a9200640 1 -- start start 2024-05-09T05:06:09.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.708+0000 7fb7a9200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a40ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:09.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.708+0000 7fb7a9200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 0x7fb7a406e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:09.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.708+0000 7fb7a9200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a40721e0 con 0x7fb7a406edf0 2024-05-09T05:06:09.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.708+0000 7fb7a9200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a40cf1f0 con 0x7fb7a40ced90 2024-05-09T05:06:09.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.708+0000 7fb7a9200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a406f600 con 0x7fb7a41458f0 2024-05-09T05:06:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.709+0000 7fb79be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 0x7fb7a406e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.709+0000 7fb7a3400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a40ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.709+0000 7fb79be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 0x7fb7a406e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.100:51756/0 (socket says 172.21.15.100:51756) 2024-05-09T05:06:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.709+0000 7fb79be00640 1 -- 172.21.15.100:0/1338355743 learned_addr learned my addr 172.21.15.100:0/1338355743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:09.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.709+0000 7fb7a3e00640 1 --1- 172.21.15.100:0/1338355743 >> v1:172.21.15.133:6789/0 conn(0x7fb7a406edf0 0x7fb7a40ae880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.100:53738/0 (socket says 172.21.15.100:53738) 2024-05-09T05:06:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.710+0000 7fb7a3400640 1 -- 172.21.15.100:0/1338355743 >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 msgr2=0x7fb7a406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.710+0000 7fb7a3400640 1 --2- 172.21.15.100:0/1338355743 >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 0x7fb7a406e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.710+0000 7fb7a3400640 1 -- 172.21.15.100:0/1338355743 >> v1:172.21.15.133:6789/0 conn(0x7fb7a406edf0 legacy=0x7fb7a40ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.710+0000 7fb7a3400640 1 -- 172.21.15.100:0/1338355743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a406f8e0 con 0x7fb7a41458f0 2024-05-09T05:06:09.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.710+0000 7fb79be00640 1 --2- 172.21.15.100:0/1338355743 >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 0x7fb7a406e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:06:09.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.712+0000 7fb7a3400640 1 --2- 172.21.15.100:0/1338355743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a40ce850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7940097a0 tx=0x7fb79402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=422d3c83c70c12fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.712+0000 7fb7a2a00640 1 -- 172.21.15.100:0/1338355743 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794037070 con 0x7fb7a41458f0 2024-05-09T05:06:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.712+0000 7fb7a2a00640 1 -- 172.21.15.100:0/1338355743 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79402ae50 con 0x7fb7a41458f0 2024-05-09T05:06:09.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.712+0000 7fb7a2a00640 1 -- 172.21.15.100:0/1338355743 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794032660 con 0x7fb7a41458f0 2024-05-09T05:06:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 -- 172.21.15.100:0/1338355743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 msgr2=0x7fb7a40ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:09.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1338355743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a40ce850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7940097a0 tx=0x7fb79402a100 comp rx=0 tx=0).stop 2024-05-09T05:06:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 -- 172.21.15.100:0/1338355743 shutdown_connections 2024-05-09T05:06:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1338355743 >> v2:172.21.15.133:3300/0 conn(0x7fb7a40ced90 0x7fb7a406e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1338355743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a40ce850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 -- 172.21.15.100:0/1338355743 >> 172.21.15.100:0/1338355743 conn(0x7fb7a40b29b0 msgr2=0x7fb7a40b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 -- 172.21.15.100:0/1338355743 shutdown_connections 2024-05-09T05:06:09.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.713+0000 7fb7a9200640 1 -- 172.21.15.100:0/1338355743 wait complete. 2024-05-09T05:06:09.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.715+0000 7fb7a9200640 1 Processor -- start 2024-05-09T05:06:09.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.715+0000 7fb7a9200640 1 -- start start 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb7a9200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a406edf0 0x7fb7a4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb7a9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 0x7fb7a4154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb7a9200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a4134820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb7a9200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a406f240 con 0x7fb7a40ced90 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb7a9200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a406fea0 con 0x7fb7a406edf0 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb7a9200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a406f3c0 con 0x7fb7a41458f0 2024-05-09T05:06:09.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb79be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 0x7fb7a4154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb79be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 0x7fb7a4154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52894/0 (socket says 172.21.15.100:52894) 2024-05-09T05:06:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.716+0000 7fb79be00640 1 -- 172.21.15.100:0/1733634911 learned_addr learned my addr 172.21.15.100:0/1733634911 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb7a3e00640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a4134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb7a3400640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a406edf0 0x7fb7a4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79be00640 1 -- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 msgr2=0x7fb7a4134820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:09.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79be00640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a4134820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79be00640 1 -- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a406edf0 msgr2=0x7fb7a4153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79be00640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a406edf0 0x7fb7a4153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79be00640 1 -- 172.21.15.100:0/1733634911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a4160850 con 0x7fb7a40ced90 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79be00640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 0x7fb7a4154410 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00e9d0 tx=0x7fb78c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c017070 con 0x7fb7a40ced90 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c00ca60 con 0x7fb7a40ced90 2024-05-09T05:06:09.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c00ce10 con 0x7fb7a40ced90 2024-05-09T05:06:09.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.717+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a40b55a0 con 0x7fb7a40ced90 2024-05-09T05:06:09.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.718+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a4132cc0 con 0x7fb7a40ced90 2024-05-09T05:06:09.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.719+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a406a550 con 0x7fb7a40ced90 2024-05-09T05:06:09.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.720+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb78c01a070 con 0x7fb7a40ced90 2024-05-09T05:06:09.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.721+0000 7fb79b400640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7800762d0 0x7fb780078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:09.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.721+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6140+0+0 (secure 0 0 0) 0x7fb78c097a80 con 0x7fb7a40ced90 2024-05-09T05:06:09.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.722+0000 7fb7a3400640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7800762d0 0x7fb780078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:09.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.722+0000 7fb7a3400640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7800762d0 0x7fb780078790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb794034000 tx=0x7fb79402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:09.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.726+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb7a4160850 con 0x7fb7a40ced90 2024-05-09T05:06:09.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:09.972+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra1"} v 0) -- 0x7fb7a415e7e0 con 0x7fb7a40ced90 2024-05-09T05:06:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.505+0000 7fb79b400640 1 -- 172.21.15.100:0/1733634911 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra1"}]=0 added data pool 9 to fsmap v29) ==== 141+0+0 (secure 0 0 0) 0x7fb78c0612a0 con 0x7fb7a40ced90 2024-05-09T05:06:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 9 to fsmap 2024-05-09T05:06:10.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.514+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7800762d0 msgr2=0x7fb780078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.514+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7800762d0 0x7fb780078790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb794034000 tx=0x7fb79402e000 comp rx=0 tx=0).stop 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.514+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 msgr2=0x7fb7a4154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.514+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 0x7fb7a4154410 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00e9d0 tx=0x7fb78c00ee90 comp rx=0 tx=0).stop 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 shutdown_connections 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb7800762d0 0x7fb780078790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb7a41458f0 0x7fb7a4134820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7a40ced90 0x7fb7a4154410 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 --2- 172.21.15.100:0/1733634911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a406edf0 0x7fb7a4153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 >> 172.21.15.100:0/1733634911 conn(0x7fb7a40b29b0 msgr2=0x7fb7a41434f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.515+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 shutdown_connections 2024-05-09T05:06:10.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.516+0000 7fb7a9200640 1 -- 172.21.15.100:0/1733634911 wait complete. 2024-05-09T05:06:10.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:10.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.718+0000 7f4cee600640 1 Processor -- start 2024-05-09T05:06:10.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.719+0000 7f4cee600640 1 -- start start 2024-05-09T05:06:10.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4cee600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ce80cdc20 0x7f4ce80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4cee600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 0x7f4ce806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4cee600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce81566d0 con 0x7f4ce81562f0 2024-05-09T05:06:10.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4cee600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce80ce5d0 con 0x7f4ce80cdc20 2024-05-09T05:06:10.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4cee600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce80ceee0 con 0x7f4ce806e460 2024-05-09T05:06:10.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4ced200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4ce81562f0 0x7f4ce80af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43822/0 (socket says 172.21.15.100:43822) 2024-05-09T05:06:10.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.720+0000 7f4ced200640 1 -- 172.21.15.100:0/357161305 learned_addr learned my addr 172.21.15.100:0/357161305 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/357161305 >> v2:172.21.15.133:3300/0 conn(0x7f4ce80cdc20 0x7f4ce80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4cedc00640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 0x7f4ce806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267694884 0 0) 0x7f4ce81566d0 con 0x7f4ce81562f0 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd0003520 con 0x7f4ce81562f0 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3763741041 0 0) 0x7f4cd0003520 con 0x7f4ce81562f0 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 msgr2=0x7f4ce806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 0x7f4ce806e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 >> v2:172.21.15.133:3300/0 conn(0x7f4ce80cdc20 msgr2=0x7f4ce80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 --2- 172.21.15.100:0/357161305 >> v2:172.21.15.133:3300/0 conn(0x7f4ce80cdc20 0x7f4ce80ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce80afa80 con 0x7f4ce81562f0 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f4cdc0016f0 con 0x7f4ce81562f0 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.721+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 >> v1:172.21.15.100:6789/0 conn(0x7f4ce81562f0 legacy=0x7f4ce80af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7400640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd0003a00 0x7f4cd0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7400640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4cd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7400640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 0x7f4cd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80ce5d0 con 0x7f4cd0004800 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80ceee0 con 0x7f4cd0003a00 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd000b9c0 con 0x7f4ce806e460 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4cd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ced200640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd0003a00 0x7f4cd0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7e00640 1 -- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 msgr2=0x7f4cd00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:10.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce806e460 0x7f4cd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7e00640 1 -- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd0003a00 msgr2=0x7f4cd0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:10.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd0003a00 0x7f4cd0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ce7e00640 1 -- 172.21.15.100:0/357161305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd0003520 con 0x7f4cd0004800 2024-05-09T05:06:10.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.722+0000 7f4ced200640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cd0003a00 0x7f4cd0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.723+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4cd0004c80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009af0 tx=0x7f4cd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ca3d3a21cdc88 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8036070 con 0x7f4cd0004800 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd8031400 con 0x7f4cd0004800 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4ce7400640 1 -- 172.21.15.100:0/357161305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8009690 con 0x7f4cd0004800 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cee600640 1 -- 172.21.15.100:0/357161305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 msgr2=0x7f4cd0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cee600640 1 --2- 172.21.15.100:0/357161305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4cd0004c80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009af0 tx=0x7f4cd0005830 comp rx=0 tx=0).stop 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cedc00640 1 -- 172.21.15.100:0/357161305 reap_dead start 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cee600640 1 -- 172.21.15.100:0/357161305 shutdown_connections 2024-05-09T05:06:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cee600640 1 -- 172.21.15.100:0/357161305 >> 172.21.15.100:0/357161305 conn(0x7f4ce806c7f0 msgr2=0x7f4ce806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:10.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cee600640 1 -- 172.21.15.100:0/357161305 shutdown_connections 2024-05-09T05:06:10.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.724+0000 7f4cee600640 1 -- 172.21.15.100:0/357161305 wait complete. 2024-05-09T05:06:10.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.727+0000 7f4cee600640 1 Processor -- start 2024-05-09T05:06:10.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.727+0000 7f4cee600640 1 -- start start 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4cee600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4ce815db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4cee600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80734e0 0x7f4ce8152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4cee600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce8073940 0x7f4ce8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4cee600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80cf410 con 0x7f4cd0004800 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4cee600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce80cfd40 con 0x7f4ce80734e0 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4cee600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce80cf6f0 con 0x7f4ce8073940 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4ce815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4ce815db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52924/0 (socket says 172.21.15.100:52924) 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 -- 172.21.15.100:0/3020417723 learned_addr learned my addr 172.21.15.100:0/3020417723 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80734e0 0x7f4ce8152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 -- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce8073940 msgr2=0x7f4ce8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce8073940 0x7f4ce8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 -- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80734e0 msgr2=0x7f4ce8152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80734e0 0x7f4ce8152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.728+0000 7f4ced200640 1 -- 172.21.15.100:0/3020417723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce8161610 con 0x7f4cd0004800 2024-05-09T05:06:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.729+0000 7f4ced200640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4ce815db90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00d830 tx=0x7f4cdc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.729+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc0074e0 con 0x7f4cd0004800 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.729+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc0047e0 con 0x7f4cd0004800 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.729+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc004bb0 con 0x7f4cd0004800 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.729+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce81618f0 con 0x7f4cd0004800 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.729+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce8161eb0 con 0x7f4cd0004800 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.730+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce80b4070 con 0x7f4cd0004800 2024-05-09T05:06:10.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.731+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cdc00b6b0 con 0x7f4cd0004800 2024-05-09T05:06:10.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.733+0000 7f4ce4c00640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ccc076300 0x7f4ccc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:10.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.733+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6172+0+0 (secure 0 0 0) 0x7f4cdc0973c0 con 0x7f4cd0004800 2024-05-09T05:06:10.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.733+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ccc076300 0x7f4ccc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:10.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.734+0000 7f4ce7e00640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ccc076300 0x7f4ccc0787c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8033000 tx=0x7f4cd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:10.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.737+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4ce80b4070 con 0x7f4cd0004800 2024-05-09T05:06:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.981+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ce806a550 con 0x7f4cd0004800 2024-05-09T05:06:10.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.982+0000 7f4ce4c00640 1 -- 172.21.15.100:0/3020417723 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5195 (secure 0 0 0) 0x7f4cdc060b40 con 0x7f4cd0004800 2024-05-09T05:06:10.983 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:10.983 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:09.975301+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8,9],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:10.984 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 29 2024-05-09T05:06:10.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ccc076300 msgr2=0x7f4ccc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ccc076300 0x7f4ccc0787c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8033000 tx=0x7f4cd8008030 comp rx=0 tx=0).stop 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 msgr2=0x7f4ce815db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4ce815db90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00d830 tx=0x7f4cdc00dcf0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 shutdown_connections 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f4ccc076300 0x7f4ccc0787c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ce8073940 0x7f4ce8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80734e0 0x7f4ce8152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 --2- 172.21.15.100:0/3020417723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cd0004800 0x7f4ce815db90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 >> 172.21.15.100:0/3020417723 conn(0x7f4ce806c7f0 msgr2=0x7f4ce80b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 shutdown_connections 2024-05-09T05:06:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:10.985+0000 7f4cee600640 1 -- 172.21.15.100:0/3020417723 wait complete. 2024-05-09T05:06:11.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.199+0000 7fdf5ec00640 1 Processor -- start 2024-05-09T05:06:11.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.199+0000 7fdf5ec00640 1 -- start start 2024-05-09T05:06:11.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ec00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf580b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf580d3660 0x7fdf580d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ec00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf580d2f80 con 0x7fdf580d1a10 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdf580d4000 con 0x7fdf580d3660 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ec00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580b6190 con 0x7fdf580b4530 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf580d3660 0x7fdf580d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf580d3660 0x7fdf580d3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52934/0 (socket says 172.21.15.100:52934) 2024-05-09T05:06:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.201+0000 7fdf5ce00640 1 -- 172.21.15.100:0/621163644 learned_addr learned my addr 172.21.15.100:0/621163644 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf5ce00640 1 -- 172.21.15.100:0/621163644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 msgr2=0x7fdf580b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf5d800640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf580b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf5ce00640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf580b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf57e00640 1 -- 172.21.15.100:0/621163644 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371789507 0 0) 0x7fdf580d2f80 con 0x7fdf580d1a10 2024-05-09T05:06:11.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf5ce00640 1 -- 172.21.15.100:0/621163644 >> v1:172.21.15.100:6789/0 conn(0x7fdf580d1a10 legacy=0x7fdf580cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf5ce00640 1 -- 172.21.15.100:0/621163644 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580b51e0 con 0x7fdf580d3660 2024-05-09T05:06:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.202+0000 7fdf5d800640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf580b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.203+0000 7fdf5ce00640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d3660 0x7fdf580d3ac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009870 tx=0x7fdf4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd584a9989bb65f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.203+0000 7fdf57e00640 1 -- 172.21.15.100:0/621163644 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44037070 con 0x7fdf580d3660 2024-05-09T05:06:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.203+0000 7fdf57e00640 1 -- 172.21.15.100:0/621163644 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf44032440 con 0x7fdf580d3660 2024-05-09T05:06:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.203+0000 7fdf57e00640 1 -- 172.21.15.100:0/621163644 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44032810 con 0x7fdf580d3660 2024-05-09T05:06:11.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.203+0000 7fdf5ec00640 1 -- 172.21.15.100:0/621163644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d3660 msgr2=0x7fdf580d3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.203+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d3660 0x7fdf580d3ac0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009870 tx=0x7fdf4402a270 comp rx=0 tx=0).stop 2024-05-09T05:06:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.204+0000 7fdf5ec00640 1 -- 172.21.15.100:0/621163644 shutdown_connections 2024-05-09T05:06:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.204+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d3660 0x7fdf580d3ac0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.204+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/621163644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf580b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.204+0000 7fdf5ec00640 1 -- 172.21.15.100:0/621163644 >> 172.21.15.100:0/621163644 conn(0x7fdf5808eb30 msgr2=0x7fdf5809e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.204+0000 7fdf5ec00640 1 -- 172.21.15.100:0/621163644 shutdown_connections 2024-05-09T05:06:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.204+0000 7fdf5ec00640 1 -- 172.21.15.100:0/621163644 wait complete. 2024-05-09T05:06:11.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.205+0000 7fdf5ec00640 1 Processor -- start 2024-05-09T05:06:11.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.206+0000 7fdf5ec00640 1 -- start start 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.206+0000 7fdf5ec00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf581554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 0x7fdf580b9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ec00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf580d3660 0x7fdf580ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580b5730 con 0x7fdf580d1a10 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ec00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580b5450 con 0x7fdf580d3660 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ec00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdf580d28d0 con 0x7fdf580b4530 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 0x7fdf580b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 0x7fdf580b9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52948/0 (socket says 172.21.15.100:52948) 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 -- 172.21.15.100:0/3446401159 learned_addr learned my addr 172.21.15.100:0/3446401159 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5d800640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf581554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 -- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 msgr2=0x7fdf581554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf581554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 -- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf580d3660 msgr2=0x7fdf580ba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf580d3660 0x7fdf580ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.207+0000 7fdf5ce00640 1 -- 172.21.15.100:0/3446401159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf580b7ff0 con 0x7fdf580d1a10 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.208+0000 7fdf5ce00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 0x7fdf580b9090 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdf44000c00 tx=0x7fdf440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.208+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44037040 con 0x7fdf580d1a10 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.208+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf44042070 con 0x7fdf580d1a10 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.208+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44030bd0 con 0x7fdf580d1a10 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.208+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf580b82d0 con 0x7fdf580d1a10 2024-05-09T05:06:11.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.208+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf580b8890 con 0x7fdf580d1a10 2024-05-09T05:06:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.209+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf5806a550 con 0x7fdf580d1a10 2024-05-09T05:06:11.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.210+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdf44047460 con 0x7fdf580d1a10 2024-05-09T05:06:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.211+0000 7fdf55600640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf38076300 0x7fdf380787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.211+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6172+0+0 (secure 0 0 0) 0x7fdf440b8480 con 0x7fdf580d1a10 2024-05-09T05:06:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.212+0000 7fdf5d800640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf38076300 0x7fdf380787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.212+0000 7fdf5d800640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf38076300 0x7fdf380787c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c008ee0 tx=0x7fdf4c008430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.216+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdf44081c00 con 0x7fdf580d1a10 2024-05-09T05:06:11.343 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:06:11.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:06:11.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.424+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf58068590 con 0x7fdf580d1a10 2024-05-09T05:06:11.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.426+0000 7fdf55600640 1 -- 172.21.15.100:0/3446401159 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+18568 (secure 0 0 0) 0x7fdf44081500 con 0x7fdf580d1a10 2024-05-09T05:06:11.427 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:11.427 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:06:09.974693+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data_extra1","create_time":"2024-05-09T05:06:09.113262+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf38076300 msgr2=0x7fdf380787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf38076300 0x7fdf380787c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c008ee0 tx=0x7fdf4c008430 comp rx=0 tx=0).stop 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 msgr2=0x7fdf580b9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 0x7fdf580b9090 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdf44000c00 tx=0x7fdf440046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 shutdown_connections 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdf38076300 0x7fdf380787c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf580d3660 0x7fdf580ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf580d1a10 0x7fdf580b9090 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 --2- 172.21.15.100:0/3446401159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf580b4530 0x7fdf581554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 >> 172.21.15.100:0/3446401159 conn(0x7fdf5808eb30 msgr2=0x7fdf580b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 shutdown_connections 2024-05-09T05:06:11.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.429+0000 7fdf5ec00640 1 -- 172.21.15.100:0/3446401159 wait complete. 2024-05-09T05:06:11.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:11.449 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_x) 2024-05-09T05:06:11.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:11.504 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v cephfs_data_extra1 dir_x) 2024-05-09T05:06:11.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:11.564 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_x/file_x) 2024-05-09T05:06:11.612 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-05-09T05:06:11.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.806+0000 7ff65d200640 1 Processor -- start 2024-05-09T05:06:11.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.807+0000 7ff65d200640 1 -- start start 2024-05-09T05:06:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.808+0000 7ff65d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6581458f0 0x7ff6580ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.808+0000 7ff65d200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff65806efc0 0x7ff6580726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.808+0000 7ff65d200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6580721e0 con 0x7ff6580ced90 2024-05-09T05:06:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.808+0000 7ff65d200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff65806f600 con 0x7ff6581458f0 2024-05-09T05:06:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.808+0000 7ff65d200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff65806f8e0 con 0x7ff65806efc0 2024-05-09T05:06:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.809+0000 7ff657400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6581458f0 0x7ff6580ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.809+0000 7ff657400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6581458f0 0x7ff6580ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52958/0 (socket says 172.21.15.100:52958) 2024-05-09T05:06:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.809+0000 7ff657400640 1 -- 172.21.15.100:0/1749064813 learned_addr learned my addr 172.21.15.100:0/1749064813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.809+0000 7ff657e00640 1 --2- 172.21.15.100:0/1749064813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff65806efc0 0x7ff6580726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.810+0000 7ff657e00640 1 -- 172.21.15.100:0/1749064813 >> v2:172.21.15.100:3300/0 conn(0x7ff6581458f0 msgr2=0x7ff6580ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.810+0000 7ff657e00640 1 --2- 172.21.15.100:0/1749064813 >> v2:172.21.15.100:3300/0 conn(0x7ff6581458f0 0x7ff6580ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.810+0000 7ff657e00640 1 -- 172.21.15.100:0/1749064813 >> v1:172.21.15.133:6789/0 conn(0x7ff6580ced90 legacy=0x7ff65806e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.810+0000 7ff657e00640 1 -- 172.21.15.100:0/1749064813 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65806fbc0 con 0x7ff65806efc0 2024-05-09T05:06:11.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.811+0000 7ff657e00640 1 --2- 172.21.15.100:0/1749064813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff65806efc0 0x7ff6580726e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45c7015b0139437a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.811+0000 7ff656000640 1 -- 172.21.15.100:0/1749064813 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650031600 con 0x7ff65806efc0 2024-05-09T05:06:11.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.811+0000 7ff656000640 1 -- 172.21.15.100:0/1749064813 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6500317a0 con 0x7ff65806efc0 2024-05-09T05:06:11.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.811+0000 7ff656000640 1 -- 172.21.15.100:0/1749064813 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650031b70 con 0x7ff65806efc0 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 -- 172.21.15.100:0/1749064813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff65806efc0 msgr2=0x7ff6580726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 --2- 172.21.15.100:0/1749064813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff65806efc0 0x7ff6580726e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65002a5d0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 -- 172.21.15.100:0/1749064813 shutdown_connections 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 --2- 172.21.15.100:0/1749064813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff65806efc0 0x7ff6580726e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 --2- 172.21.15.100:0/1749064813 >> v2:172.21.15.100:3300/0 conn(0x7ff6581458f0 0x7ff6580ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 -- 172.21.15.100:0/1749064813 >> 172.21.15.100:0/1749064813 conn(0x7ff6580b29b0 msgr2=0x7ff6580b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 -- 172.21.15.100:0/1749064813 shutdown_connections 2024-05-09T05:06:11.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.812+0000 7ff65d200640 1 -- 172.21.15.100:0/1749064813 wait complete. 2024-05-09T05:06:11.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.814+0000 7ff65d200640 1 Processor -- start 2024-05-09T05:06:11.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.814+0000 7ff65d200640 1 -- start start 2024-05-09T05:06:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff65d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 0x7ff65815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff65d200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6580ced90 0x7ff658157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff65d200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6581458f0 0x7ff658161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff65d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff658072da0 con 0x7ff65806efc0 2024-05-09T05:06:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff65d200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff658072c20 con 0x7ff6580ced90 2024-05-09T05:06:11.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff65d200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff658072f20 con 0x7ff6581458f0 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff657400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 0x7ff65815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff657400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 0x7ff65815fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52966/0 (socket says 172.21.15.100:52966) 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.815+0000 7ff657400640 1 -- 172.21.15.100:0/644340826 learned_addr learned my addr 172.21.15.100:0/644340826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657e00640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6581458f0 0x7ff658161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657400640 1 -- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6581458f0 msgr2=0x7ff658161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657400640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6581458f0 0x7ff658161460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657400640 1 -- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6580ced90 msgr2=0x7ff658157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657400640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6580ced90 0x7ff658157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657400640 1 -- 172.21.15.100:0/644340826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff658161c90 con 0x7ff65806efc0 2024-05-09T05:06:11.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff657400640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 0x7ff65815fb00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e870 tx=0x7ff64800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff64f400640 1 -- 172.21.15.100:0/644340826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648017070 con 0x7ff65806efc0 2024-05-09T05:06:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff64f400640 1 -- 172.21.15.100:0/644340826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64800c8e0 con 0x7ff65806efc0 2024-05-09T05:06:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff658161f70 con 0x7ff65806efc0 2024-05-09T05:06:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff64f400640 1 -- 172.21.15.100:0/644340826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64800ccd0 con 0x7ff65806efc0 2024-05-09T05:06:11.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.816+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff658162530 con 0x7ff65806efc0 2024-05-09T05:06:11.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.819+0000 7ff64f400640 1 -- 172.21.15.100:0/644340826 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff64801a070 con 0x7ff65806efc0 2024-05-09T05:06:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.820+0000 7ff64f400640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff6380762d0 0x7ff638078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.820+0000 7ff64f400640 1 -- 172.21.15.100:0/644340826 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6172+0+0 (secure 0 0 0) 0x7ff648097ab0 con 0x7ff65806efc0 2024-05-09T05:06:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.821+0000 7ff656a00640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff6380762d0 0x7ff638078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.821+0000 7ff661768740 1 Processor -- start 2024-05-09T05:06:11.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.821+0000 7ff661768740 1 -- start start 2024-05-09T05:06:11.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.821+0000 7ff656a00640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff6380762d0 0x7ff638078790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff644000f60 tx=0x7ff6440079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b763f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff661768740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 0x556843b4b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff661768740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556843ab0d50 con 0x556843b76930 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556843a55ef0 con 0x556843b77070 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x556843aacd10 con 0x556843b93f50 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff657e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 0x556843b4b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff657e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 0x556843b4b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52972/0 (socket says 172.21.15.100:52972) 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff657e00640 1 -- 172.21.15.100:0/726476773 learned_addr learned my addr 172.21.15.100:0/726476773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff657e00640 1 -- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 msgr2=0x556843b468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff657e00640 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.822+0000 7ff657e00640 1 -- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 msgr2=0x556843b763f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff656a00640 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff657e00640 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b763f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff657e00640 1 -- 172.21.15.100:0/726476773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55684388c7d0 con 0x556843b76930 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff657e00640 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 0x556843b4b740 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff650009b40 tx=0x7ff65002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e178788fd2a122f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff643e00640 1 -- 172.21.15.100:0/726476773 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650031780 con 0x556843b76930 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff643e00640 1 -- 172.21.15.100:0/726476773 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650040070 con 0x556843b76930 2024-05-09T05:06:11.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.823+0000 7ff643e00640 1 -- 172.21.15.100:0/726476773 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650031b40 con 0x556843b76930 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 -- 172.21.15.100:0/726476773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 msgr2=0x556843b4b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 0x556843b4b740 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff650009b40 tx=0x7ff65002e000 comp rx=0 tx=0).stop 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 -- 172.21.15.100:0/726476773 shutdown_connections 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b76930 0x556843b4b740 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b763f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 --2- 172.21.15.100:0/726476773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 -- 172.21.15.100:0/726476773 >> 172.21.15.100:0/726476773 conn(0x556843b48b50 msgr2=0x556843b913f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 -- 172.21.15.100:0/726476773 shutdown_connections 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.824+0000 7ff661768740 1 -- 172.21.15.100:0/726476773 wait complete. 2024-05-09T05:06:11.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.825+0000 7ff661768740 1 -- start start 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.825+0000 7ff661768740 1 Processor -- start 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b79130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 0x556843ba1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b8dc70 0x556843b92c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556843b4ad00 con 0x556843b93f50 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556843a69990 con 0x556843b77070 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x556843b4a0f0 con 0x556843b8dc70 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff661768740 10 client.0 _ll_register_callbacks cb 0x556843a68110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff656a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 0x556843ba1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff656a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 0x556843ba1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52988/0 (socket says 172.21.15.100:52988) 2024-05-09T05:06:11.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.826+0000 7ff656a00640 1 -- 172.21.15.100:0/3476050979 learned_addr learned my addr 172.21.15.100:0/3476050979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff657e00640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b8dc70 0x556843b92c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff656a00640 1 -- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b8dc70 msgr2=0x556843b92c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff656a00640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b8dc70 0x556843b92c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff656a00640 1 -- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 msgr2=0x556843b79130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff657400640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b79130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff656a00640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b79130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff656a00640 1 -- 172.21.15.100:0/3476050979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568437c23f0 con 0x556843b93f50 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff656a00640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 0x556843ba1580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff644014ea0 tx=0x7ff644001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edcebd1b88a6b14 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff640c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff640c00640 1 -- 172.21.15.100:0/3476050979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6440035f0 con 0x556843b93f50 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff640c00640 1 -- 172.21.15.100:0/3476050979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 6172+0+0 (secure 0 0 0) 0x7ff644022ca0 con 0x556843b93f50 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.827+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff650040070 con 0x556843b93f50 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff640c00640 1 -- 172.21.15.100:0/3476050979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff644003790 con 0x556843b93f50 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 10 client.5457 fetch_fsmap learned FSMap version 29 2024-05-09T05:06:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x5568437820f0 con 0x556843b93f50 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff640c00640 1 -- 172.21.15.100:0/3476050979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650040070 con 0x556843b93f50 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff640c00640 1 -- 172.21.15.100:0/3476050979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7ff644003930 con 0x556843b93f50 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 10 client.5457 fetch_fsmap finished waiting for FSMap version 29 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 10 client.5457 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 20 client.5457 populate_metadata read hostname 'smithi100' 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b78170 0x556843b785b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 4 client.5457 mds_command: new command op to 5286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.828+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 --> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556843ac4ef0 con 0x556843b78170 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.829+0000 7ff657400640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b78170 0x556843b785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.830+0000 7ff657400640 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b78170 0x556843b785b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec8f3e1bae33cb3c server_cookie=29fa53733b10a699 in_seq=0 out_seq=0 2024-05-09T05:06:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.830+0000 7ff640c00640 10 client.5457 ms_handle_connect on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:11.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff640c00640 1 -- 172.21.15.100:0/3476050979 <== mds.0 v2:172.21.15.133:6833/3578202714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556843ac4ef0 con 0x556843b78170 2024-05-09T05:06:11.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff640c00640 10 client.5457 handle_command_reply: tid=0 2024-05-09T05:06:11.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 client.5457 shutdown 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 msgr2=0x556843ba1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 0x556843ba1580 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff644014ea0 tx=0x7ff644001120 comp rx=0 tx=0).stop 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 shutdown_connections 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b78170 0x556843b785b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b8dc70 0x556843b92c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b93f50 0x556843ba1580 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 --2- 172.21.15.100:0/3476050979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843b79130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff640c00640 0 client.5457 ms_handle_reset on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 >> 172.21.15.100:0/3476050979 conn(0x556843b76930 msgr2=0x556843b913f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 shutdown_connections 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 1 -- 172.21.15.100:0/3476050979 wait complete. 2024-05-09T05:06:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.832+0000 7ff661768740 20 client.5457 trim_cache size 0 max 16384 2024-05-09T05:06:11.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.849+0000 7ff661768740 1 Processor -- start 2024-05-09T05:06:11.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.849+0000 7ff661768740 1 -- start start 2024-05-09T05:06:11.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff661768740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 0x556843b8fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b8dc70 0x556843b91a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b4c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff661768740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6582028c0 con 0x556843b77070 2024-05-09T05:06:11.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff6582018a0 con 0x556843b8dc70 2024-05-09T05:06:11.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff6580b2260 con 0x556843b93f50 2024-05-09T05:06:11.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 0x556843b8fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 0x556843b8fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40394/0 (socket says 172.21.15.100:40394) 2024-05-09T05:06:11.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 -- 172.21.15.100:0/1426827703 learned_addr learned my addr 172.21.15.100:0/1426827703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 -- 172.21.15.100:0/1426827703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 msgr2=0x556843b4c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b4c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 -- 172.21.15.100:0/1426827703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b8dc70 msgr2=0x556843b91a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b8dc70 0x556843b91a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.850+0000 7ff657400640 1 -- 172.21.15.100:0/1426827703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556843b90e10 con 0x556843b77070 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff657400640 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 0x556843b8fd10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff648060af0 tx=0x7ff648009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62a4656ca6db0e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff643400640 1 -- 172.21.15.100:0/1426827703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648021040 con 0x556843b77070 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff643400640 1 -- 172.21.15.100:0/1426827703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff648061260 con 0x556843b77070 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff643400640 1 -- 172.21.15.100:0/1426827703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648060b60 con 0x556843b77070 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 -- 172.21.15.100:0/1426827703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 msgr2=0x556843b8fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 0x556843b8fd10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff648060af0 tx=0x7ff648009330 comp rx=0 tx=0).stop 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 -- 172.21.15.100:0/1426827703 shutdown_connections 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b4c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b8dc70 0x556843b91a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 --2- 172.21.15.100:0/1426827703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b77070 0x556843b8fd10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.851+0000 7ff661768740 1 -- 172.21.15.100:0/1426827703 >> 172.21.15.100:0/1426827703 conn(0x556843b76930 msgr2=0x556843b8d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.852+0000 7ff661768740 1 -- 172.21.15.100:0/1426827703 shutdown_connections 2024-05-09T05:06:11.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.852+0000 7ff661768740 1 -- 172.21.15.100:0/1426827703 wait complete. 2024-05-09T05:06:11.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.852+0000 7ff661768740 1 -- start start 2024-05-09T05:06:11.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.852+0000 7ff661768740 1 Processor -- start 2024-05-09T05:06:11.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843c12160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 0x556843b70460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff658201280 con 0x556843b8dc70 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x556843b76ea0 con 0x556843b77070 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x556843b73910 con 0x556843b93f50 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.853+0000 7ff661768740 10 client.0 _ll_register_callbacks cb 0x7ff6440012c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 0x556843b70460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 0x556843b70460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40404/0 (socket says 172.21.15.100:40404) 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 -- 172.21.15.100:0/996620470 learned_addr learned my addr 172.21.15.100:0/996620470 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 -- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 msgr2=0x556843b709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff657400640 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843c12160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 -- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 msgr2=0x556843c12160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843c12160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 -- 172.21.15.100:0/996620470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556843b8e5d0 con 0x556843b8dc70 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff656a00640 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 0x556843b70460 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff644000fb0 tx=0x7ff644000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b264e8e737cdf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.854+0000 7ff640c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff640c00640 1 -- 172.21.15.100:0/996620470 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6440035f0 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff640c00640 1 -- 172.21.15.100:0/996620470 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 6172+0+0 (secure 0 0 0) 0x7ff644007220 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff648061260 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff640c00640 1 -- 172.21.15.100:0/996620470 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff644036050 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 10 client.5463 fetch_fsmap learned FSMap version 29 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x556843b9fdc0 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff640c00640 1 -- 172.21.15.100:0/996620470 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff648061260 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff640c00640 1 -- 172.21.15.100:0/996620470 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7ff644039020 con 0x556843b8dc70 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 10 client.5463 fetch_fsmap finished waiting for FSMap version 29 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 10 client.5463 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 20 client.5463 populate_metadata read hostname 'smithi100' 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b91d40 0x556843b94810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 4 client.5463 mds_command: new command op to 5286 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T05:06:11.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.855+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 --> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556843abe960 con 0x556843b91d40 2024-05-09T05:06:11.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.856+0000 7ff657400640 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b91d40 0x556843b94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:11.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.857+0000 7ff657400640 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b91d40 0x556843b94810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e9fea9b2f503af server_cookie=ce6a87dc2e53ba9 in_seq=0 out_seq=0 2024-05-09T05:06:11.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.857+0000 7ff640c00640 10 client.5463 ms_handle_connect on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.882+0000 7ff640c00640 1 -- 172.21.15.100:0/996620470 <== mds.0 v2:172.21.15.133:6833/3578202714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556843abe960 con 0x556843b91d40 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.882+0000 7ff640c00640 10 client.5463 handle_command_reply: tid=0 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.882+0000 7ff661768740 1 client.5463 shutdown 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 msgr2=0x556843b70460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 0x556843b70460 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff644000fb0 tx=0x7ff644000ed0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 shutdown_connections 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:6833/3578202714,v1:172.21.15.133:6835/3578202714] conn(0x556843b91d40 0x556843b94810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x556843b93f50 0x556843b709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556843b8dc70 0x556843b70460 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff640c00640 0 client.5463 ms_handle_reset on v2:172.21.15.133:6833/3578202714 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 --2- 172.21.15.100:0/996620470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x556843b77070 0x556843c12160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 >> 172.21.15.100:0/996620470 conn(0x556843b76930 msgr2=0x556843b8fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 shutdown_connections 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 1 -- 172.21.15.100:0/996620470 wait complete. 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.883+0000 7ff661768740 20 client.5463 trim_cache size 0 max 16384 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stdout: "message": "", 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0 2024-05-09T05:06:11.885 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:11.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff6380762d0 msgr2=0x7ff638078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff6380762d0 0x7ff638078790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff644000f60 tx=0x7ff6440079b0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 msgr2=0x7ff65815fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:11.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 0x7ff65815fb00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e870 tx=0x7ff64800ed30 comp rx=0 tx=0).stop 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 shutdown_connections 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff6380762d0 0x7ff638078790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6581458f0 0x7ff658161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6580ced90 0x7ff658157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 --2- 172.21.15.100:0/644340826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65806efc0 0x7ff65815fb00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 >> 172.21.15.100:0/644340826 conn(0x7ff6580b29b0 msgr2=0x7ff658143210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 shutdown_connections 2024-05-09T05:06:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:11.884+0000 7ff65d200640 1 -- 172.21.15.100:0/644340826 wait complete. 2024-05-09T05:06:11.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_extra2 --pg_num_min 64 2024-05-09T05:06:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.099+0000 7ffb08c00640 1 Processor -- start 2024-05-09T05:06:12.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.100+0000 7ffb08c00640 1 -- start start 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.101+0000 7ffb08c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb040d0500 0x7ffb0415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.101+0000 7ffb08c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04072ae0 0x7ffb04072f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.101+0000 7ffb08c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb040b6b60 con 0x7ffb0415d180 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.101+0000 7ffb08c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7ffb0406c3d0 con 0x7ffb040d0500 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.101+0000 7ffb08c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0406db50 con 0x7ffb04072ae0 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb03400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ffb0415d180 0x7ffb040b6450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54880/0 (socket says 172.21.15.100:54880) 2024-05-09T05:06:12.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb03400640 1 -- 172.21.15.100:0/1856095158 learned_addr learned my addr 172.21.15.100:0/1856095158 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1856095158 >> v2:172.21.15.133:3300/0 conn(0x7ffb040d0500 0x7ffb0415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517752229 0 0) 0x7ffb040b6b60 con 0x7ffb0415d180 2024-05-09T05:06:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb03e00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04072ae0 0x7ffb04072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae4003520 con 0x7ffb0415d180 2024-05-09T05:06:12.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2804781336 0 0) 0x7ffae4003520 con 0x7ffb0415d180 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04072ae0 msgr2=0x7ffb04072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.102+0000 7ffb02000640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04072ae0 0x7ffb04072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 >> v2:172.21.15.133:3300/0 conn(0x7ffb040d0500 msgr2=0x7ffb0415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 --2- 172.21.15.100:0/1856095158 >> v2:172.21.15.133:3300/0 conn(0x7ffb040d0500 0x7ffb0415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb040d0990 con 0x7ffb0415d180 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7ffaf40016f0 con 0x7ffb0415d180 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1856095158 >> v2:172.21.15.133:3300/0 conn(0x7ffb040d0500 0x7ffb0415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 >> v1:172.21.15.100:6789/0 conn(0x7ffb0415d180 legacy=0x7ffb040b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffae4003a00 0x7ffae4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffae4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffae4005210 0x7ffae400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0406c3d0 con 0x7ffae4004800 2024-05-09T05:06:12.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0406db50 con 0x7ffae4003a00 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ffae400c140 con 0x7ffae4005210 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb03e00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04072ae0 0x7ffb04072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffae4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.103+0000 7ffb03400640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffae4003a00 0x7ffae4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb03e00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffae4005210 0x7ffae400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb02a00640 1 -- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffae4005210 msgr2=0x7ffae400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffae4005210 0x7ffae400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb02a00640 1 -- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffae4003a00 msgr2=0x7ffae4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffae4003a00 0x7ffae4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb02a00640 1 -- 172.21.15.100:0/1856095158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae4003520 con 0x7ffae4004800 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.104+0000 7ffb03e00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffae4005210 0x7ffae400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.105+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffae4004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0073b0 tx=0x7ffae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bff597382af550 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.105+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec009c80 con 0x7ffae4004800 2024-05-09T05:06:12.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.105+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec02c650 con 0x7ffae4004800 2024-05-09T05:06:12.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.105+0000 7ffb02000640 1 -- 172.21.15.100:0/1856095158 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec02ca00 con 0x7ffae4004800 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb08c00640 1 -- 172.21.15.100:0/1856095158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 msgr2=0x7ffae4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1856095158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffae4004c80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0073b0 tx=0x7ffae4005830 comp rx=0 tx=0).stop 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb03e00640 1 -- 172.21.15.100:0/1856095158 reap_dead start 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb08c00640 1 -- 172.21.15.100:0/1856095158 shutdown_connections 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb08c00640 1 -- 172.21.15.100:0/1856095158 >> 172.21.15.100:0/1856095158 conn(0x7ffb040b3a10 msgr2=0x7ffb040d15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb08c00640 1 -- 172.21.15.100:0/1856095158 shutdown_connections 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.106+0000 7ffb08c00640 1 -- 172.21.15.100:0/1856095158 wait complete. 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.108+0000 7ffb08c00640 1 Processor -- start 2024-05-09T05:06:12.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.108+0000 7ffb08c00640 1 -- start start 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb08c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffb041f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb08c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb04155db0 0x7ffb04154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb08c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04156230 0x7ffb041552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb08c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04072f70 con 0x7ffae4004800 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb08c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040d0f50 con 0x7ffb04155db0 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb08c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ffb040730f0 con 0x7ffb04156230 2024-05-09T05:06:12.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffb041f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffb041f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40432/0 (socket says 172.21.15.100:40432) 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 -- 172.21.15.100:0/1231737704 learned_addr learned my addr 172.21.15.100:0/1231737704 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 -- 172.21.15.100:0/1231737704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04156230 msgr2=0x7ffb041552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04156230 0x7ffb041552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 -- 172.21.15.100:0/1231737704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb04155db0 msgr2=0x7ffb04154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb04155db0 0x7ffb04154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.109+0000 7ffb03400640 1 -- 172.21.15.100:0/1231737704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb04156790 con 0x7ffae4004800 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.110+0000 7ffb03400640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffb041f8870 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400e7e0 tx=0x7ffaf400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.110+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400c850 con 0x7ffae4004800 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.110+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4018070 con 0x7ffae4004800 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.110+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400cc50 con 0x7ffae4004800 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.110+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb04156a70 con 0x7ffae4004800 2024-05-09T05:06:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.110+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb04157030 con 0x7ffae4004800 2024-05-09T05:06:12.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.112+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb0406a630 con 0x7ffae4004800 2024-05-09T05:06:12.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.113+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffaf401d460 con 0x7ffae4004800 2024-05-09T05:06:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.114+0000 7ffafb400640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffae00762d0 0x7ffae0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.114+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6172+0+0 (secure 0 0 0) 0x7ffaf4097570 con 0x7ffae4004800 2024-05-09T05:06:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.114+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffae00762d0 0x7ffae0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.115+0000 7ffb02a00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffae00762d0 0x7ffae0078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffaec035000 tx=0x7ffaec02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.118+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffaf4060d90 con 0x7ffae4004800 2024-05-09T05:06:12.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.321+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_extra2", "pg_num_min": 64} v 0) -- 0x7ffb041e4eb0 con 0x7ffae4004800 2024-05-09T05:06:12.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.533+0000 7ffafb400640 1 -- 172.21.15.100:0/1231737704 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_extra2", "pg_num_min": 64}]=0 pool 'cephfs_data_extra2' created v53) ==== 144+0+0 (secure 0 0 0) 0x7ffaf4060690 con 0x7ffae4004800 2024-05-09T05:06:12.535 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_extra2' created 2024-05-09T05:06:12.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffae00762d0 msgr2=0x7ffae0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffae00762d0 0x7ffae0078790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffaec035000 tx=0x7ffaec02f000 comp rx=0 tx=0).stop 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 msgr2=0x7ffb041f8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffb041f8870 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400e7e0 tx=0x7ffaf400eca0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 shutdown_connections 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffae00762d0 0x7ffae0078790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffb04156230 0x7ffb041552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb04155db0 0x7ffb04154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 --2- 172.21.15.100:0/1231737704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffae4004800 0x7ffb041f8870 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.537+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 >> 172.21.15.100:0/1231737704 conn(0x7ffb040b3a10 msgr2=0x7ffb041e7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.538+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 shutdown_connections 2024-05-09T05:06:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.538+0000 7ffb08c00640 1 -- 172.21.15.100:0/1231737704 wait complete. 2024-05-09T05:06:12.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_extra2 2024-05-09T05:06:12.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.752+0000 7f2ad6200640 1 Processor -- start 2024-05-09T05:06:12.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.752+0000 7f2ad6200640 1 -- start start 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.753+0000 7f2ad6200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ad006f590 0x7f2ad006f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.753+0000 7f2ad6200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ad00ae350 0x7f2ad00ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.753+0000 7f2ad6200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad006feb0 con 0x7f2ad015c640 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.753+0000 7f2ad6200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad00cdd30 con 0x7f2ad00ae350 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.753+0000 7f2ad6200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad00ce010 con 0x7f2ad006f590 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ad00ae350 0x7f2ad00ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ad00ae350 0x7f2ad00ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40436/0 (socket says 172.21.15.100:40436) 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 -- 172.21.15.100:0/3828417261 learned_addr learned my addr 172.21.15.100:0/3828417261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acf400640 1 --2- 172.21.15.100:0/3828417261 >> v2:172.21.15.133:3300/0 conn(0x7f2ad006f590 0x7f2ad006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 -- 172.21.15.100:0/3828417261 >> v2:172.21.15.133:3300/0 conn(0x7f2ad006f590 msgr2=0x7f2ad006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 --2- 172.21.15.100:0/3828417261 >> v2:172.21.15.133:3300/0 conn(0x7f2ad006f590 0x7f2ad006f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 -- 172.21.15.100:0/3828417261 >> v1:172.21.15.133:6789/0 conn(0x7f2ad015c640 legacy=0x7f2ad00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acfe00640 1 -- 172.21.15.100:0/3828417261 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad00ce2f0 con 0x7f2ad00ae350 2024-05-09T05:06:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.754+0000 7f2acf400640 1 --2- 172.21.15.100:0/3828417261 >> v2:172.21.15.133:3300/0 conn(0x7f2ad006f590 0x7f2ad006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.755+0000 7f2acfe00640 1 --2- 172.21.15.100:0/3828417261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00ae350 0x7f2ad00ae800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2ad006d8b0 tx=0x7f2ac802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05ab097e2979606 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ace000640 1 -- 172.21.15.100:0/3828417261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8036070 con 0x7f2ad00ae350 2024-05-09T05:06:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ace000640 1 -- 172.21.15.100:0/3828417261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac8031600 con 0x7f2ad00ae350 2024-05-09T05:06:12.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ace000640 1 -- 172.21.15.100:0/3828417261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80319d0 con 0x7f2ad00ae350 2024-05-09T05:06:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 -- 172.21.15.100:0/3828417261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00ae350 msgr2=0x7f2ad00ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 --2- 172.21.15.100:0/3828417261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00ae350 0x7f2ad00ae800 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2ad006d8b0 tx=0x7f2ac802a610 comp rx=0 tx=0).stop 2024-05-09T05:06:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 -- 172.21.15.100:0/3828417261 shutdown_connections 2024-05-09T05:06:12.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 --2- 172.21.15.100:0/3828417261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00ae350 0x7f2ad00ae800 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 --2- 172.21.15.100:0/3828417261 >> v2:172.21.15.133:3300/0 conn(0x7f2ad006f590 0x7f2ad006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 -- 172.21.15.100:0/3828417261 >> 172.21.15.100:0/3828417261 conn(0x7f2ad00b2c90 msgr2=0x7f2ad00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.756+0000 7f2ad6200640 1 -- 172.21.15.100:0/3828417261 shutdown_connections 2024-05-09T05:06:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.757+0000 7f2ad6200640 1 -- 172.21.15.100:0/3828417261 wait complete. 2024-05-09T05:06:12.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.758+0000 7f2ad6200640 1 Processor -- start 2024-05-09T05:06:12.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.758+0000 7f2ad6200640 1 -- start start 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2ad6200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad006f590 0x7f2ad0155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2ad6200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00ae350 0x7f2ad0149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2ad6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 0x7f2ad0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2ad6200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad00cdaf0 con 0x7f2ad015c640 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2ad6200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad00cd970 con 0x7f2ad00ae350 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2ad6200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad00d0660 con 0x7f2ad006f590 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.759+0000 7f2acfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 0x7f2ad0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 0x7f2ad0157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40452/0 (socket says 172.21.15.100:40452) 2024-05-09T05:06:12.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 -- 172.21.15.100:0/4091485633 learned_addr learned my addr 172.21.15.100:0/4091485633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:12.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acf400640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad006f590 0x7f2ad0155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acea00640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00ae350 0x7f2ad0149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 -- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad006f590 msgr2=0x7f2ad0155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad006f590 0x7f2ad0155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 -- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00ae350 msgr2=0x7f2ad0149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00ae350 0x7f2ad0149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 -- 172.21.15.100:0/4091485633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01543a0 con 0x7f2ad015c640 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.760+0000 7f2acfe00640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 0x7f2ad0157f50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8034040 tx=0x7f2ac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.761+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8036050 con 0x7f2ad015c640 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.761+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac8042070 con 0x7f2ad015c640 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.761+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8009510 con 0x7f2ad015c640 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.761+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad0154680 con 0x7f2ad015c640 2024-05-09T05:06:12.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.761+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad0154c40 con 0x7f2ad015c640 2024-05-09T05:06:12.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.762+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad006a630 con 0x7f2ad015c640 2024-05-09T05:06:12.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.763+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ac8007bf0 con 0x7f2ad015c640 2024-05-09T05:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.764+0000 7f2ac7400640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ab0076300 0x7f2ab00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.764+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6545+0+0 (secure 0 0 0) 0x7f2ac80b9420 con 0x7f2ad015c640 2024-05-09T05:06:12.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.765+0000 7f2acf400640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ab0076300 0x7f2ab00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:12.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.765+0000 7f2acf400640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ab0076300 0x7f2ab00787c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0008850 tx=0x7f2ac0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:12.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:12.769+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2ac8082aa0 con 0x7f2ad015c640 2024-05-09T05:06:13.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.014+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra2"} v 0) -- 0x7f2ad00b0410 con 0x7f2ad015c640 2024-05-09T05:06:13.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.546+0000 7f2ac7400640 1 -- 172.21.15.100:0/4091485633 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra2"}]=0 added data pool 10 to fsmap v30) ==== 142+0+0 (secure 0 0 0) 0x7f2ac80823a0 con 0x7f2ad015c640 2024-05-09T05:06:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 10 to fsmap 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ab0076300 msgr2=0x7f2ab00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ab0076300 0x7f2ab00787c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0008850 tx=0x7f2ac0008040 comp rx=0 tx=0).stop 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 msgr2=0x7f2ad0157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 0x7f2ad0157f50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8034040 tx=0x7f2ac8004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 shutdown_connections 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2ab0076300 0x7f2ab00787c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad015c640 0x7f2ad0157f50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ad00ae350 0x7f2ad0149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 --2- 172.21.15.100:0/4091485633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ad006f590 0x7f2ad0155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.552+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 >> 172.21.15.100:0/4091485633 conn(0x7f2ad00b2c90 msgr2=0x7f2ad00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:13.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.553+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 shutdown_connections 2024-05-09T05:06:13.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.553+0000 7f2ad6200640 1 -- 172.21.15.100:0/4091485633 wait complete. 2024-05-09T05:06:13.581 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:13.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.755+0000 7fdd39000640 1 Processor -- start 2024-05-09T05:06:13.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.755+0000 7fdd39000640 1 -- start start 2024-05-09T05:06:13.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd39000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd341456c0 0x7fdd3415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd39000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd3406f570 0x7fdd3406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd39000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd3415d730 con 0x7fdd3415fb60 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd39000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdd340cfb40 con 0x7fdd341456c0 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd39000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fdd3415d530 con 0x7fdd3406f570 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd33400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd341456c0 0x7fdd3415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd33e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdd3415fb60 0x7fdd3415ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54888/0 (socket says 172.21.15.100:54888) 2024-05-09T05:06:13.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.757+0000 7fdd33e00640 1 -- 172.21.15.100:0/3026664333 learned_addr learned my addr 172.21.15.100:0/3026664333 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.758+0000 7fdd33400640 1 -- 172.21.15.100:0/3026664333 >> v2:172.21.15.133:3300/0 conn(0x7fdd3406f570 msgr2=0x7fdd3406f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.758+0000 7fdd32a00640 1 --2- 172.21.15.100:0/3026664333 >> v2:172.21.15.133:3300/0 conn(0x7fdd3406f570 0x7fdd3406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.758+0000 7fdd33400640 1 --2- 172.21.15.100:0/3026664333 >> v2:172.21.15.133:3300/0 conn(0x7fdd3406f570 0x7fdd3406f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.758+0000 7fdd33400640 1 -- 172.21.15.100:0/3026664333 >> v1:172.21.15.100:6789/0 conn(0x7fdd3415fb60 legacy=0x7fdd3415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.758+0000 7fdd33400640 1 -- 172.21.15.100:0/3026664333 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd340cef30 con 0x7fdd341456c0 2024-05-09T05:06:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.758+0000 7fdd32000640 1 -- 172.21.15.100:0/3026664333 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667219808 0 0) 0x7fdd2c001110 con 0x7fdd3415fb60 2024-05-09T05:06:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.759+0000 7fdd33400640 1 --2- 172.21.15.100:0/3026664333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd3415cff0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdd34073180 tx=0x7fdd2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f60f22cae059ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.759+0000 7fdd32000640 1 -- 172.21.15.100:0/3026664333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24037070 con 0x7fdd341456c0 2024-05-09T05:06:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.759+0000 7fdd32000640 1 -- 172.21.15.100:0/3026664333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd24032440 con 0x7fdd341456c0 2024-05-09T05:06:13.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.759+0000 7fdd32000640 1 -- 172.21.15.100:0/3026664333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24032810 con 0x7fdd341456c0 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.759+0000 7fdd39000640 1 -- 172.21.15.100:0/3026664333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 msgr2=0x7fdd3415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.759+0000 7fdd39000640 1 --2- 172.21.15.100:0/3026664333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd3415cff0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdd34073180 tx=0x7fdd2402a1a0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.760+0000 7fdd39000640 1 -- 172.21.15.100:0/3026664333 shutdown_connections 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.760+0000 7fdd39000640 1 --2- 172.21.15.100:0/3026664333 >> v2:172.21.15.133:3300/0 conn(0x7fdd3406f570 0x7fdd3406f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.760+0000 7fdd39000640 1 --2- 172.21.15.100:0/3026664333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd3415cff0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.760+0000 7fdd39000640 1 -- 172.21.15.100:0/3026664333 >> 172.21.15.100:0/3026664333 conn(0x7fdd3406c7f0 msgr2=0x7fdd3406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.760+0000 7fdd39000640 1 -- 172.21.15.100:0/3026664333 shutdown_connections 2024-05-09T05:06:13.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.760+0000 7fdd39000640 1 -- 172.21.15.100:0/3026664333 wait complete. 2024-05-09T05:06:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.761+0000 7fdd39000640 1 Processor -- start 2024-05-09T05:06:13.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.761+0000 7fdd39000640 1 -- start start 2024-05-09T05:06:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.762+0000 7fdd39000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd3406f570 0x7fdd341671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.762+0000 7fdd39000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd341411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:13.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.762+0000 7fdd39000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd3415fb60 0x7fdd340739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.762+0000 7fdd39000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd340cf7d0 con 0x7fdd341456c0 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.762+0000 7fdd39000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdd340cf4f0 con 0x7fdd3406f570 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.762+0000 7fdd39000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdd340cec00 con 0x7fdd3415fb60 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd341411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd341411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40464/0 (socket says 172.21.15.100:40464) 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 -- 172.21.15.100:0/2675473368 learned_addr learned my addr 172.21.15.100:0/2675473368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd33400640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd3406f570 0x7fdd341671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 -- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd3415fb60 msgr2=0x7fdd340739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd3415fb60 0x7fdd340739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 -- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd3406f570 msgr2=0x7fdd341671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd3406f570 0x7fdd341671d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 -- 172.21.15.100:0/2675473368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd34166170 con 0x7fdd341456c0 2024-05-09T05:06:13.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd33400640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd3406f570 0x7fdd341671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.763+0000 7fdd32a00640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd341411a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00ccd0 tx=0x7fdd1c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.764+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c003990 con 0x7fdd341456c0 2024-05-09T05:06:13.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.764+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c003b30 con 0x7fdd341456c0 2024-05-09T05:06:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.764+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c004020 con 0x7fdd341456c0 2024-05-09T05:06:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.764+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd34166410 con 0x7fdd341456c0 2024-05-09T05:06:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.764+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341669d0 con 0x7fdd341456c0 2024-05-09T05:06:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.765+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3406a550 con 0x7fdd341456c0 2024-05-09T05:06:13.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.766+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd1c0041c0 con 0x7fdd341456c0 2024-05-09T05:06:13.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.767+0000 7fdd2b400640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdd100762d0 0x7fdd10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:13.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.767+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6577+0+0 (secure 0 0 0) 0x7fdd1c097e10 con 0x7fdd341456c0 2024-05-09T05:06:13.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.767+0000 7fdd33400640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdd100762d0 0x7fdd10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:13.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.768+0000 7fdd33400640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdd100762d0 0x7fdd10078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd24034000 tx=0x7fdd2402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:13.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:13.772+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd1c09b030 con 0x7fdd341456c0 2024-05-09T05:06:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.022+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd34072cd0 con 0x7fdd341456c0 2024-05-09T05:06:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.023+0000 7fdd2b400640 1 -- 172.21.15.100:0/2675473368 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5198 (secure 0 0 0) 0x7fdd1c014030 con 0x7fdd341456c0 2024-05-09T05:06:14.024 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:14.024 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:13.016822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8,9,10],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:14.025 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2024-05-09T05:06:14.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.026+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdd100762d0 msgr2=0x7fdd10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.026+0000 7fdd39000640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdd100762d0 0x7fdd10078790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd24034000 tx=0x7fdd2402e000 comp rx=0 tx=0).stop 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.026+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 msgr2=0x7fdd341411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.026+0000 7fdd39000640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd341411a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00ccd0 tx=0x7fdd1c00a5c0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 shutdown_connections 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdd100762d0 0x7fdd10078790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd3415fb60 0x7fdd340739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd341456c0 0x7fdd341411a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 --2- 172.21.15.100:0/2675473368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd3406f570 0x7fdd341671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 >> 172.21.15.100:0/2675473368 conn(0x7fdd3406c7f0 msgr2=0x7fdd3406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 shutdown_connections 2024-05-09T05:06:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.027+0000 7fdd39000640 1 -- 172.21.15.100:0/2675473368 wait complete. 2024-05-09T05:06:14.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:14.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.252+0000 7fc49f000640 1 Processor -- start 2024-05-09T05:06:14.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.252+0000 7fc49f000640 1 -- start start 2024-05-09T05:06:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.253+0000 7fc49f000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498073840 0x7fc498073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.253+0000 7fc49f000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4980aee10 0x7fc4980af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.253+0000 7fc49f000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc49806f390 con 0x7fc49806fd60 2024-05-09T05:06:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.253+0000 7fc49f000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fc49806e810 con 0x7fc4980aee10 2024-05-09T05:06:14.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.253+0000 7fc49f000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc49806eaf0 con 0x7fc498073840 2024-05-09T05:06:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc497e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc49806fd60 0x7fc498070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54898/0 (socket says 172.21.15.100:54898) 2024-05-09T05:06:14.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc497e00640 1 -- 172.21.15.100:0/2927626844 learned_addr learned my addr 172.21.15.100:0/2927626844 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc49d000640 1 --2- 172.21.15.100:0/2927626844 >> v2:172.21.15.133:3300/0 conn(0x7fc4980aee10 0x7fc4980af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc497400640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498073840 0x7fc498073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396312849 0 0) 0x7fc49806f390 con 0x7fc49806fd60 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc47c003520 con 0x7fc49806fd60 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.254+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717599693 0 0) 0x7fc47c003520 con 0x7fc49806fd60 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498073840 msgr2=0x7fc498073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498073840 0x7fc498073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 >> v2:172.21.15.133:3300/0 conn(0x7fc4980aee10 msgr2=0x7fc4980af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 --2- 172.21.15.100:0/2927626844 >> v2:172.21.15.133:3300/0 conn(0x7fc4980aee10 0x7fc4980af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49806edd0 con 0x7fc49806fd60 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fc4800016f0 con 0x7fc49806fd60 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 >> v1:172.21.15.100:6789/0 conn(0x7fc49806fd60 legacy=0x7fc498070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc47c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc47c004800 0x7fc47c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0051c0 0x7fc47c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc49806e810 con 0x7fc47c003a50 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc49806eaf0 con 0x7fc47c0051c0 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c00e240 con 0x7fc47c004800 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc497400640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498073840 0x7fc498073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc497e00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc47c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.255+0000 7fc49d000640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0051c0 0x7fc47c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497e00640 1 -- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc47c004800 msgr2=0x7fc47c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497400640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc47c004800 0x7fc47c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497e00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc47c004800 0x7fc47c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497e00640 1 -- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0051c0 msgr2=0x7fc47c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497e00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0051c0 0x7fc47c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497e00640 1 -- 172.21.15.100:0/2927626844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c003520 con 0x7fc47c003a50 2024-05-09T05:06:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc497400640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc47c004800 0x7fc47c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.256+0000 7fc49d000640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0051c0 0x7fc47c00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.257+0000 7fc497e00640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc47c003e70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c190 tx=0x7fc47c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6191038b68f4794 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.257+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480007cc0 con 0x7fc47c003a50 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.257+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc480005ad0 con 0x7fc47c003a50 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.257+0000 7fc496a00640 1 -- 172.21.15.100:0/2927626844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480007070 con 0x7fc47c003a50 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.257+0000 7fc49f000640 1 -- 172.21.15.100:0/2927626844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 msgr2=0x7fc47c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.257+0000 7fc49f000640 1 --2- 172.21.15.100:0/2927626844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc47c003e70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c190 tx=0x7fc47c005830 comp rx=0 tx=0).stop 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.258+0000 7fc49d000640 1 -- 172.21.15.100:0/2927626844 reap_dead start 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.258+0000 7fc49f000640 1 -- 172.21.15.100:0/2927626844 shutdown_connections 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.258+0000 7fc49f000640 1 -- 172.21.15.100:0/2927626844 >> 172.21.15.100:0/2927626844 conn(0x7fc4980b31e0 msgr2=0x7fc4980d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.258+0000 7fc49f000640 1 -- 172.21.15.100:0/2927626844 shutdown_connections 2024-05-09T05:06:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.258+0000 7fc49f000640 1 -- 172.21.15.100:0/2927626844 wait complete. 2024-05-09T05:06:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.259+0000 7fc49f000640 1 Processor -- start 2024-05-09T05:06:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.260+0000 7fc49f000640 1 -- start start 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc49f000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc498158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc49f000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498147ab0 0x7fc49809c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc49f000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc498158e90 0x7fc49809c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc49f000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc498159f00 con 0x7fc47c003a50 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc49f000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc49806e4a0 con 0x7fc498158e90 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc49f000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc4981584c0 con 0x7fc498147ab0 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc498158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc498158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40474/0 (socket says 172.21.15.100:40474) 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 -- 172.21.15.100:0/3613368233 learned_addr learned my addr 172.21.15.100:0/3613368233 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 -- 172.21.15.100:0/3613368233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498147ab0 msgr2=0x7fc49809c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498147ab0 0x7fc49809c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 -- 172.21.15.100:0/3613368233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc498158e90 msgr2=0x7fc49809c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc498158e90 0x7fc49809c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.261+0000 7fc497e00640 1 -- 172.21.15.100:0/3613368233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc498157b90 con 0x7fc47c003a50 2024-05-09T05:06:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.262+0000 7fc497e00640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc498158950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc48002ac70 tx=0x7fc480001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.262+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480043070 con 0x7fc47c003a50 2024-05-09T05:06:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.262+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc480038040 con 0x7fc47c003a50 2024-05-09T05:06:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.262+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc498157e70 con 0x7fc47c003a50 2024-05-09T05:06:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.262+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480007290 con 0x7fc47c003a50 2024-05-09T05:06:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.262+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc498157840 con 0x7fc47c003a50 2024-05-09T05:06:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.263+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc498076070 con 0x7fc47c003a50 2024-05-09T05:06:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.265+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc480007430 con 0x7fc47c003a50 2024-05-09T05:06:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.265+0000 7fc48fe00640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc474076300 0x7fc4740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.266+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6577+0+0 (secure 0 0 0) 0x7fc4800b76b0 con 0x7fc47c003a50 2024-05-09T05:06:14.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.266+0000 7fc497400640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc474076300 0x7fc4740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.266+0000 7fc497400640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc474076300 0x7fc4740787c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc4981595a0 tx=0x7fc4880039b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:14.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.270+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc480080d30 con 0x7fc47c003a50 2024-05-09T05:06:14.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.476+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc49806a5c0 con 0x7fc47c003a50 2024-05-09T05:06:14.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.480+0000 7fc48fe00640 1 -- 172.21.15.100:0/3613368233 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+20388 (secure 0 0 0) 0x7fc480080630 con 0x7fc47c003a50 2024-05-09T05:06:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:14.481 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":54,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:06:13.016292+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data_extra1","create_time":"2024-05-09T05:06:09.113262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra2","create_time":"2024-05-09T05:06:12.336629+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:14.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc474076300 msgr2=0x7fc4740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc474076300 0x7fc4740787c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc4981595a0 tx=0x7fc4880039b0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 msgr2=0x7fc498158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc498158950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc48002ac70 tx=0x7fc480001930 comp rx=0 tx=0).stop 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 shutdown_connections 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc474076300 0x7fc4740787c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc498158e90 0x7fc49809c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc498147ab0 0x7fc49809c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 --2- 172.21.15.100:0/3613368233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47c003a50 0x7fc498158950 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 >> 172.21.15.100:0/3613368233 conn(0x7fc4980b31e0 msgr2=0x7fc498153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 shutdown_connections 2024-05-09T05:06:14.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:14.483+0000 7fc49f000640 1 -- 172.21.15.100:0/3613368233 wait complete. 2024-05-09T05:06:14.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:14.503 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v cephfs_data_extra2 dir_x/file_x) 2024-05-09T05:06:14.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:14.568 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -x ceph.dir.layout.pool dir_x) 2024-05-09T05:06:14.616 INFO:teuthology.orchestra.run.smithi100.stderr:setfattr: dir_x: No such attribute 2024-05-09T05:06:14.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:06:14.617 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-09T05:06:14.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:06:14.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-09T05:06:14.828 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-09T05:06:14.828 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:06:14.828 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:06:14.828 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:14.882 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:06:14.882 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:14.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T05:06:15.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.134+0000 7fdeba600640 1 Processor -- start 2024-05-09T05:06:15.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.135+0000 7fdeba600640 1 -- start start 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.136+0000 7fdeba600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.136+0000 7fdeba600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdeb40ae350 0x7fdeb40ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.136+0000 7fdeba600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb406feb0 con 0x7fdeb415c640 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.136+0000 7fdeba600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb40cdd30 con 0x7fdeb40ae350 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.136+0000 7fdeba600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb40ce010 con 0x7fdeb406f590 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.137+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.137+0000 7fdeb3e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdeb40ae350 0x7fdeb40ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.137+0000 7fdeb3400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb406f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:36960/0 (socket says 172.21.15.100:36960) 2024-05-09T05:06:15.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.137+0000 7fdeb3400640 1 -- 172.21.15.100:0/3937797317 learned_addr learned my addr 172.21.15.100:0/3937797317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:15.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.138+0000 7fdeb3e00640 1 -- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 msgr2=0x7fdeb406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:15.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.138+0000 7fdeb3e00640 1 --2- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb406f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.138+0000 7fdeb3e00640 1 -- 172.21.15.100:0/3937797317 >> v1:172.21.15.133:6789/0 conn(0x7fdeb415c640 legacy=0x7fdeb40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.138+0000 7fdeb3e00640 1 -- 172.21.15.100:0/3937797317 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb40ce2f0 con 0x7fdeb40ae350 2024-05-09T05:06:15.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.138+0000 7fdeb3400640 1 --2- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:06:15.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.139+0000 7fdeb3e00640 1 --2- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb40ae800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009dc0 tx=0x7fdeac02a5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc73df3064ed51 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeb2000640 1 -- 172.21.15.100:0/3937797317 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac007740 con 0x7fdeb40ae350 2024-05-09T05:06:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeb2000640 1 -- 172.21.15.100:0/3937797317 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac0078e0 con 0x7fdeb40ae350 2024-05-09T05:06:15.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeb2000640 1 -- 172.21.15.100:0/3937797317 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac007cb0 con 0x7fdeb40ae350 2024-05-09T05:06:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeba600640 1 -- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 msgr2=0x7fdeb40ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeba600640 1 --2- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb40ae800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009dc0 tx=0x7fdeac02a5e0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeba600640 1 -- 172.21.15.100:0/3937797317 shutdown_connections 2024-05-09T05:06:15.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeba600640 1 --2- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb40ae800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeba600640 1 --2- 172.21.15.100:0/3937797317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.140+0000 7fdeba600640 1 -- 172.21.15.100:0/3937797317 >> 172.21.15.100:0/3937797317 conn(0x7fdeb40b2c90 msgr2=0x7fdeb40b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:15.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.141+0000 7fdeba600640 1 -- 172.21.15.100:0/3937797317 shutdown_connections 2024-05-09T05:06:15.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.141+0000 7fdeba600640 1 -- 172.21.15.100:0/3937797317 wait complete. 2024-05-09T05:06:15.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.143+0000 7fdeba600640 1 Processor -- start 2024-05-09T05:06:15.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.143+0000 7fdeba600640 1 -- start start 2024-05-09T05:06:15.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeba600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeba600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb414f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeba600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 0x7fdeb415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeba600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40cdaf0 con 0x7fdeb415c640 2024-05-09T05:06:15.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeba600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40cd970 con 0x7fdeb40ae350 2024-05-09T05:06:15.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeba600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb40d0660 con 0x7fdeb406f590 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.144+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 0x7fdeb415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 0x7fdeb415b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40476/0 (socket says 172.21.15.100:40476) 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 -- 172.21.15.100:0/823041419 learned_addr learned my addr 172.21.15.100:0/823041419 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb2a00640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb414f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 -- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 msgr2=0x7fdeb415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3400640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb415ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 -- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 msgr2=0x7fdeb414f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb414f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb3e00640 1 -- 172.21.15.100:0/823041419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb415f3d0 con 0x7fdeb415c640 2024-05-09T05:06:15.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.145+0000 7fdeb2a00640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb414f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:15.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.146+0000 7fdeb3e00640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 0x7fdeb415b670 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdeac02abd0 tx=0x7fdeac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:15.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.146+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac040070 con 0x7fdeb415c640 2024-05-09T05:06:15.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.146+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeac031bc0 con 0x7fdeb415c640 2024-05-09T05:06:15.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.146+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac009450 con 0x7fdeb415c640 2024-05-09T05:06:15.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.146+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb415f6b0 con 0x7fdeb415c640 2024-05-09T05:06:15.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.146+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb4157500 con 0x7fdeb415c640 2024-05-09T05:06:15.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.147+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb415f8b0 con 0x7fdeb415c640 2024-05-09T05:06:15.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.148+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdeac039040 con 0x7fdeb415c640 2024-05-09T05:06:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.149+0000 7fdeab400640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fde940762d0 0x7fde94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.149+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7fdeac0b9230 con 0x7fdeb415c640 2024-05-09T05:06:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.150+0000 7fdeb3400640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fde940762d0 0x7fde94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.150+0000 7fdeb3400640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fde940762d0 0x7fde94078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009a90 tx=0x7fdea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:15.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.154+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdeac082140 con 0x7fdeb415c640 2024-05-09T05:06:15.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.373+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdeb406a630 con 0x7fdeb415c640 2024-05-09T05:06:15.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.374+0000 7fdeab400640 1 -- 172.21.15.100:0/823041419 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) ==== 80+0+0 (secure 0 0 0) 0x7fdeac0a3080 con 0x7fdeb415c640 2024-05-09T05:06:15.375 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.377+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fde940762d0 msgr2=0x7fde94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.377+0000 7fdeba600640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fde940762d0 0x7fde94078790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009a90 tx=0x7fdea4008040 comp rx=0 tx=0).stop 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.377+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 msgr2=0x7fdeb415b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.377+0000 7fdeba600640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 0x7fdeb415b670 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdeac02abd0 tx=0x7fdeac004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 shutdown_connections 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fde940762d0 0x7fde94078790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeb415c640 0x7fdeb415b670 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeb40ae350 0x7fdeb414f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 --2- 172.21.15.100:0/823041419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdeb406f590 0x7fdeb415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 >> 172.21.15.100:0/823041419 conn(0x7fdeb40b2c90 msgr2=0x7fdeb40ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:15.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 shutdown_connections 2024-05-09T05:06:15.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.378+0000 7fdeba600640 1 -- 172.21.15.100:0/823041419 wait complete. 2024-05-09T05:06:15.398 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T05:06:15.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:15.398 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T05:06:15.529 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:06:15.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:15.529 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T05:06:15.575 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:06:15.575 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:06:15.575 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:15.616 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:06:15.616 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:06:15.616 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:06:15.616 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:15.655 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052691,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248964k,nr_inodes=812241,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-09T05:06:15.655 INFO:tasks.cephfs.mount:Terminating background process 2024-05-09T05:06:15.655 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:06:15.656 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:15.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:06:15.703 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.903+0000 7eff2be00640 1 Processor -- start 2024-05-09T05:06:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.903+0000 7eff2be00640 1 -- start start 2024-05-09T05:06:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.905+0000 7eff2be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff24073840 0x7eff24073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.905+0000 7eff2be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2406f390 con 0x7eff240aee10 2024-05-09T05:06:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.905+0000 7eff2be00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2406e810 con 0x7eff2406fd60 2024-05-09T05:06:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.905+0000 7eff2be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7eff2406eaf0 con 0x7eff24073840 2024-05-09T05:06:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.905+0000 7eff29e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7eff240aee10 0x7eff240af2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54914/0 (socket says 172.21.15.100:54914) 2024-05-09T05:06:15.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.905+0000 7eff29e00640 1 -- 172.21.15.100:0/1554355597 learned_addr learned my addr 172.21.15.100:0/1554355597 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff28a00640 1 --2- 172.21.15.100:0/1554355597 >> v2:172.21.15.133:3300/0 conn(0x7eff24073840 0x7eff24073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774201945 0 0) 0x7eff2406f390 con 0x7eff240aee10 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff0c003520 con 0x7eff240aee10 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327693959 0 0) 0x7eff0c003520 con 0x7eff240aee10 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 >> v2:172.21.15.133:3300/0 conn(0x7eff24073840 msgr2=0x7eff24073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 --2- 172.21.15.100:0/1554355597 >> v2:172.21.15.133:3300/0 conn(0x7eff24073840 0x7eff24073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 >> v1:172.21.15.133:6789/0 conn(0x7eff2406fd60 legacy=0x7eff24070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2406edd0 con 0x7eff240aee10 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7eff1c001a70 con 0x7eff240aee10 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.906+0000 7eff28a00640 1 --2- 172.21.15.100:0/1554355597 >> v2:172.21.15.133:3300/0 conn(0x7eff24073840 0x7eff24073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 >> v1:172.21.15.100:6789/0 conn(0x7eff240aee10 legacy=0x7eff240af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff0c004800 0x7eff0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff0c0052e0 0x7eff0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff2406eaf0 con 0x7eff0c003a50 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7eff0c00c1b0 con 0x7eff0c0052e0 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7eff0c00c3b0 con 0x7eff0c004800 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29400640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29400640 1 -- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff0c004800 msgr2=0x7eff0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29400640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff0c004800 0x7eff0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29400640 1 -- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff0c0052e0 msgr2=0x7eff0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29e00640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff0c0052e0 0x7eff0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29400640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff0c0052e0 0x7eff0c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29e00640 1 -- 172.21.15.100:0/1554355597 reap_dead start 2024-05-09T05:06:15.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.907+0000 7eff29400640 1 -- 172.21.15.100:0/1554355597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c003520 con 0x7eff0c003a50 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.908+0000 7eff29400640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff0c003e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff18001760 tx=0x7eff0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c5832a8737f8fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180013b0 con 0x7eff0c003a50 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180052d0 con 0x7eff0c003a50 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff23e00640 1 -- 172.21.15.100:0/1554355597 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1802aa90 con 0x7eff0c003a50 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff2be00640 1 -- 172.21.15.100:0/1554355597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 msgr2=0x7eff0c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff2be00640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff0c003e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7eff18001760 tx=0x7eff0c005830 comp rx=0 tx=0).stop 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff2be00640 1 -- 172.21.15.100:0/1554355597 shutdown_connections 2024-05-09T05:06:15.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff2be00640 1 --2- 172.21.15.100:0/1554355597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff0c003e70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.909+0000 7eff2be00640 1 -- 172.21.15.100:0/1554355597 >> 172.21.15.100:0/1554355597 conn(0x7eff240b31e0 msgr2=0x7eff240d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.910+0000 7eff2be00640 1 -- 172.21.15.100:0/1554355597 shutdown_connections 2024-05-09T05:06:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.910+0000 7eff2be00640 1 -- 172.21.15.100:0/1554355597 wait complete. 2024-05-09T05:06:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.911+0000 7eff2be00640 1 Processor -- start 2024-05-09T05:06:15.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.912+0000 7eff2be00640 1 -- start start 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.912+0000 7eff2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff240b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.912+0000 7eff2be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff2414a850 0x7eff2414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff2be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff24157be0 0x7eff24158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff2be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff24159f00 con 0x7eff0c003a50 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff2be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7eff2406e4a0 con 0x7eff24157be0 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff2be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7eff2409bf20 con 0x7eff2414a850 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff240b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff240b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40496/0 (socket says 172.21.15.100:40496) 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 -- 172.21.15.100:0/653476160 learned_addr learned my addr 172.21.15.100:0/653476160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 -- 172.21.15.100:0/653476160 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff2414a850 msgr2=0x7eff2414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff2414a850 0x7eff2414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 -- 172.21.15.100:0/653476160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff24157be0 msgr2=0x7eff24158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff24157be0 0x7eff24158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.913+0000 7eff29400640 1 -- 172.21.15.100:0/653476160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff24158950 con 0x7eff0c003a50 2024-05-09T05:06:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.914+0000 7eff29400640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff240b20f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7eff18005040 tx=0x7eff18001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.914+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1803f020 con 0x7eff0c003a50 2024-05-09T05:06:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.914+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff18005480 con 0x7eff0c003a50 2024-05-09T05:06:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.914+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18037040 con 0x7eff0c003a50 2024-05-09T05:06:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.914+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff24158c30 con 0x7eff0c003a50 2024-05-09T05:06:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.914+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff241585d0 con 0x7eff0c003a50 2024-05-09T05:06:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.916+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff24076070 con 0x7eff0c003a50 2024-05-09T05:06:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.917+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff18042020 con 0x7eff0c003a50 2024-05-09T05:06:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.918+0000 7eff21600640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff04076270 0x7eff04078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.918+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7eff180b74d0 con 0x7eff0c003a50 2024-05-09T05:06:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.918+0000 7eff28a00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff04076270 0x7eff04078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.919+0000 7eff28a00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff04076270 0x7eff04078730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff10006fd0 tx=0x7eff10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:15.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:15.922+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff18049030 con 0x7eff0c003a50 2024-05-09T05:06:16.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.170+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff2406f390 con 0x7eff0c003a50 2024-05-09T05:06:16.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.171+0000 7eff21600640 1 -- 172.21.15.100:0/653476160 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5198 (secure 0 0 0) 0x7eff18080ac0 con 0x7eff0c003a50 2024-05-09T05:06:16.172 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:16.172 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:13.016822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8,9,10],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2024-05-09T05:06:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff04076270 msgr2=0x7eff04078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff04076270 0x7eff04078730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff10006fd0 tx=0x7eff10008040 comp rx=0 tx=0).stop 2024-05-09T05:06:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 msgr2=0x7eff240b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff240b20f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7eff18005040 tx=0x7eff18001120 comp rx=0 tx=0).stop 2024-05-09T05:06:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 shutdown_connections 2024-05-09T05:06:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7eff04076270 0x7eff04078730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff24157be0 0x7eff24158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7eff2414a850 0x7eff2414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 --2- 172.21.15.100:0/653476160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0c003a50 0x7eff240b20f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.174+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 >> 172.21.15.100:0/653476160 conn(0x7eff240b31e0 msgr2=0x7eff240b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:16.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.175+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 shutdown_connections 2024-05-09T05:06:16.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.175+0000 7eff2be00640 1 -- 172.21.15.100:0/653476160 wait complete. 2024-05-09T05:06:16.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:16.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.396+0000 7efce4c00640 1 Processor -- start 2024-05-09T05:06:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.396+0000 7efce4c00640 1 -- start start 2024-05-09T05:06:16.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efce4c00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efce0073cd0 0x7efce00af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efce4c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce006f390 con 0x7efce0073840 2024-05-09T05:06:16.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efce4c00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce006e810 con 0x7efce006fd60 2024-05-09T05:06:16.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efce4c00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7efce006eaf0 con 0x7efce0073cd0 2024-05-09T05:06:16.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efcdd400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efce0073840 0x7efce00aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54924/0 (socket says 172.21.15.100:54924) 2024-05-09T05:06:16.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efcdd400640 1 -- 172.21.15.100:0/2586043958 learned_addr learned my addr 172.21.15.100:0/2586043958 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.398+0000 7efcde800640 1 --2- 172.21.15.100:0/2586043958 >> v2:172.21.15.133:3300/0 conn(0x7efce0073cd0 0x7efce00af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235527715 0 0) 0x7efce006f390 con 0x7efce0073840 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc4005730 con 0x7efce0073840 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3542315861 0 0) 0x7efcc4005730 con 0x7efce0073840 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 >> v2:172.21.15.133:3300/0 conn(0x7efce0073cd0 msgr2=0x7efce00af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 --2- 172.21.15.100:0/2586043958 >> v2:172.21.15.133:3300/0 conn(0x7efce0073cd0 0x7efce00af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 >> v1:172.21.15.133:6789/0 conn(0x7efce006fd60 legacy=0x7efce0070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce006edd0 con 0x7efce0073840 2024-05-09T05:06:16.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7efcc80016f0 con 0x7efce0073840 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 >> v1:172.21.15.100:6789/0 conn(0x7efce0073840 legacy=0x7efce00aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc4005cb0 0x7efcc40060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4006a10 0x7efcc4006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcc4007420 0x7efcc400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efce006eaf0 con 0x7efcc4007420 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efcc400e370 con 0x7efcc4005cb0 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.399+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7efcc400e570 con 0x7efcc4006a10 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcde800640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcc4007420 0x7efcc400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcdde00640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc4005cb0 0x7efcc40060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcdd400640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4006a10 0x7efcc4006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcde800640 1 -- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4006a10 msgr2=0x7efcc4006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcde800640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4006a10 0x7efcc4006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcde800640 1 -- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc4005cb0 msgr2=0x7efcc40060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:16.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcde800640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcc4005cb0 0x7efcc40060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcde800640 1 -- 172.21.15.100:0/2586043958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc4005730 con 0x7efcc4007420 2024-05-09T05:06:16.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.400+0000 7efcdd400640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4006a10 0x7efcc4006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:16.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.401+0000 7efcde800640 1 -- 172.21.15.100:0/2586043958 reap_dead start 2024-05-09T05:06:16.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.401+0000 7efcde800640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcc4007420 0x7efcc400dbd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009a90 tx=0x7efcc4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb464de11c3c45c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:16.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.401+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8009690 con 0x7efcc4007420 2024-05-09T05:06:16.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd8004020 con 0x7efcc4007420 2024-05-09T05:06:16.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efcdca00640 1 -- 172.21.15.100:0/2586043958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd80043d0 con 0x7efcc4007420 2024-05-09T05:06:16.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efce4c00640 1 -- 172.21.15.100:0/2586043958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcc4007420 msgr2=0x7efcc400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efce4c00640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcc4007420 0x7efcc400dbd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009a90 tx=0x7efcc4007a40 comp rx=0 tx=0).stop 2024-05-09T05:06:16.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efce4c00640 1 -- 172.21.15.100:0/2586043958 shutdown_connections 2024-05-09T05:06:16.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efce4c00640 1 --2- 172.21.15.100:0/2586043958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcc4007420 0x7efcc400dbd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efce4c00640 1 -- 172.21.15.100:0/2586043958 >> 172.21.15.100:0/2586043958 conn(0x7efce00b31e0 msgr2=0x7efce00d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:16.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.402+0000 7efce4c00640 1 -- 172.21.15.100:0/2586043958 shutdown_connections 2024-05-09T05:06:16.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.403+0000 7efce4c00640 1 -- 172.21.15.100:0/2586043958 wait complete. 2024-05-09T05:06:16.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.404+0000 7efce4c00640 1 Processor -- start 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.404+0000 7efce4c00640 1 -- start start 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.405+0000 7efce4c00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4007420 0x7efce0155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.405+0000 7efce4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 0x7efce00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.405+0000 7efce4c00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce00cf5b0 0x7efce00cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.405+0000 7efce4c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efce0159f00 con 0x7efce00cf130 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.405+0000 7efce4c00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7efce006e4a0 con 0x7efce00cf5b0 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.405+0000 7efce4c00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7efce01e7e60 con 0x7efcc4007420 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 0x7efce00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 0x7efce00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40508/0 (socket says 172.21.15.100:40508) 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 -- 172.21.15.100:0/1682446990 learned_addr learned my addr 172.21.15.100:0/1682446990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcde800640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce00cf5b0 0x7efce00cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdde00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4007420 0x7efce0155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 -- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4007420 msgr2=0x7efce0155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4007420 0x7efce0155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 -- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce00cf5b0 msgr2=0x7efce00cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce00cf5b0 0x7efce00cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 -- 172.21.15.100:0/1682446990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce01e6dc0 con 0x7efce00cf130 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdde00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4007420 0x7efce0155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:16.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.406+0000 7efcdd400640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 0x7efce00cb4e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efcc800d7a0 tx=0x7efcc800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:16.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.407+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc80074e0 con 0x7efce00cf130 2024-05-09T05:06:16.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.407+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc800de50 con 0x7efce00cf130 2024-05-09T05:06:16.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.407+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce01e70a0 con 0x7efce00cf130 2024-05-09T05:06:16.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.407+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8004a20 con 0x7efce00cf130 2024-05-09T05:06:16.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.407+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce01e7660 con 0x7efce00cf130 2024-05-09T05:06:16.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.408+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce0076070 con 0x7efce00cf130 2024-05-09T05:06:16.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.409+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcc801b020 con 0x7efce00cf130 2024-05-09T05:06:16.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.411+0000 7efcd6000640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efcbc076300 0x7efcbc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.411+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7efcc8097730 con 0x7efce00cf130 2024-05-09T05:06:16.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.411+0000 7efcdde00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efcbc076300 0x7efcbc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.412+0000 7efcdde00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efcbc076300 0x7efcbc0787c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efcd0007fd0 tx=0x7efcd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:16.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.416+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efcc8060d10 con 0x7efce00cf130 2024-05-09T05:06:16.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.658+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efce006f390 con 0x7efce00cf130 2024-05-09T05:06:16.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.660+0000 7efcd6000640 1 -- 172.21.15.100:0/1682446990 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5198 (secure 0 0 0) 0x7efcc8060610 con 0x7efce00cf130 2024-05-09T05:06:16.660 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:16.660 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:13.016822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8,9,10],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:16.661 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2024-05-09T05:06:16.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.662+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efcbc076300 msgr2=0x7efcbc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.662+0000 7efce4c00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efcbc076300 0x7efcbc0787c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efcd0007fd0 tx=0x7efcd0009040 comp rx=0 tx=0).stop 2024-05-09T05:06:16.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.662+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 msgr2=0x7efce00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.662+0000 7efce4c00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 0x7efce00cb4e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efcc800d7a0 tx=0x7efcc800dc60 comp rx=0 tx=0).stop 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 shutdown_connections 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7efcbc076300 0x7efcbc0787c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce00cf5b0 0x7efce00cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce00cf130 0x7efce00cb4e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 --2- 172.21.15.100:0/1682446990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efcc4007420 0x7efce0155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 >> 172.21.15.100:0/1682446990 conn(0x7efce00b31e0 msgr2=0x7efce00b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 shutdown_connections 2024-05-09T05:06:16.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.663+0000 7efce4c00640 1 -- 172.21.15.100:0/1682446990 wait complete. 2024-05-09T05:06:16.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.872+0000 7faa86200640 1 Processor -- start 2024-05-09T05:06:16.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.872+0000 7faa86200640 1 -- start start 2024-05-09T05:06:16.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa86200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faa8006fd60 0x7faa80070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa86200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa800afe20 0x7faa80073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa86200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa80070680 con 0x7faa80073840 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa86200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7faa8006f390 con 0x7faa8006fd60 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa86200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7faa8006e810 con 0x7faa800afe20 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa7f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faa8006fd60 0x7faa80070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa76a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faa80073840 0x7faa8015fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54938/0 (socket says 172.21.15.100:54938) 2024-05-09T05:06:16.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.874+0000 7faa76a00640 1 -- 172.21.15.100:0/2739595965 learned_addr learned my addr 172.21.15.100:0/2739595965 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.875+0000 7faa7fe00640 1 --2- 172.21.15.100:0/2739595965 >> v2:172.21.15.133:3300/0 conn(0x7faa800afe20 0x7faa80073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.875+0000 7faa7f400640 1 -- 172.21.15.100:0/2739595965 >> v2:172.21.15.133:3300/0 conn(0x7faa800afe20 msgr2=0x7faa80073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.875+0000 7faa7f400640 1 --2- 172.21.15.100:0/2739595965 >> v2:172.21.15.133:3300/0 conn(0x7faa800afe20 0x7faa80073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.875+0000 7faa7f400640 1 -- 172.21.15.100:0/2739595965 >> v1:172.21.15.100:6789/0 conn(0x7faa80073840 legacy=0x7faa8015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.875+0000 7faa7f400640 1 -- 172.21.15.100:0/2739595965 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8006eaf0 con 0x7faa8006fd60 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.875+0000 7faa7ea00640 1 -- 172.21.15.100:0/2739595965 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455615364 0 0) 0x7faa80070680 con 0x7faa80073840 2024-05-09T05:06:16.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.876+0000 7faa7f400640 1 --2- 172.21.15.100:0/2739595965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa8006fd60 0x7faa80070140 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faa800d1bd0 tx=0x7faa7002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513a07062c5f73a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.876+0000 7faa7ea00640 1 -- 172.21.15.100:0/2739595965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70007740 con 0x7faa8006fd60 2024-05-09T05:06:16.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.876+0000 7faa7ea00640 1 -- 172.21.15.100:0/2739595965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa700078e0 con 0x7faa8006fd60 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.876+0000 7faa7ea00640 1 -- 172.21.15.100:0/2739595965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70007cb0 con 0x7faa8006fd60 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 -- 172.21.15.100:0/2739595965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa8006fd60 msgr2=0x7faa80070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 --2- 172.21.15.100:0/2739595965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa8006fd60 0x7faa80070140 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faa800d1bd0 tx=0x7faa7002a680 comp rx=0 tx=0).stop 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 -- 172.21.15.100:0/2739595965 shutdown_connections 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 --2- 172.21.15.100:0/2739595965 >> v2:172.21.15.133:3300/0 conn(0x7faa800afe20 0x7faa80073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 --2- 172.21.15.100:0/2739595965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa8006fd60 0x7faa80070140 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 -- 172.21.15.100:0/2739595965 >> 172.21.15.100:0/2739595965 conn(0x7faa800b31e0 msgr2=0x7faa800d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 -- 172.21.15.100:0/2739595965 shutdown_connections 2024-05-09T05:06:16.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.877+0000 7faa86200640 1 -- 172.21.15.100:0/2739595965 wait complete. 2024-05-09T05:06:16.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.879+0000 7faa86200640 1 Processor -- start 2024-05-09T05:06:16.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.879+0000 7faa86200640 1 -- start start 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa86200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8006fd60 0x7faa80153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa86200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 0x7faa8014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa86200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa800afe20 0x7faa8015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa86200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa8006e4a0 con 0x7faa80073840 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa86200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7faa8006f0b0 con 0x7faa800afe20 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa86200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7faa80159f00 con 0x7faa8006fd60 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 0x7faa8014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 0x7faa8014fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40516/0 (socket says 172.21.15.100:40516) 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 -- 172.21.15.100:0/2758240980 learned_addr learned my addr 172.21.15.100:0/2758240980 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa7f400640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8006fd60 0x7faa80153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 -- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8006fd60 msgr2=0x7faa80153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8006fd60 0x7faa80153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa7fe00640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa800afe20 0x7faa8015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 -- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa800afe20 msgr2=0x7faa8015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa800afe20 0x7faa8015a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.880+0000 7faa76a00640 1 -- 172.21.15.100:0/2758240980 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa80150a20 con 0x7faa80073840 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.881+0000 7faa76a00640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 0x7faa8014fe80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c490 tx=0x7faa6800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.881+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68018070 con 0x7faa80073840 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.881+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa68007500 con 0x7faa80073840 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.881+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa80150740 con 0x7faa80073840 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.881+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68004a20 con 0x7faa80073840 2024-05-09T05:06:16.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.881+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa80153270 con 0x7faa80073840 2024-05-09T05:06:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.882+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa80076070 con 0x7faa80073840 2024-05-09T05:06:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.883+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa6801b070 con 0x7faa80073840 2024-05-09T05:06:16.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.884+0000 7faa77e00640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faa5c076300 0x7faa5c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.885+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7faa68096c10 con 0x7faa80073840 2024-05-09T05:06:16.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.885+0000 7faa7f400640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faa5c076300 0x7faa5c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:16.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.886+0000 7faa7f400640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faa5c076300 0x7faa5c0787c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa70034000 tx=0x7faa7002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:16.889+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa680601f0 con 0x7faa80073840 2024-05-09T05:06:17.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.099+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa80070890 con 0x7faa80073840 2024-05-09T05:06:17.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.102+0000 7faa77e00640 1 -- 172.21.15.100:0/2758240980 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+20375 (secure 0 0 0) 0x7faa6805faf0 con 0x7faa80073840 2024-05-09T05:06:17.104 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:17.104 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:06:14.544817+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data_extra1","create_time":"2024-05-09T05:06:09.113262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra2","create_time":"2024-05-09T05:06:12.336629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:17.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faa5c076300 msgr2=0x7faa5c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faa5c076300 0x7faa5c0787c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faa70034000 tx=0x7faa7002f000 comp rx=0 tx=0).stop 2024-05-09T05:06:17.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 msgr2=0x7faa8014fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 0x7faa8014fe80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c490 tx=0x7faa6800c950 comp rx=0 tx=0).stop 2024-05-09T05:06:17.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 shutdown_connections 2024-05-09T05:06:17.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7faa5c076300 0x7faa5c0787c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa800afe20 0x7faa8015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa80073840 0x7faa8014fe80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 --2- 172.21.15.100:0/2758240980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8006fd60 0x7faa80153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.105+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 >> 172.21.15.100:0/2758240980 conn(0x7faa800b31e0 msgr2=0x7faa800b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.106+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 shutdown_connections 2024-05-09T05:06:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.106+0000 7faa86200640 1 -- 172.21.15.100:0/2758240980 wait complete. 2024-05-09T05:06:17.126 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T05:06:17.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:17.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.325+0000 7f8082600640 1 Processor -- start 2024-05-09T05:06:17.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.325+0000 7f8082600640 1 -- start start 2024-05-09T05:06:17.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.326+0000 7f8082600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f807c0d3660 0x7f807c0d3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.326+0000 7f8082600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d1a10 0x7f807c0d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.326+0000 7f8082600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807c0d2f80 con 0x7f807c0b4530 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.326+0000 7f8082600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f807c0d4010 con 0x7f807c0d3660 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.326+0000 7f8082600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f807c0d23a0 con 0x7f807c0d1a10 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f807c0d3660 0x7f807c0d3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f807c0d3660 0x7f807c0d3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40522/0 (socket says 172.21.15.100:40522) 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 -- 172.21.15.100:0/4030947123 learned_addr learned my addr 172.21.15.100:0/4030947123 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f8081c00640 1 --2- 172.21.15.100:0/4030947123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d1a10 0x7f807c0d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 -- 172.21.15.100:0/4030947123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d1a10 msgr2=0x7f807c0d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 --2- 172.21.15.100:0/4030947123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d1a10 0x7f807c0d1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 -- 172.21.15.100:0/4030947123 >> v1:172.21.15.133:6789/0 conn(0x7f807c0b4530 legacy=0x7f807c0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:17.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.327+0000 7f807be00640 1 -- 172.21.15.100:0/4030947123 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c0b51e0 con 0x7f807c0d3660 2024-05-09T05:06:17.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.328+0000 7f807be00640 1 --2- 172.21.15.100:0/4030947123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d3660 0x7f807c0d3ad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f806802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374c27cff463ae25 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:17.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.328+0000 7f807b400640 1 -- 172.21.15.100:0/4030947123 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068037070 con 0x7f807c0d3660 2024-05-09T05:06:17.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.328+0000 7f807b400640 1 -- 172.21.15.100:0/4030947123 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8068032440 con 0x7f807c0d3660 2024-05-09T05:06:17.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.328+0000 7f807b400640 1 -- 172.21.15.100:0/4030947123 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068032810 con 0x7f807c0d3660 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 -- 172.21.15.100:0/4030947123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d3660 msgr2=0x7f807c0d3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 --2- 172.21.15.100:0/4030947123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d3660 0x7f807c0d3ad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f806802a1c0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 -- 172.21.15.100:0/4030947123 shutdown_connections 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 --2- 172.21.15.100:0/4030947123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d1a10 0x7f807c0d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 --2- 172.21.15.100:0/4030947123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d3660 0x7f807c0d3ad0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 -- 172.21.15.100:0/4030947123 >> 172.21.15.100:0/4030947123 conn(0x7f807c08eb30 msgr2=0x7f807c09e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:17.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 -- 172.21.15.100:0/4030947123 shutdown_connections 2024-05-09T05:06:17.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.329+0000 7f8082600640 1 -- 172.21.15.100:0/4030947123 wait complete. 2024-05-09T05:06:17.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.331+0000 7f8082600640 1 Processor -- start 2024-05-09T05:06:17.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.331+0000 7f8082600640 1 -- start start 2024-05-09T05:06:17.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f8082600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807c0b4530 0x7f807c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f8082600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 0x7f807c0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f8082600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d3660 0x7f807c15e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f8082600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f807c0b5730 con 0x7f807c0d1a10 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f8082600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f807c0b5450 con 0x7f807c0b4530 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f8082600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f807c0d28d0 con 0x7f807c0d3660 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f807be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 0x7f807c0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f807be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 0x7f807c0cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40538/0 (socket says 172.21.15.100:40538) 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.332+0000 7f807be00640 1 -- 172.21.15.100:0/2869725299 learned_addr learned my addr 172.21.15.100:0/2869725299 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f8081200640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807c0b4530 0x7f807c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f8081c00640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d3660 0x7f807c15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f807be00640 1 -- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d3660 msgr2=0x7f807c15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f807be00640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d3660 0x7f807c15e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f807be00640 1 -- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807c0b4530 msgr2=0x7f807c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f807be00640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807c0b4530 0x7f807c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f807be00640 1 -- 172.21.15.100:0/2869725299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c15eaa0 con 0x7f807c0d1a10 2024-05-09T05:06:17.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f8081200640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807c0b4530 0x7f807c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:17.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.333+0000 7f807be00640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 0x7f807c0cebd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f80680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.334+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068041020 con 0x7f807c0d1a10 2024-05-09T05:06:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.334+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80680306c0 con 0x7f807c0d1a10 2024-05-09T05:06:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.334+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068037040 con 0x7f807c0d1a10 2024-05-09T05:06:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.334+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c0cd140 con 0x7f807c0d1a10 2024-05-09T05:06:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.334+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c0cd700 con 0x7f807c0d1a10 2024-05-09T05:06:17.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.335+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c06a550 con 0x7f807c0d1a10 2024-05-09T05:06:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.336+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8068044020 con 0x7f807c0d1a10 2024-05-09T05:06:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.337+0000 7f8078c00640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f805c0762d0 0x7f805c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.337+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7f80680b8160 con 0x7f807c0d1a10 2024-05-09T05:06:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.337+0000 7f8081200640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f805c0762d0 0x7f805c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.338+0000 7f8081200640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f805c0762d0 0x7f805c078790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f807c162320 tx=0x7f8070008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.342+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f806804b030 con 0x7f807c0d1a10 2024-05-09T05:06:17.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.566+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f807c0b4bd0 con 0x7f807c0d1a10 2024-05-09T05:06:17.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.568+0000 7f8078c00640 1 -- 172.21.15.100:0/2869725299 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5198 (secure 0 0 0) 0x7f8068081750 con 0x7f807c0d1a10 2024-05-09T05:06:17.569 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:17.569 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:13.016822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8,9,10],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:17.569 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f805c0762d0 msgr2=0x7f805c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f805c0762d0 0x7f805c078790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f807c162320 tx=0x7f8070008040 comp rx=0 tx=0).stop 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 msgr2=0x7f807c0cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 0x7f807c0cebd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f80680046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 shutdown_connections 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f805c0762d0 0x7f805c078790 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f807c0d3660 0x7f807c15e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f807c0d1a10 0x7f807c0cebd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 --2- 172.21.15.100:0/2869725299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807c0b4530 0x7f807c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 >> 172.21.15.100:0/2869725299 conn(0x7f807c08eb30 msgr2=0x7f807c162e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 shutdown_connections 2024-05-09T05:06:17.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.571+0000 7f8082600640 1 -- 172.21.15.100:0/2869725299 wait complete. 2024-05-09T05:06:17.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.783+0000 7f925d600640 1 Processor -- start 2024-05-09T05:06:17.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.784+0000 7f925d600640 1 -- start start 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.785+0000 7f925d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 0x7f9258070140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.785+0000 7f925d600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92580afe20 0x7f9258073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.785+0000 7f925d600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9258070680 con 0x7f9258073840 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.785+0000 7f925d600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f925806f390 con 0x7f92580afe20 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.785+0000 7f925d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f925806e810 con 0x7f925806fd60 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f924fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9258073840 0x7f925815fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54950/0 (socket says 172.21.15.100:54950) 2024-05-09T05:06:17.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f924fe00640 1 -- 172.21.15.100:0/741339528 learned_addr learned my addr 172.21.15.100:0/741339528 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256a00640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 0x7f9258070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9257400640 1 --2- 172.21.15.100:0/741339528 >> v2:172.21.15.133:3300/0 conn(0x7f92580afe20 0x7f9258073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698800926 0 0) 0x7f9258070680 con 0x7f9258073840 2024-05-09T05:06:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f923c003520 con 0x7f9258073840 2024-05-09T05:06:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 382030788 0 0) 0x7f923c003520 con 0x7f9258073840 2024-05-09T05:06:17.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 msgr2=0x7f9258070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 0x7f9258070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 >> v2:172.21.15.133:3300/0 conn(0x7f92580afe20 msgr2=0x7f9258073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 --2- 172.21.15.100:0/741339528 >> v2:172.21.15.133:3300/0 conn(0x7f92580afe20 0x7f9258073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925806eaf0 con 0x7f9258073840 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f92400016f0 con 0x7f9258073840 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.786+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 >> v1:172.21.15.100:6789/0 conn(0x7f9258073840 legacy=0x7f925815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256000640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 0x7f923c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256000640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f923c003fd0 0x7f923c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256000640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004d40 0x7f923c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f925806f390 con 0x7f923c003fd0 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f925806e810 con 0x7f923c004d40 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f923c00ba10 con 0x7f925806fd60 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f924fe00640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f923c003fd0 0x7f923c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9257400640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004d40 0x7f923c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9256a00640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 0x7f923c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f924fe00640 1 -- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 msgr2=0x7f923c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f924fe00640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925806fd60 0x7f923c003a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f924fe00640 1 -- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004d40 msgr2=0x7f923c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f924fe00640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004d40 0x7f923c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f924fe00640 1 -- 172.21.15.100:0/741339528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c003520 con 0x7f923c003fd0 2024-05-09T05:06:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.787+0000 7f9257400640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004d40 0x7f923c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.788+0000 7f924fe00640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f923c003fd0 0x7f923c004800 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f924000c240 tx=0x7f923c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9159dbd8ff7bf85d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240007d50 con 0x7f923c003fd0 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240005af0 con 0x7f923c003fd0 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f9256000640 1 -- 172.21.15.100:0/741339528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240007070 con 0x7f923c003fd0 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f925d600640 1 -- 172.21.15.100:0/741339528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f923c003fd0 msgr2=0x7f923c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f925d600640 1 --2- 172.21.15.100:0/741339528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f923c003fd0 0x7f923c004800 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f924000c240 tx=0x7f923c005830 comp rx=0 tx=0).stop 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f9257400640 1 -- 172.21.15.100:0/741339528 reap_dead start 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f925d600640 1 -- 172.21.15.100:0/741339528 shutdown_connections 2024-05-09T05:06:17.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f925d600640 1 -- 172.21.15.100:0/741339528 >> 172.21.15.100:0/741339528 conn(0x7f92580b31e0 msgr2=0x7f92580d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:17.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f925d600640 1 -- 172.21.15.100:0/741339528 shutdown_connections 2024-05-09T05:06:17.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.789+0000 7f925d600640 1 -- 172.21.15.100:0/741339528 wait complete. 2024-05-09T05:06:17.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.791+0000 7f925d600640 1 Processor -- start 2024-05-09T05:06:17.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.791+0000 7f925d600640 1 -- start start 2024-05-09T05:06:17.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f925d600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c003fd0 0x7f92581605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f925d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 0x7f925809dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f925d600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925809e210 0x7f925809e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f925d600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f925806e4a0 con 0x7f925809cf70 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f925d600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f925806f0b0 con 0x7f923c003fd0 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f925d600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9258159f00 con 0x7f925809e210 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f924fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 0x7f925809dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f924fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 0x7f925809dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40544/0 (socket says 172.21.15.100:40544) 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.792+0000 7f924fe00640 1 -- 172.21.15.100:0/2482462644 learned_addr learned my addr 172.21.15.100:0/2482462644 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f9257400640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925809e210 0x7f925809e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f9256a00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c003fd0 0x7f92581605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924fe00640 1 -- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925809e210 msgr2=0x7f925809e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924fe00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925809e210 0x7f925809e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924fe00640 1 -- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c003fd0 msgr2=0x7f92581605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924fe00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c003fd0 0x7f92581605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924fe00640 1 -- 172.21.15.100:0/2482462644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9258160b00 con 0x7f925809cf70 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f9257400640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925809e210 0x7f925809e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924fe00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 0x7f925809dcd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f924000c360 tx=0x7f9240001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240041020 con 0x7f925809cf70 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240038040 con 0x7f925809cf70 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.793+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240007070 con 0x7f925809cf70 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.794+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92581530b0 con 0x7f925809cf70 2024-05-09T05:06:17.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.794+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925809d6e0 con 0x7f925809cf70 2024-05-09T05:06:17.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.795+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925809d8e0 con 0x7f925809cf70 2024-05-09T05:06:17.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.796+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9240044020 con 0x7f925809cf70 2024-05-09T05:06:17.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.797+0000 7f924ea00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9234076270 0x7f9234078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:17.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.797+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7f92400b78d0 con 0x7f925809cf70 2024-05-09T05:06:17.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.797+0000 7f9256a00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9234076270 0x7f9234078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:17.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.798+0000 7f9256a00640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9234076270 0x7f9234078730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92580cfac0 tx=0x7f9248008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:17.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:17.801+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f925809d8e0 con 0x7f925809cf70 2024-05-09T05:06:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.048+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92580b5ef0 con 0x7f925809cf70 2024-05-09T05:06:18.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.049+0000 7f924ea00640 1 -- 172.21.15.100:0/2482462644 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5198 (secure 0 0 0) 0x7f924004b030 con 0x7f925809cf70 2024-05-09T05:06:18.050 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:18.050 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-09T05:05:59.823443+0000","modified":"2024-05-09T05:06:13.016822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5286":{"gid":5286,"name":"b","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/3578202714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3578202714},{"type":"v1","addr":"172.21.15.133:6835","nonce":3578202714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8,9,10],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5286,"qdb_cluster":[5286]},"id":3}]} 2024-05-09T05:06:18.050 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 30 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9234076270 msgr2=0x7f9234078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9234076270 0x7f9234078730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92580cfac0 tx=0x7f9248008040 comp rx=0 tx=0).stop 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 msgr2=0x7f925809dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 0x7f925809dcd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f924000c360 tx=0x7f9240001a30 comp rx=0 tx=0).stop 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 shutdown_connections 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9234076270 0x7f9234078730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f925809e210 0x7f925809e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f925809cf70 0x7f925809dcd0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 --2- 172.21.15.100:0/2482462644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c003fd0 0x7f92581605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 >> 172.21.15.100:0/2482462644 conn(0x7f92580b31e0 msgr2=0x7f92580b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 shutdown_connections 2024-05-09T05:06:18.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.052+0000 7f925d600640 1 -- 172.21.15.100:0/2482462644 wait complete. 2024-05-09T05:06:18.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:18.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.270+0000 7ffa47200640 1 Processor -- start 2024-05-09T05:06:18.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.270+0000 7ffa47200640 1 -- start start 2024-05-09T05:06:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa47200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48161730 0x7ffa480cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa47200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffa480ce160 0x7ffa480cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa47200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa48143af0 con 0x7ffa48143710 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa47200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ffa480ce5b0 con 0x7ffa480ce160 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa47200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ffa48160ce0 con 0x7ffa48161730 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa46800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffa480ce160 0x7ffa480cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa46800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffa480ce160 0x7ffa480cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40560/0 (socket says 172.21.15.100:40560) 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.272+0000 7ffa46800640 1 -- 172.21.15.100:0/85726867 learned_addr learned my addr 172.21.15.100:0/85726867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.273+0000 7ffa45400640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48161730 0x7ffa480cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.273+0000 7ffa46800640 1 -- 172.21.15.100:0/85726867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48161730 msgr2=0x7ffa480cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.273+0000 7ffa46800640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48161730 0x7ffa480cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.273+0000 7ffa46800640 1 -- 172.21.15.100:0/85726867 >> v1:172.21.15.133:6789/0 conn(0x7ffa48143710 legacy=0x7ffa4815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.273+0000 7ffa46800640 1 -- 172.21.15.100:0/85726867 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4815e240 con 0x7ffa480ce160 2024-05-09T05:06:18.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.273+0000 7ffa45400640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48161730 0x7ffa480cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.274+0000 7ffa46800640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa480cf0d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009870 tx=0x7ffa4002a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8116ea200a705d35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.274+0000 7ffa44a00640 1 -- 172.21.15.100:0/85726867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40037070 con 0x7ffa480ce160 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.274+0000 7ffa44a00640 1 -- 172.21.15.100:0/85726867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa40032440 con 0x7ffa480ce160 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.274+0000 7ffa44a00640 1 -- 172.21.15.100:0/85726867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40032810 con 0x7ffa480ce160 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 -- 172.21.15.100:0/85726867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 msgr2=0x7ffa480cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa480cf0d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009870 tx=0x7ffa4002a1d0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 -- 172.21.15.100:0/85726867 shutdown_connections 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa480cf0d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 --2- 172.21.15.100:0/85726867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48161730 0x7ffa480cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 -- 172.21.15.100:0/85726867 >> 172.21.15.100:0/85726867 conn(0x7ffa4806c7f0 msgr2=0x7ffa4806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:18.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 -- 172.21.15.100:0/85726867 shutdown_connections 2024-05-09T05:06:18.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.275+0000 7ffa47200640 1 -- 172.21.15.100:0/85726867 wait complete. 2024-05-09T05:06:18.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.277+0000 7ffa47200640 1 Processor -- start 2024-05-09T05:06:18.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.277+0000 7ffa47200640 1 -- start start 2024-05-09T05:06:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa47200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa48132c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa47200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48143710 0x7ffa4815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa47200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa48161730 0x7ffa4815edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa47200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48161210 con 0x7ffa480ce160 2024-05-09T05:06:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa47200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48160f30 con 0x7ffa48161730 2024-05-09T05:06:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa47200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ffa48072490 con 0x7ffa48143710 2024-05-09T05:06:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa48132c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa48132c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40576/0 (socket says 172.21.15.100:40576) 2024-05-09T05:06:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 -- 172.21.15.100:0/2538925148 learned_addr learned my addr 172.21.15.100:0/2538925148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 -- 172.21.15.100:0/2538925148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48143710 msgr2=0x7ffa4815e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48143710 0x7ffa4815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 -- 172.21.15.100:0/2538925148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa48161730 msgr2=0x7ffa4815edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa48161730 0x7ffa4815edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.278+0000 7ffa45e00640 1 -- 172.21.15.100:0/2538925148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa481e6c70 con 0x7ffa480ce160 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.279+0000 7ffa45e00640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa48132c60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c870 tx=0x7ffa3800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.279+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38003b70 con 0x7ffa480ce160 2024-05-09T05:06:18.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.279+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa38003d10 con 0x7ffa480ce160 2024-05-09T05:06:18.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.279+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3800aa90 con 0x7ffa480ce160 2024-05-09T05:06:18.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.279+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa481e6f50 con 0x7ffa480ce160 2024-05-09T05:06:18.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.279+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa48157320 con 0x7ffa480ce160 2024-05-09T05:06:18.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.280+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa4806a550 con 0x7ffa480ce160 2024-05-09T05:06:18.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.281+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa3800ac30 con 0x7ffa480ce160 2024-05-09T05:06:18.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.283+0000 7ffa3e000640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffa280762d0 0x7ffa28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.283+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7ffa38097990 con 0x7ffa480ce160 2024-05-09T05:06:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.283+0000 7ffa45400640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffa280762d0 0x7ffa28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.284+0000 7ffa45400640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffa280762d0 0x7ffa28078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006fd0 tx=0x7ffa34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.288+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa38060f70 con 0x7ffa480ce160 2024-05-09T05:06:18.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.502+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa480cdf40 con 0x7ffa480ce160 2024-05-09T05:06:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.506+0000 7ffa3e000640 1 -- 172.21.15.100:0/2538925148 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+20375 (secure 0 0 0) 0x7ffa38060870 con 0x7ffa480ce160 2024-05-09T05:06:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:18.507 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:06:14.544817+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:05:57.717664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-09T05:05:58.806484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data_extra1","create_time":"2024-05-09T05:06:09.113262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra2","create_time":"2024-05-09T05:06:12.336629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.23","mappings":[{"from":0,"to":1}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffa280762d0 msgr2=0x7ffa28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffa280762d0 0x7ffa28078790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffa34006fd0 tx=0x7ffa34008040 comp rx=0 tx=0).stop 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 msgr2=0x7ffa48132c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa48132c60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c870 tx=0x7ffa3800cd30 comp rx=0 tx=0).stop 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 shutdown_connections 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ffa280762d0 0x7ffa28078790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa48161730 0x7ffa4815edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffa48143710 0x7ffa4815e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 --2- 172.21.15.100:0/2538925148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa480ce160 0x7ffa48132c60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 >> 172.21.15.100:0/2538925148 conn(0x7ffa4806c7f0 msgr2=0x7ffa4806cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:18.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 shutdown_connections 2024-05-09T05:06:18.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.509+0000 7ffa47200640 1 -- 172.21.15.100:0/2538925148 wait complete. 2024-05-09T05:06:18.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T05:06:18.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.721+0000 7f6bd5800640 1 Processor -- start 2024-05-09T05:06:18.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.721+0000 7f6bd5800640 1 -- start start 2024-05-09T05:06:18.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.722+0000 7f6bd5800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6bd00b5990 0x7f6bd0164b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bd5800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bd00cff00 0x7f6bd00d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bd5800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd00b5e40 con 0x7f6bd0163c10 2024-05-09T05:06:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bd5800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd0165050 con 0x7f6bd00cff00 2024-05-09T05:06:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bd5800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd00d0890 con 0x7f6bd00b5990 2024-05-09T05:06:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bcea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6bd0163c10 0x7f6bd00b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54964/0 (socket says 172.21.15.100:54964) 2024-05-09T05:06:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bcea00640 1 -- 172.21.15.100:0/1399202578 learned_addr learned my addr 172.21.15.100:0/1399202578 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:18.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bcf400640 1 --2- 172.21.15.100:0/1399202578 >> v2:172.21.15.100:3300/0 conn(0x7f6bd00cff00 0x7f6bd00d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bce000640 1 --2- 172.21.15.100:0/1399202578 >> v2:172.21.15.133:3300/0 conn(0x7f6bd00b5990 0x7f6bd0164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bcd600640 1 -- 172.21.15.100:0/1399202578 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683983078 0 0) 0x7f6bd00b5e40 con 0x7f6bd0163c10 2024-05-09T05:06:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bcf400640 1 -- 172.21.15.100:0/1399202578 >> v2:172.21.15.133:3300/0 conn(0x7f6bd00b5990 msgr2=0x7f6bd0164b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.723+0000 7f6bcf400640 1 --2- 172.21.15.100:0/1399202578 >> v2:172.21.15.133:3300/0 conn(0x7f6bd00b5990 0x7f6bd0164b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.724+0000 7f6bcf400640 1 -- 172.21.15.100:0/1399202578 >> v1:172.21.15.100:6789/0 conn(0x7f6bd0163c10 legacy=0x7f6bd00b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.724+0000 7f6bcf400640 1 -- 172.21.15.100:0/1399202578 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd00b6120 con 0x7f6bd00cff00 2024-05-09T05:06:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.724+0000 7f6bce000640 1 --2- 172.21.15.100:0/1399202578 >> v2:172.21.15.133:3300/0 conn(0x7f6bd00b5990 0x7f6bd0164b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.724+0000 7f6bcf400640 1 --2- 172.21.15.100:0/1399202578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00cff00 0x7f6bd00d0350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b0bd0 tx=0x7f6bc802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693c51f8c9638f85 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bcd600640 1 -- 172.21.15.100:0/1399202578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8007740 con 0x7f6bd00cff00 2024-05-09T05:06:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bcd600640 1 -- 172.21.15.100:0/1399202578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc80078e0 con 0x7f6bd00cff00 2024-05-09T05:06:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bcd600640 1 -- 172.21.15.100:0/1399202578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8007cb0 con 0x7f6bd00cff00 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 -- 172.21.15.100:0/1399202578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00cff00 msgr2=0x7f6bd00d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 --2- 172.21.15.100:0/1399202578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00cff00 0x7f6bd00d0350 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b0bd0 tx=0x7f6bc802a5f0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 -- 172.21.15.100:0/1399202578 shutdown_connections 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 --2- 172.21.15.100:0/1399202578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd00cff00 0x7f6bd00d0350 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 --2- 172.21.15.100:0/1399202578 >> v2:172.21.15.133:3300/0 conn(0x7f6bd00b5990 0x7f6bd0164b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 -- 172.21.15.100:0/1399202578 >> 172.21.15.100:0/1399202578 conn(0x7f6bd00b2c90 msgr2=0x7f6bd00b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 -- 172.21.15.100:0/1399202578 shutdown_connections 2024-05-09T05:06:18.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.725+0000 7f6bd5800640 1 -- 172.21.15.100:0/1399202578 wait complete. 2024-05-09T05:06:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.727+0000 7f6bd5800640 1 Processor -- start 2024-05-09T05:06:18.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.727+0000 7f6bd5800640 1 -- start start 2024-05-09T05:06:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bd5800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bd00b5990 0x7f6bd00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bd5800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd00cff00 0x7f6bd0155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bd5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 0x7f6bd00b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bd5800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd0163ff0 con 0x7f6bd0163c10 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bd5800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd01645f0 con 0x7f6bd00cff00 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bd5800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd00cf040 con 0x7f6bd00b5990 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bcf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 0x7f6bd00b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bcf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 0x7f6bd00b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40590/0 (socket says 172.21.15.100:40590) 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.728+0000 7f6bcf400640 1 -- 172.21.15.100:0/2694233999 learned_addr learned my addr 172.21.15.100:0/2694233999 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcea00640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bd00b5990 0x7f6bd00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcf400640 1 -- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bd00b5990 msgr2=0x7f6bd00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcf400640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bd00b5990 0x7f6bd00c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcf400640 1 -- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd00cff00 msgr2=0x7f6bd0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcf400640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd00cff00 0x7f6bd0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcf400640 1 -- 172.21.15.100:0/2694233999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd01f9840 con 0x7f6bd0163c10 2024-05-09T05:06:18.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcea00640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bd00b5990 0x7f6bd00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bcf400640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 0x7f6bd00b1f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6bc802abe0 tx=0x7f6bc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8040070 con 0x7f6bd0163c10 2024-05-09T05:06:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc8031bc0 con 0x7f6bd0163c10 2024-05-09T05:06:18.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.729+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8045460 con 0x7f6bd0163c10 2024-05-09T05:06:18.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.730+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd01f9b20 con 0x7f6bd0163c10 2024-05-09T05:06:18.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.730+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd01fa3c0 con 0x7f6bd0163c10 2024-05-09T05:06:18.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.731+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd01f9f10 con 0x7f6bd0163c10 2024-05-09T05:06:18.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.732+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6bc8039040 con 0x7f6bd0163c10 2024-05-09T05:06:18.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.733+0000 7f6bc6a00640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bb0076300 0x7f6bb00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:18.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.733+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6577+0+0 (secure 0 0 0) 0x7f6bc80b9350 con 0x7f6bd0163c10 2024-05-09T05:06:18.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.733+0000 7f6bcea00640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bb0076300 0x7f6bb00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:18.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.734+0000 7f6bcea00640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bb0076300 0x7f6bb00787c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0001220 tx=0x7f6bc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:18.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.740+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6bc8082930 con 0x7f6bd0163c10 2024-05-09T05:06:18.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.969+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6bd006a630 con 0x7f6bd0163c10 2024-05-09T05:06:18.970 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-05-09T05:06:18.970+0000 7f475d400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T05:06:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.973+0000 7f6bc6a00640 1 -- 172.21.15.100:0/2694233999 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f6bc8082230 con 0x7f6bd0163c10 2024-05-09T05:06:18.974 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.976+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bb0076300 msgr2=0x7f6bb00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.976+0000 7f6bd5800640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bb0076300 0x7f6bb00787c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0001220 tx=0x7f6bc0009040 comp rx=0 tx=0).stop 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.976+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 msgr2=0x7f6bd00b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.976+0000 7f6bd5800640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 0x7f6bd00b1f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6bc802abe0 tx=0x7f6bc8004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 shutdown_connections 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6bb0076300 0x7f6bb00787c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bd0163c10 0x7f6bd00b1f90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6bd00cff00 0x7f6bd0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 --2- 172.21.15.100:0/2694233999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6bd00b5990 0x7f6bd00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:18.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 >> 172.21.15.100:0/2694233999 conn(0x7f6bd00b2c90 msgr2=0x7f6bd0163200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 shutdown_connections 2024-05-09T05:06:18.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:18.977+0000 7f6bd5800640 1 -- 172.21.15.100:0/2694233999 wait complete. 2024-05-09T05:06:18.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T05:06:19.007 INFO:tasks.ceph.mds.b.smithi133.stderr: -4939> 2024-05-09T05:06:02.338+0000 7f7e8a400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:06:19.082 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2024-05-09T05:06:19.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.181+0000 7f18c3200640 1 Processor -- start 2024-05-09T05:06:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.181+0000 7f18c3200640 1 -- start start 2024-05-09T05:06:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.182+0000 7f18c3200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f18c415d630 0x7f18c40b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.182+0000 7f18c3200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c40721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.182+0000 7f18c3200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c406f090 con 0x7f18c40b6980 2024-05-09T05:06:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c3200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f18c40b5fb0 con 0x7f18c415d630 2024-05-09T05:06:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c3200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f18c40b4000 con 0x7f18c406eb90 2024-05-09T05:06:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f18c40b6980 0x7f18c406e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54970/0 (socket says 172.21.15.100:54970) 2024-05-09T05:06:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1400640 1 -- 172.21.15.100:0/2063508818 learned_addr learned my addr 172.21.15.100:0/2063508818 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1e00640 1 --2- 172.21.15.100:0/2063508818 >> v2:172.21.15.100:3300/0 conn(0x7f18c415d630 0x7f18c40b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c2800640 1 --2- 172.21.15.100:0/2063508818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c40721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c0a00640 1 -- 172.21.15.100:0/2063508818 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551887607 0 0) 0x7f18c406f090 con 0x7f18c40b6980 2024-05-09T05:06:19.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1e00640 1 -- 172.21.15.100:0/2063508818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 msgr2=0x7f18c40721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:19.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1e00640 1 --2- 172.21.15.100:0/2063508818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c40721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1e00640 1 -- 172.21.15.100:0/2063508818 >> v1:172.21.15.100:6789/0 conn(0x7f18c40b6980 legacy=0x7f18c406e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:19.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.183+0000 7f18c1e00640 1 -- 172.21.15.100:0/2063508818 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c406f370 con 0x7f18c415d630 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.184+0000 7f18c1e00640 1 --2- 172.21.15.100:0/2063508818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c415d630 0x7f18c40b6440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f18b40097a0 tx=0x7f18b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6fa5cbce20b536 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c0a00640 1 -- 172.21.15.100:0/2063508818 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4037070 con 0x7f18c415d630 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c0a00640 1 -- 172.21.15.100:0/2063508818 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b4032440 con 0x7f18c415d630 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c0a00640 1 -- 172.21.15.100:0/2063508818 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4032810 con 0x7f18c415d630 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c3200640 1 -- 172.21.15.100:0/2063508818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c415d630 msgr2=0x7f18c40b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c3200640 1 --2- 172.21.15.100:0/2063508818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c415d630 0x7f18c40b6440 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f18b40097a0 tx=0x7f18b402a180 comp rx=0 tx=0).stop 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c3200640 1 -- 172.21.15.100:0/2063508818 shutdown_connections 2024-05-09T05:06:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c3200640 1 --2- 172.21.15.100:0/2063508818 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c40721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c3200640 1 --2- 172.21.15.100:0/2063508818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c415d630 0x7f18c40b6440 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.185+0000 7f18c3200640 1 -- 172.21.15.100:0/2063508818 >> 172.21.15.100:0/2063508818 conn(0x7f18c40b29b0 msgr2=0x7f18c40b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.186+0000 7f18c3200640 1 -- 172.21.15.100:0/2063508818 shutdown_connections 2024-05-09T05:06:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.186+0000 7f18c3200640 1 -- 172.21.15.100:0/2063508818 wait complete. 2024-05-09T05:06:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.187+0000 7f18c3200640 1 Processor -- start 2024-05-09T05:06:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.187+0000 7f18c3200640 1 -- start start 2024-05-09T05:06:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c3200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c4149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 0x7f18c4158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c3200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c415d630 0x7f18c4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c3200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18c4072720 con 0x7f18c40b6980 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c3200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f18c40b5c40 con 0x7f18c415d630 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c3200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f18c40728a0 con 0x7f18c406eb90 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.188+0000 7f18c1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 0x7f18c4158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 0x7f18c4158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40616/0 (socket says 172.21.15.100:40616) 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 -- 172.21.15.100:0/1548612660 learned_addr learned my addr 172.21.15.100:0/1548612660 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1e00640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c4149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c2800640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c415d630 0x7f18c4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 -- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 msgr2=0x7f18c4149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c4149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 -- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c415d630 msgr2=0x7f18c4158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c415d630 0x7f18c4158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 -- 172.21.15.100:0/1548612660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c415cf00 con 0x7f18c40b6980 2024-05-09T05:06:19.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18c1400640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 0x7f18c4158690 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c480 tx=0x7f18b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:19.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.189+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0018070 con 0x7f18c40b6980 2024-05-09T05:06:19.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.190+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0007500 con 0x7f18c40b6980 2024-05-09T05:06:19.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.190+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c41549f0 con 0x7f18c40b6980 2024-05-09T05:06:19.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.190+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0004a20 con 0x7f18c40b6980 2024-05-09T05:06:19.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.190+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c415cc20 con 0x7f18c40b6980 2024-05-09T05:06:19.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.191+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c406a550 con 0x7f18c40b6980 2024-05-09T05:06:19.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.192+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f18b001b070 con 0x7f18c40b6980 2024-05-09T05:06:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.193+0000 7f18ba000640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18a40762d0 0x7f18a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.193+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6663+0+0 (secure 0 0 0) 0x7f18b0096d20 con 0x7f18c40b6980 2024-05-09T05:06:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.194+0000 7f18c1e00640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18a40762d0 0x7f18a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.194+0000 7f18c1e00640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18a40762d0 0x7f18a4078790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18b4034000 tx=0x7f18b402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:19.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.197+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18b00602b0 con 0x7f18c40b6980 2024-05-09T05:06:19.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.434+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f18c40b6690 con 0x7f18c40b6980 2024-05-09T05:06:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.977+0000 7f18ba000640 1 -- 172.21.15.100:0/1548612660 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f18b005fbb0 con 0x7f18c40b6980 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18a40762d0 msgr2=0x7f18a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18a40762d0 0x7f18a4078790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f18b4034000 tx=0x7f18b402e000 comp rx=0 tx=0).stop 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 msgr2=0x7f18c4158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 0x7f18c4158690 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c480 tx=0x7f18b000c940 comp rx=0 tx=0).stop 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 shutdown_connections 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f18a40762d0 0x7f18a4078790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18c415d630 0x7f18c4158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18c40b6980 0x7f18c4158690 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 --2- 172.21.15.100:0/1548612660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18c406eb90 0x7f18c4149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:19.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 >> 172.21.15.100:0/1548612660 conn(0x7f18c40b29b0 msgr2=0x7f18c40ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:19.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.981+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 shutdown_connections 2024-05-09T05:06:19.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:19.982+0000 7f18c3200640 1 -- 172.21.15.100:0/1548612660 wait complete. 2024-05-09T05:06:20.005 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T05:06:20.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.209+0000 7f149f200640 1 Processor -- start 2024-05-09T05:06:20.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.209+0000 7f149f200640 1 -- start start 2024-05-09T05:06:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.211+0000 7f149f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f14a00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.211+0000 7f149f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a00d0ba0 con 0x7f14a0145330 2024-05-09T05:06:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.211+0000 7f149f200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14a01607d0 con 0x7f14a00b2b90 2024-05-09T05:06:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.211+0000 7f149f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f14a00d0000 con 0x7f14a00b53d0 2024-05-09T05:06:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.211+0000 7f149de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f14a0145330 0x7f14a00d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54972/0 (socket says 172.21.15.100:54972) 2024-05-09T05:06:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.211+0000 7f149de00640 1 -- 172.21.15.100:0/2936750267 learned_addr learned my addr 172.21.15.100:0/2936750267 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149e800640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f14a00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266322814 0 0) 0x7f14a00d0ba0 con 0x7f14a0145330 2024-05-09T05:06:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1484005730 con 0x7f14a0145330 2024-05-09T05:06:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2185017045 0 0) 0x7f1484005730 con 0x7f14a0145330 2024-05-09T05:06:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 msgr2=0x7f14a00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f14a00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 >> v1:172.21.15.133:6789/0 conn(0x7f14a00b2b90 legacy=0x7f14a00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a00cf9b0 con 0x7f14a0145330 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f14900016f0 con 0x7f14a0145330 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 >> v1:172.21.15.100:6789/0 conn(0x7f14a0145330 legacy=0x7f14a00d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f1484005cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484006330 0x7f1484006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1484007070 0x7f148400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00d0000 con 0x7f1484007070 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1484007780 con 0x7f1484006330 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.212+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f148400e110 con 0x7f14a00b53d0 2024-05-09T05:06:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149e800640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1484007070 0x7f148400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149de00640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f1484005cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f1497e00640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484006330 0x7f1484006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149e800640 1 -- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 msgr2=0x7f1484005cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149e800640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f1484005cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149e800640 1 -- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484006330 msgr2=0x7f1484006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149e800640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484006330 0x7f1484006a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149e800640 1 -- 172.21.15.100:0/2936750267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1484005730 con 0x7f1484007070 2024-05-09T05:06:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.213+0000 7f149de00640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a00b53d0 0x7f1484005cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.214+0000 7f149e800640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1484007070 0x7f148400dbd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1498007360 tx=0x7f1484007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719b5b79d6b99c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.214+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1498009be0 con 0x7f1484007070 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.214+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1498036600 con 0x7f1484007070 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.214+0000 7f149d400640 1 -- 172.21.15.100:0/2936750267 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14980369d0 con 0x7f1484007070 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149f200640 1 -- 172.21.15.100:0/2936750267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1484007070 msgr2=0x7f148400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149f200640 1 --2- 172.21.15.100:0/2936750267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1484007070 0x7f148400dbd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1498007360 tx=0x7f1484007a40 comp rx=0 tx=0).stop 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149e800640 1 -- 172.21.15.100:0/2936750267 reap_dead start 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149f200640 1 -- 172.21.15.100:0/2936750267 shutdown_connections 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149f200640 1 -- 172.21.15.100:0/2936750267 >> 172.21.15.100:0/2936750267 conn(0x7f14a006c3d0 msgr2=0x7f14a006c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149f200640 1 -- 172.21.15.100:0/2936750267 shutdown_connections 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.215+0000 7f149f200640 1 -- 172.21.15.100:0/2936750267 wait complete. 2024-05-09T05:06:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.217+0000 7f149f200640 1 Processor -- start 2024-05-09T05:06:20.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.217+0000 7f149f200640 1 -- start start 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f149f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484007070 0x7f14a0141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f149f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 0x7f14a0158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f149f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a013ded0 0x7f14a013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f149f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00b2fd0 con 0x7f14a015b850 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f149f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00cf6a0 con 0x7f1484007070 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f149f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f14a00b3150 con 0x7f14a013ded0 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f1497e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 0x7f14a0158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f1497e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 0x7f14a0158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40626/0 (socket says 172.21.15.100:40626) 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.218+0000 7f1497e00640 1 -- 172.21.15.100:0/2559100892 learned_addr learned my addr 172.21.15.100:0/2559100892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f149e800640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a013ded0 0x7f14a013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1497e00640 1 -- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a013ded0 msgr2=0x7f14a013e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f149de00640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484007070 0x7f14a0141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1497e00640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a013ded0 0x7f14a013e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1497e00640 1 -- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484007070 msgr2=0x7f14a0141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1497e00640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484007070 0x7f14a0141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1497e00640 1 -- 172.21.15.100:0/2559100892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a0158fb0 con 0x7f14a015b850 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f149e800640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a013ded0 0x7f14a013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1497e00640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 0x7f14a0158a70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f148800d770 tx=0x7f148800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488005270 con 0x7f14a015b850 2024-05-09T05:06:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1488017070 con 0x7f14a015b850 2024-05-09T05:06:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a013d220 con 0x7f14a015b850 2024-05-09T05:06:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148800b6b0 con 0x7f14a015b850 2024-05-09T05:06:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.219+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a013d7e0 con 0x7f14a015b850 2024-05-09T05:06:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.221+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a006a630 con 0x7f14a015b850 2024-05-09T05:06:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.222+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f148800b850 con 0x7f14a015b850 2024-05-09T05:06:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.223+0000 7f1496000640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f147c0762d0 0x7f147c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.223+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6663+0+0 (secure 0 0 0) 0x7f14880978c0 con 0x7f14a015b850 2024-05-09T05:06:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.223+0000 7f149de00640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f147c0762d0 0x7f147c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.224+0000 7f149de00640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f147c0762d0 0x7f147c078790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1490001eb0 tx=0x7f1490009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.227+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1488060e50 con 0x7f14a015b850 2024-05-09T05:06:20.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.432+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f14a00b46c0 con 0x7f14a015b850 2024-05-09T05:06:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.981+0000 7f1496000640 1 -- 172.21.15.100:0/2559100892 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) ==== 181+0+0 (secure 0 0 0) 0x7f1488060750 con 0x7f14a015b850 2024-05-09T05:06:20.982 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-05-09T05:06:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f147c0762d0 msgr2=0x7f147c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f147c0762d0 0x7f147c078790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1490001eb0 tx=0x7f1490009040 comp rx=0 tx=0).stop 2024-05-09T05:06:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 msgr2=0x7f14a0158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 0x7f14a0158a70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f148800d770 tx=0x7f148800dc30 comp rx=0 tx=0).stop 2024-05-09T05:06:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 shutdown_connections 2024-05-09T05:06:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f147c0762d0 0x7f147c078790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f14a013ded0 0x7f14a013e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a015b850 0x7f14a0158a70 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 --2- 172.21.15.100:0/2559100892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1484007070 0x7f14a0141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 >> 172.21.15.100:0/2559100892 conn(0x7f14a006c3d0 msgr2=0x7f14a015c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.985+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 shutdown_connections 2024-05-09T05:06:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:20.986+0000 7f149f200640 1 -- 172.21.15.100:0/2559100892 wait complete. 2024-05-09T05:06:21.012 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T05:06:21.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.201+0000 7f7800e00640 1 Processor -- start 2024-05-09T05:06:21.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.201+0000 7f7800e00640 1 -- start start 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f7800e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77fc0d5a80 0x7f77fc0d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f7800e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77fc0d1250 0x7f77fc0d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f7800e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77fc0d61f0 con 0x7f77fc15f5f0 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f7800e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc0d3960 con 0x7f77fc0d5a80 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f7800e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc0d5f10 con 0x7f77fc0d1250 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f77f9e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f77fc15f5f0 0x7f77fc0b6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54974/0 (socket says 172.21.15.100:54974) 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f77f9e00640 1 -- 172.21.15.100:0/3425071216 learned_addr learned my addr 172.21.15.100:0/3425071216 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:21.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.203+0000 7f77f9400640 1 --2- 172.21.15.100:0/3425071216 >> v2:172.21.15.100:3300/0 conn(0x7f77fc0d5a80 0x7f77fc0d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:21.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77fa800640 1 --2- 172.21.15.100:0/3425071216 >> v2:172.21.15.133:3300/0 conn(0x7f77fc0d1250 0x7f77fc0d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:21.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77f8a00640 1 -- 172.21.15.100:0/3425071216 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539780638 0 0) 0x7f77fc0d61f0 con 0x7f77fc15f5f0 2024-05-09T05:06:21.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77f8a00640 1 -- 172.21.15.100:0/3425071216 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77e0003520 con 0x7f77fc15f5f0 2024-05-09T05:06:21.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77f9400640 1 -- 172.21.15.100:0/3425071216 >> v2:172.21.15.133:3300/0 conn(0x7f77fc0d1250 msgr2=0x7f77fc0d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:21.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77f9400640 1 --2- 172.21.15.100:0/3425071216 >> v2:172.21.15.133:3300/0 conn(0x7f77fc0d1250 0x7f77fc0d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77f9400640 1 -- 172.21.15.100:0/3425071216 >> v1:172.21.15.100:6789/0 conn(0x7f77fc15f5f0 legacy=0x7f77fc0b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:21.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.204+0000 7f77f9400640 1 -- 172.21.15.100:0/3425071216 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0d3310 con 0x7f77fc0d5a80 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.205+0000 7f77f9400640 1 --2- 172.21.15.100:0/3425071216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d5a80 0x7f77fc0d3df0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0cfe80 tx=0x7f77e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732b026eccaf3f77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.205+0000 7f77f8a00640 1 -- 172.21.15.100:0/3425071216 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4037070 con 0x7f77fc0d5a80 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.205+0000 7f77f8a00640 1 -- 172.21.15.100:0/3425071216 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e4032440 con 0x7f77fc0d5a80 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.205+0000 7f77f8a00640 1 -- 172.21.15.100:0/3425071216 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4032810 con 0x7f77fc0d5a80 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 -- 172.21.15.100:0/3425071216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d5a80 msgr2=0x7f77fc0d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 --2- 172.21.15.100:0/3425071216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d5a80 0x7f77fc0d3df0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0cfe80 tx=0x7f77e402a1a0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 -- 172.21.15.100:0/3425071216 shutdown_connections 2024-05-09T05:06:21.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 --2- 172.21.15.100:0/3425071216 >> v2:172.21.15.133:3300/0 conn(0x7f77fc0d1250 0x7f77fc0d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 --2- 172.21.15.100:0/3425071216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d5a80 0x7f77fc0d3df0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 -- 172.21.15.100:0/3425071216 >> 172.21.15.100:0/3425071216 conn(0x7f77fc08cfa0 msgr2=0x7f77fc0d5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:21.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.206+0000 7f7800e00640 1 -- 172.21.15.100:0/3425071216 shutdown_connections 2024-05-09T05:06:21.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.207+0000 7f7800e00640 1 -- 172.21.15.100:0/3425071216 wait complete. 2024-05-09T05:06:21.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.208+0000 7f7800e00640 1 Processor -- start 2024-05-09T05:06:21.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.208+0000 7f7800e00640 1 -- start start 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.209+0000 7f7800e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 0x7f77fc1f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.209+0000 7f7800e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc15f5f0 0x7f77fc0b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.209+0000 7f7800e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0ba340 0x7f77fc0ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.209+0000 7f7800e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc15fb50 con 0x7f77fc0d1250 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.209+0000 7f7800e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc15f9d0 con 0x7f77fc15f5f0 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.209+0000 7f7800e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc0b7500 con 0x7f77fc0ba340 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 0x7f77fc1f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 0x7f77fc1f6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40632/0 (socket says 172.21.15.100:40632) 2024-05-09T05:06:21.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 -- 172.21.15.100:0/371476699 learned_addr learned my addr 172.21.15.100:0/371476699 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9400640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc15f5f0 0x7f77fc0b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77fa800640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0ba340 0x7f77fc0ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 -- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0ba340 msgr2=0x7f77fc0ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0ba340 0x7f77fc0ba7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 -- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc15f5f0 msgr2=0x7f77fc0b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc15f5f0 0x7f77fc0b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 -- 172.21.15.100:0/371476699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0bae00 con 0x7f77fc0d1250 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9400640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc15f5f0 0x7f77fc0b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.210+0000 7f77f9e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 0x7f77fc1f6410 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00cbf0 tx=0x7f77ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.211+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00ad40 con 0x7f77fc0d1250 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.211+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec012400 con 0x7f77fc0d1250 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.211+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0127b0 con 0x7f77fc0d1250 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.211+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc0c9f90 con 0x7f77fc0d1250 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.211+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc0b8970 con 0x7f77fc0d1250 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.212+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc069500 con 0x7f77fc0d1250 2024-05-09T05:06:21.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.213+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f77ec012950 con 0x7f77fc0d1250 2024-05-09T05:06:21.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.214+0000 7f77f2000640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:21.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.214+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6225+0+0 (secure 0 0 0) 0x7f77ec097e50 con 0x7f77fc0d1250 2024-05-09T05:06:21.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.214+0000 7f77f9400640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:21.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.215+0000 7f77f9400640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77e4034000 tx=0x7f77e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:21.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.219+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f77ec061590 con 0x7f77fc0d1250 2024-05-09T05:06:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.424+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77fc162f70 con 0x7f77fc0d1250 2024-05-09T05:06:21.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.985+0000 7f77f2000640 1 -- 172.21.15.100:0/371476699 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) ==== 169+0+0 (secure 0 0 0) 0x7f77ec060e90 con 0x7f77fc0d1250 2024-05-09T05:06:21.986 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 msgr2=0x7f77d8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77e4034000 tx=0x7f77e402e000 comp rx=0 tx=0).stop 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 msgr2=0x7f77fc1f6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 0x7f77fc1f6410 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00cbf0 tx=0x7f77ec00a430 comp rx=0 tx=0).stop 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 shutdown_connections 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f77d80762d0 0x7f77d8078790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77fc0ba340 0x7f77fc0ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77fc15f5f0 0x7f77fc0b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 --2- 172.21.15.100:0/371476699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77fc0d1250 0x7f77fc1f6410 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.989+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 >> 172.21.15.100:0/371476699 conn(0x7f77fc08cfa0 msgr2=0x7f77fc0b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.990+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 shutdown_connections 2024-05-09T05:06:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:21.990+0000 7f7800e00640 1 -- 172.21.15.100:0/371476699 wait complete. 2024-05-09T05:06:22.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_extra1 cephfs_data_extra1 --yes-i-really-really-mean-it 2024-05-09T05:06:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.208+0000 7fad70200640 1 Processor -- start 2024-05-09T05:06:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.208+0000 7fad70200640 1 -- start start 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad70200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad681639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad70200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fad680b5e10 0x7fad68160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad70200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad6815f8c0 con 0x7fad680724b0 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad70200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fad681608c0 con 0x7fad680b5e10 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad70200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fad6815fef0 con 0x7fad6806fd50 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad6e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fad680b5e10 0x7fad68160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad6ce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fad680724b0 0x7fad680b5700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33626/0 (socket says 172.21.15.100:33626) 2024-05-09T05:06:22.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.210+0000 7fad6ce00640 1 -- 172.21.15.100:0/3729301535 learned_addr learned my addr 172.21.15.100:0/3729301535 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:22.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.211+0000 7fad6d800640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad681639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:22.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.211+0000 7fad6e200640 1 -- 172.21.15.100:0/3729301535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 msgr2=0x7fad681639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:22.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.211+0000 7fad6e200640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad681639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.211+0000 7fad6e200640 1 -- 172.21.15.100:0/3729301535 >> v1:172.21.15.100:6789/0 conn(0x7fad680724b0 legacy=0x7fad680b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:22.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.211+0000 7fad6e200640 1 -- 172.21.15.100:0/3729301535 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad68072c30 con 0x7fad680b5e10 2024-05-09T05:06:22.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.211+0000 7fad6d800640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad681639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:22.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.212+0000 7fad6e200640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680b5e10 0x7fad68160380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fad60009d90 tx=0x7fad6002a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bfb6a0c1e195c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:22.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.212+0000 7fad67e00640 1 -- 172.21.15.100:0/3729301535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60007740 con 0x7fad680b5e10 2024-05-09T05:06:22.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.212+0000 7fad67e00640 1 -- 172.21.15.100:0/3729301535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad600078e0 con 0x7fad680b5e10 2024-05-09T05:06:22.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.212+0000 7fad67e00640 1 -- 172.21.15.100:0/3729301535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60007cb0 con 0x7fad680b5e10 2024-05-09T05:06:22.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 -- 172.21.15.100:0/3729301535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680b5e10 msgr2=0x7fad68160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:22.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680b5e10 0x7fad68160380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fad60009d90 tx=0x7fad6002a650 comp rx=0 tx=0).stop 2024-05-09T05:06:22.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 -- 172.21.15.100:0/3729301535 shutdown_connections 2024-05-09T05:06:22.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680b5e10 0x7fad68160380 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 --2- 172.21.15.100:0/3729301535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad681639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 -- 172.21.15.100:0/3729301535 >> 172.21.15.100:0/3729301535 conn(0x7fad680b2c20 msgr2=0x7fad680b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:22.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 -- 172.21.15.100:0/3729301535 shutdown_connections 2024-05-09T05:06:22.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.213+0000 7fad70200640 1 -- 172.21.15.100:0/3729301535 wait complete. 2024-05-09T05:06:22.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.215+0000 7fad70200640 1 Processor -- start 2024-05-09T05:06:22.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.216+0000 7fad70200640 1 -- start start 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad70200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad6814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad70200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 0x7fad680ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad70200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680b5e10 0x7fad680ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad70200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad68072930 con 0x7fad680724b0 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad70200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fad6815fb80 con 0x7fad680b5e10 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad70200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fad6806e470 con 0x7fad6806fd50 2024-05-09T05:06:22.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad6ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 0x7fad680ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:22.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad6ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 0x7fad680ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35196/0 (socket says 172.21.15.100:35196) 2024-05-09T05:06:22.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.217+0000 7fad6ce00640 1 -- 172.21.15.100:0/3397377438 learned_addr learned my addr 172.21.15.100:0/3397377438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6d800640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad6814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6ce00640 1 -- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 msgr2=0x7fad6814a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6ce00640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad6814a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6ce00640 1 -- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680b5e10 msgr2=0x7fad680ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6ce00640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680b5e10 0x7fad680ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6ce00640 1 -- 172.21.15.100:0/3397377438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad680aff80 con 0x7fad680724b0 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.218+0000 7fad6ce00640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 0x7fad680ca2a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad5400c500 tx=0x7fad5400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.219+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54017070 con 0x7fad680724b0 2024-05-09T05:06:22.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.219+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54005d00 con 0x7fad680724b0 2024-05-09T05:06:22.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.219+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54007330 con 0x7fad680724b0 2024-05-09T05:06:22.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.219+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6814a800 con 0x7fad680724b0 2024-05-09T05:06:22.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.219+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6814adc0 con 0x7fad680724b0 2024-05-09T05:06:22.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.220+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad68069500 con 0x7fad680724b0 2024-05-09T05:06:22.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.223+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fad5401a070 con 0x7fad680724b0 2024-05-09T05:06:22.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.224+0000 7fad65600640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad480762d0 0x7fad48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:22.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.224+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5753+0+0 (secure 0 0 0) 0x7fad540969e0 con 0x7fad680724b0 2024-05-09T05:06:22.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.226+0000 7fad6d800640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad480762d0 0x7fad48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:22.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.229+0000 7fad6d800640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad480762d0 0x7fad48078790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00a9e0 tx=0x7fad5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:22.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.233+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fad54060300 con 0x7fad680724b0 2024-05-09T05:06:22.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.444+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_extra1", "pool2": "cephfs_data_extra1", "yes_i_really_really_mean_it": true} v 0) -- 0x7fad680b3810 con 0x7fad680724b0 2024-05-09T05:06:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.988+0000 7fad65600640 1 -- 172.21.15.100:0/3397377438 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_extra1", "pool2": "cephfs_data_extra1", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_extra1' removed v59) ==== 190+0+0 (secure 0 0 0) 0x7fad5405fc00 con 0x7fad680724b0 2024-05-09T05:06:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_extra1' removed 2024-05-09T05:06:22.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad480762d0 msgr2=0x7fad48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:22.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad480762d0 0x7fad48078790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00a9e0 tx=0x7fad5c008040 comp rx=0 tx=0).stop 2024-05-09T05:06:22.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 msgr2=0x7fad680ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 0x7fad680ca2a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fad5400c500 tx=0x7fad5400c9c0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 shutdown_connections 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fad480762d0 0x7fad48078790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680b5e10 0x7fad680ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad680724b0 0x7fad680ca2a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 --2- 172.21.15.100:0/3397377438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad6806fd50 0x7fad6814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.993+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 >> 172.21.15.100:0/3397377438 conn(0x7fad680b2c20 msgr2=0x7fad6815dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.994+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 shutdown_connections 2024-05-09T05:06:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:22.994+0000 7fad70200640 1 -- 172.21.15.100:0/3397377438 wait complete. 2024-05-09T05:06:23.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_extra2 cephfs_data_extra2 --yes-i-really-really-mean-it 2024-05-09T05:06:23.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.221+0000 7f0418000640 1 Processor -- start 2024-05-09T05:06:23.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.221+0000 7f0418000640 1 -- start start 2024-05-09T05:06:23.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0418000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 0x7f04100b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0418000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04100aecd0 con 0x7f041015c120 2024-05-09T05:06:23.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0418000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04100aef40 con 0x7f04100b4630 2024-05-09T05:06:23.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0418000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f04100af870 con 0x7f04100afd00 2024-05-09T05:06:23.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0415600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f041015c120 0x7f04100b3f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33640/0 (socket says 172.21.15.100:33640) 2024-05-09T05:06:23.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0415600640 1 -- 172.21.15.100:0/1544264233 learned_addr learned my addr 172.21.15.100:0/1544264233 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:23.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127255910 0 0) 0x7f04100aecd0 con 0x7f041015c120 2024-05-09T05:06:23.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f0414c00640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 0x7f04100b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.223+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03f8005730 con 0x7f041015c120 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4237175811 0 0) 0x7f03f8005730 con 0x7f041015c120 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 msgr2=0x7f04100b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 0x7f04100b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 >> v1:172.21.15.133:6789/0 conn(0x7f04100b4630 legacy=0x7f041015c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04100af220 con 0x7f041015c120 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f04040016f0 con 0x7f041015c120 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 >> v1:172.21.15.100:6789/0 conn(0x7f041015c120 legacy=0x7f04100b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f8005c40 0x7f03f8006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8006a10 0x7f03f8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 0x7f03f800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04100af870 con 0x7f03f8005c40 2024-05-09T05:06:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8007750 con 0x7f03f8006a10 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f03f800e110 con 0x7f04100afd00 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.224+0000 7f0415600640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f8005c40 0x7f03f8006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.225+0000 7f0415600640 1 -- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 msgr2=0x7f03f800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.225+0000 7f0415600640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04100afd00 0x7f03f800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.225+0000 7f0415600640 1 -- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8006a10 msgr2=0x7f03f8006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.225+0000 7f0415600640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8006a10 0x7f03f8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.225+0000 7f0415600640 1 -- 172.21.15.100:0/1544264233 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f8005730 con 0x7f03f8005c40 2024-05-09T05:06:23.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.226+0000 7f0415600640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f8005c40 0x7f03f8006060 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f040400c290 tx=0x7f03f8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a49416475a5adf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:23.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.226+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404007d50 con 0x7f03f8005c40 2024-05-09T05:06:23.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.226+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0404005af0 con 0x7f03f8005c40 2024-05-09T05:06:23.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.226+0000 7f040fe00640 1 -- 172.21.15.100:0/1544264233 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404007070 con 0x7f03f8005c40 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0418000640 1 -- 172.21.15.100:0/1544264233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f8005c40 msgr2=0x7f03f8006060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0418000640 1 --2- 172.21.15.100:0/1544264233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03f8005c40 0x7f03f8006060 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f040400c290 tx=0x7f03f8007a40 comp rx=0 tx=0).stop 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0416000640 1 -- 172.21.15.100:0/1544264233 reap_dead start 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0418000640 1 -- 172.21.15.100:0/1544264233 shutdown_connections 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0418000640 1 -- 172.21.15.100:0/1544264233 >> 172.21.15.100:0/1544264233 conn(0x7f04100b2c20 msgr2=0x7f04100b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0418000640 1 -- 172.21.15.100:0/1544264233 shutdown_connections 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.227+0000 7f0418000640 1 -- 172.21.15.100:0/1544264233 wait complete. 2024-05-09T05:06:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.229+0000 7f0418000640 1 Processor -- start 2024-05-09T05:06:23.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.229+0000 7f0418000640 1 -- start start 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0418000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8005c40 0x7f04101e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0418000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0410148930 0x7f041009bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0418000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 0x7f041015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0418000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04100b4a80 con 0x7f041009c070 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0418000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f04100b0160 con 0x7f03f8005c40 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0418000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f04100b4c00 con 0x7f0410148930 2024-05-09T05:06:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0416000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 0x7f041015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0416000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 0x7f041015a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35208/0 (socket says 172.21.15.100:35208) 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0416000640 1 -- 172.21.15.100:0/136182454 learned_addr learned my addr 172.21.15.100:0/136182454 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.230+0000 7f0415600640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8005c40 0x7f04101e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0414c00640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0410148930 0x7f041009bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0416000640 1 -- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0410148930 msgr2=0x7f041009bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0416000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0410148930 0x7f041009bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0416000640 1 -- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8005c40 msgr2=0x7f04101e6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0416000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8005c40 0x7f04101e6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0416000640 1 -- 172.21.15.100:0/136182454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041009e170 con 0x7f041009c070 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0416000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 0x7f041015a790 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0410072040 tx=0x7f040800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408017070 con 0x7f041009c070 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408005d40 con 0x7f041009c070 2024-05-09T05:06:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800a7f0 con 0x7f041009c070 2024-05-09T05:06:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.231+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041009e450 con 0x7f041009c070 2024-05-09T05:06:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.232+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041015a270 con 0x7f041009c070 2024-05-09T05:06:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.233+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041015a470 con 0x7f041009c070 2024-05-09T05:06:23.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.234+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f040800a990 con 0x7f041009c070 2024-05-09T05:06:23.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.235+0000 7f040d600640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f03f00762d0 0x7f03f0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:23.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.235+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5348+0+0 (secure 0 0 0) 0x7f04080966b0 con 0x7f041009c070 2024-05-09T05:06:23.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.236+0000 7f0415600640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f03f00762d0 0x7f03f0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:23.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.236+0000 7f0415600640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f03f00762d0 0x7f03f0078790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0404007fd0 tx=0x7f040402d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:23.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.240+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f041015a470 con 0x7f041009c070 2024-05-09T05:06:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:23.445+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_extra2", "pool2": "cephfs_data_extra2", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0410069500 con 0x7f041009c070 2024-05-09T05:06:24.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.013+0000 7f040d600640 1 -- 172.21.15.100:0/136182454 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_extra2", "pool2": "cephfs_data_extra2", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_extra2' removed v60) ==== 190+0+0 (secure 0 0 0) 0x7f0408060160 con 0x7f041009c070 2024-05-09T05:06:24.014 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_extra2' removed 2024-05-09T05:06:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.017+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f03f00762d0 msgr2=0x7f03f0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.017+0000 7f0418000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f03f00762d0 0x7f03f0078790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0404007fd0 tx=0x7f040402d000 comp rx=0 tx=0).stop 2024-05-09T05:06:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.017+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 msgr2=0x7f041015a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.017+0000 7f0418000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 0x7f041015a790 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0410072040 tx=0x7f040800cb90 comp rx=0 tx=0).stop 2024-05-09T05:06:24.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.020+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 shutdown_connections 2024-05-09T05:06:24.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.020+0000 7f0418000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f03f00762d0 0x7f03f0078790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.020+0000 7f0418000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f041009c070 0x7f041015a790 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.020+0000 7f0418000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0410148930 0x7f041009bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.020+0000 7f0418000640 1 --2- 172.21.15.100:0/136182454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8005c40 0x7f04101e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.020+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 >> 172.21.15.100:0/136182454 conn(0x7f04100b2c20 msgr2=0x7f04100b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:24.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.024+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 shutdown_connections 2024-05-09T05:06:24.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.024+0000 7f0418000640 1 -- 172.21.15.100:0/136182454 wait complete. 2024-05-09T05:06:24.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-09T05:06:24.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.238+0000 7ff385600640 1 Processor -- start 2024-05-09T05:06:24.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.238+0000 7ff385600640 1 -- start start 2024-05-09T05:06:24.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff385600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff3800b02a0 0x7ff3800cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff385600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3800b0750 0x7ff3800d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff385600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff380160ba0 con 0x7ff38015d1b0 2024-05-09T05:06:24.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff385600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff38015d590 con 0x7ff3800b02a0 2024-05-09T05:06:24.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff385600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7ff38015ff90 con 0x7ff3800b0750 2024-05-09T05:06:24.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff37ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff38015d1b0 0x7ff3800b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33654/0 (socket says 172.21.15.100:33654) 2024-05-09T05:06:24.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff37ea00640 1 -- 172.21.15.100:0/1300413797 learned_addr learned my addr 172.21.15.100:0/1300413797 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:24.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.240+0000 7ff37e000640 1 --2- 172.21.15.100:0/1300413797 >> v2:172.21.15.100:3300/0 conn(0x7ff3800b02a0 0x7ff3800cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37f400640 1 --2- 172.21.15.100:0/1300413797 >> v2:172.21.15.133:3300/0 conn(0x7ff3800b0750 0x7ff3800d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37d600640 1 -- 172.21.15.100:0/1300413797 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180918749 0 0) 0x7ff380160ba0 con 0x7ff38015d1b0 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37d600640 1 -- 172.21.15.100:0/1300413797 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff364003520 con 0x7ff38015d1b0 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37e000640 1 -- 172.21.15.100:0/1300413797 >> v2:172.21.15.133:3300/0 conn(0x7ff3800b0750 msgr2=0x7ff3800d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37e000640 1 --2- 172.21.15.100:0/1300413797 >> v2:172.21.15.133:3300/0 conn(0x7ff3800b0750 0x7ff3800d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37e000640 1 -- 172.21.15.100:0/1300413797 >> v1:172.21.15.100:6789/0 conn(0x7ff38015d1b0 legacy=0x7ff3800b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.241+0000 7ff37e000640 1 -- 172.21.15.100:0/1300413797 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff380160270 con 0x7ff3800b02a0 2024-05-09T05:06:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.242+0000 7ff37e000640 1 --2- 172.21.15.100:0/1300413797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b02a0 0x7ff3800cff00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff380070750 tx=0x7ff36c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a558cd263ccd633 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.242+0000 7ff37d600640 1 -- 172.21.15.100:0/1300413797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c037070 con 0x7ff3800b02a0 2024-05-09T05:06:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.242+0000 7ff37d600640 1 -- 172.21.15.100:0/1300413797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c032440 con 0x7ff3800b02a0 2024-05-09T05:06:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.242+0000 7ff37d600640 1 -- 172.21.15.100:0/1300413797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c02ae60 con 0x7ff3800b02a0 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 -- 172.21.15.100:0/1300413797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b02a0 msgr2=0x7ff3800cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 --2- 172.21.15.100:0/1300413797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b02a0 0x7ff3800cff00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff380070750 tx=0x7ff36c02a110 comp rx=0 tx=0).stop 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 -- 172.21.15.100:0/1300413797 shutdown_connections 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 --2- 172.21.15.100:0/1300413797 >> v2:172.21.15.133:3300/0 conn(0x7ff3800b0750 0x7ff3800d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 --2- 172.21.15.100:0/1300413797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b02a0 0x7ff3800cff00 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 -- 172.21.15.100:0/1300413797 >> 172.21.15.100:0/1300413797 conn(0x7ff3800b2c90 msgr2=0x7ff3800b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 -- 172.21.15.100:0/1300413797 shutdown_connections 2024-05-09T05:06:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.243+0000 7ff385600640 1 -- 172.21.15.100:0/1300413797 wait complete. 2024-05-09T05:06:24.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.245+0000 7ff385600640 1 Processor -- start 2024-05-09T05:06:24.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.245+0000 7ff385600640 1 -- start start 2024-05-09T05:06:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff385600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3800b02a0 0x7ff380072670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff385600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 0x7ff38014b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff385600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38015d1b0 0x7ff380073f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff385600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff38015fc10 con 0x7ff3800b0750 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff385600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff380160830 con 0x7ff38015d1b0 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff385600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff380163510 con 0x7ff3800b02a0 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff37e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 0x7ff38014b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff37e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 0x7ff38014b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35218/0 (socket says 172.21.15.100:35218) 2024-05-09T05:06:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.246+0000 7ff37e000640 1 -- 172.21.15.100:0/1674638423 learned_addr learned my addr 172.21.15.100:0/1674638423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37e000640 1 -- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3800b02a0 msgr2=0x7ff380072670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37e000640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3800b02a0 0x7ff380072670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37f400640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38015d1b0 0x7ff380073f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37e000640 1 -- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38015d1b0 msgr2=0x7ff380073f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37e000640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38015d1b0 0x7ff380073f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37e000640 1 -- 172.21.15.100:0/1674638423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800ae1a0 con 0x7ff3800b0750 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37f400640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38015d1b0 0x7ff380073f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff37e000640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 0x7ff38014b910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff36c000c00 tx=0x7ff36c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c037050 con 0x7ff3800b0750 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c038040 con 0x7ff3800b0750 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3800ae480 con 0x7ff3800b0750 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004450 con 0x7ff3800b0750 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.247+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38014be50 con 0x7ff3800b0750 2024-05-09T05:06:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.249+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38006a630 con 0x7ff3800b0750 2024-05-09T05:06:24.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.250+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff36c03c6d0 con 0x7ff3800b0750 2024-05-09T05:06:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.251+0000 7ff376a00640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff360076300 0x7ff3600787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.251+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7ff36c0b7dd0 con 0x7ff3800b0750 2024-05-09T05:06:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.251+0000 7ff37ea00640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff360076300 0x7ff3600787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.252+0000 7ff37ea00640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff360076300 0x7ff3600787c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff370001220 tx=0x7ff3700078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:24.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.256+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff36c081990 con 0x7ff3800b0750 2024-05-09T05:06:24.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.477+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff3800d07e0 con 0x7ff3800b0750 2024-05-09T05:06:24.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.484+0000 7ff376a00640 1 -- 172.21.15.100:0/1674638423 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7ff36c081290 con 0x7ff3800b0750 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff360076300 msgr2=0x7ff3600787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff360076300 0x7ff3600787c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff370001220 tx=0x7ff3700078f0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 msgr2=0x7ff38014b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 0x7ff38014b910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff36c000c00 tx=0x7ff36c0046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 shutdown_connections 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff360076300 0x7ff3600787c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff38015d1b0 0x7ff380073f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3800b0750 0x7ff38014b910 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 --2- 172.21.15.100:0/1674638423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3800b02a0 0x7ff380072670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 >> 172.21.15.100:0/1674638423 conn(0x7ff3800b2c90 msgr2=0x7ff38006e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:24.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.487+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 shutdown_connections 2024-05-09T05:06:24.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.488+0000 7ff385600640 1 -- 172.21.15.100:0/1674638423 wait complete. 2024-05-09T05:06:24.508 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace_flush_on_deleted_data_pool' 2024-05-09T05:06:24.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.707+0000 7f83d2000640 1 Processor -- start 2024-05-09T05:06:24.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.707+0000 7f83d2000640 1 -- start start 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.709+0000 7f83d2000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc145900 0x7f83cc073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.709+0000 7f83d2000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83cc0b45c0 0x7f83cc06f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.709+0000 7f83d2000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc06ead0 con 0x7f83cc0739a0 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.709+0000 7f83d2000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f83cc06f390 con 0x7f83cc0b45c0 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.709+0000 7f83d2000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc06ed40 con 0x7f83cc145900 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.709+0000 7f83cbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83cc0b45c0 0x7f83cc06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83cc0b45c0 0x7f83cc06f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35224/0 (socket says 172.21.15.100:35224) 2024-05-09T05:06:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cbe00640 1 -- 172.21.15.100:0/3502024368 learned_addr learned my addr 172.21.15.100:0/3502024368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cb400640 1 --2- 172.21.15.100:0/3502024368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc145900 0x7f83cc073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cbe00640 1 -- 172.21.15.100:0/3502024368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc145900 msgr2=0x7f83cc073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cbe00640 1 --2- 172.21.15.100:0/3502024368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc145900 0x7f83cc073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cbe00640 1 -- 172.21.15.100:0/3502024368 >> v1:172.21.15.133:6789/0 conn(0x7f83cc0739a0 legacy=0x7f83cc0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.710+0000 7f83cbe00640 1 -- 172.21.15.100:0/3502024368 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc06f020 con 0x7f83cc0b45c0 2024-05-09T05:06:24.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.711+0000 7f83cbe00640 1 --2- 172.21.15.100:0/3502024368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc06f820 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e50 tx=0x7f83c402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33886d51b59b3c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:24.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.712+0000 7f83ca000640 1 -- 172.21.15.100:0/3502024368 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4036070 con 0x7f83cc0b45c0 2024-05-09T05:06:24.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.712+0000 7f83ca000640 1 -- 172.21.15.100:0/3502024368 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c4031600 con 0x7f83cc0b45c0 2024-05-09T05:06:24.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.712+0000 7f83ca000640 1 -- 172.21.15.100:0/3502024368 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c40319d0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.712+0000 7f83d2000640 1 -- 172.21.15.100:0/3502024368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 msgr2=0x7f83cc06f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.712+0000 7f83d2000640 1 --2- 172.21.15.100:0/3502024368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc06f820 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009e50 tx=0x7f83c402a710 comp rx=0 tx=0).stop 2024-05-09T05:06:24.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.713+0000 7f83d2000640 1 -- 172.21.15.100:0/3502024368 shutdown_connections 2024-05-09T05:06:24.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.713+0000 7f83d2000640 1 --2- 172.21.15.100:0/3502024368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc06f820 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.713+0000 7f83d2000640 1 --2- 172.21.15.100:0/3502024368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc145900 0x7f83cc073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.713+0000 7f83d2000640 1 -- 172.21.15.100:0/3502024368 >> 172.21.15.100:0/3502024368 conn(0x7f83cc0b31e0 msgr2=0x7f83cc0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.713+0000 7f83d2000640 1 -- 172.21.15.100:0/3502024368 shutdown_connections 2024-05-09T05:06:24.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.713+0000 7f83d2000640 1 -- 172.21.15.100:0/3502024368 wait complete. 2024-05-09T05:06:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.714+0000 7f83d2000640 1 Processor -- start 2024-05-09T05:06:24.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.714+0000 7f83d2000640 1 -- start start 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.715+0000 7f83d2000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc0739a0 0x7f83cc1632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.715+0000 7f83d2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.715+0000 7f83d2000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc145900 0x7f83cc142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.715+0000 7f83d2000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc145ce0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.715+0000 7f83d2000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0ade90 con 0x7f83cc145900 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.715+0000 7f83d2000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc145e60 con 0x7f83cc0739a0 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc0afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35234/0 (socket says 172.21.15.100:35234) 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 -- 172.21.15.100:0/1874012414 learned_addr learned my addr 172.21.15.100:0/1874012414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83cb400640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc0739a0 0x7f83cc1632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83cbe00640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc145900 0x7f83cc142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 -- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc0739a0 msgr2=0x7f83cc1632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc0739a0 0x7f83cc1632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 -- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc145900 msgr2=0x7f83cc142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc145900 0x7f83cc142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.716+0000 7f83caa00640 1 -- 172.21.15.100:0/1874012414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc1637f0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.717+0000 7f83caa00640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc0afa20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c420 tx=0x7f83b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.717+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8017070 con 0x7f83cc0b45c0 2024-05-09T05:06:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.717+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b80052d0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.717+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8003830 con 0x7f83cc0b45c0 2024-05-09T05:06:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.717+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc0ae0a0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.717+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc0ae940 con 0x7f83cc0b45c0 2024-05-09T05:06:24.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.718+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc06a5c0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.719+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83b801a070 con 0x7f83cc0b45c0 2024-05-09T05:06:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.720+0000 7f83c3400640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f83ac0762d0 0x7f83ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.721+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f83b80966a0 con 0x7f83cc0b45c0 2024-05-09T05:06:24.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.721+0000 7f83cb400640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f83ac0762d0 0x7f83ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:24.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.722+0000 7f83cb400640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f83ac0762d0 0x7f83ac078790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f83bc006fd0 tx=0x7f83bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:24.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:24.725+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83b80602f0 con 0x7f83cc0b45c0 2024-05-09T05:06:25.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:25.012+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace_flush_on_deleted_data_pool"]} v 0) -- 0x7f83cc143a40 con 0x7f83cc0b45c0 2024-05-09T05:06:26.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.026+0000 7f83c3400640 1 -- 172.21.15.100:0/1874012414 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace_flush_on_deleted_data_pool"]}]=0 v138) ==== 162+0+0 (secure 0 0 0) 0x7f83b80682e0 con 0x7f83cc0b45c0 2024-05-09T05:06:26.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f83ac0762d0 msgr2=0x7f83ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f83ac0762d0 0x7f83ac078790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f83bc006fd0 tx=0x7f83bc008040 comp rx=0 tx=0).stop 2024-05-09T05:06:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 msgr2=0x7f83cc0afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc0afa20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c420 tx=0x7f83b800c8e0 comp rx=0 tx=0).stop 2024-05-09T05:06:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 shutdown_connections 2024-05-09T05:06:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f83ac0762d0 0x7f83ac078790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:26.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83cc145900 0x7f83cc142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:26.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc0b45c0 0x7f83cc0afa20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:26.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 --2- 172.21.15.100:0/1874012414 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83cc0739a0 0x7f83cc1632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:26.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.030+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 >> 172.21.15.100:0/1874012414 conn(0x7f83cc0b31e0 msgr2=0x7f83cc09de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:26.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.031+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 shutdown_connections 2024-05-09T05:06:26.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:26.031+0000 7f83d2000640 1 -- 172.21.15.100:0/1874012414 wait complete. 2024-05-09T05:06:26.054 INFO:tasks.cephfs_test_runner:that the MDS does not go read-only when handling backtrace update errors ... ERROR 2024-05-09T05:06:26.054 INFO:tasks.cephfs_test_runner: 2024-05-09T05:06:26.054 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace) 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner:that the MDS does not go read-only when handling backtrace update errors 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks/cephfs/test_backtrace.py", line 121, in test_backtrace_flush_on_deleted_data_pool 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: self.mount_a.run_shell(["setfattr", "-x", "ceph.dir.layout.pool", "dir_x"]) 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks/cephfs/mount.py", line 776, in run_shell 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, **kwargs) 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: r.wait() 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-09T05:06:26.055 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -x ceph.dir.layout.pool dir_x)' 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:Ran 2 tests in 93.241s 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace) 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:that the MDS does not go read-only when handling backtrace update errors 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks/cephfs/test_backtrace.py", line 121, in test_backtrace_flush_on_deleted_data_pool 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: self.mount_a.run_shell(["setfattr", "-x", "ceph.dir.layout.pool", "dir_x"]) 2024-05-09T05:06:26.056 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks/cephfs/mount.py", line 776, in run_shell 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, **kwargs) 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: r.wait() 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -x ceph.dir.layout.pool dir_x)' 2024-05-09T05:06:26.057 INFO:tasks.cephfs_test_runner: 2024-05-09T05:06:26.058 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace) 2024-05-09T05:06:26.294 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a4e5438f226b4681b17493b679ec633b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_a2e1088fa282408acd6a8a29f9417b763c0a8663/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace) 2024-05-09T05:06:26.295 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-09T05:06:26.305 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T05:06:26.314 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T05:06:26.314 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:06:26.314 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:26.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052691,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248964k,nr_inodes=812241,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-09T05:06:26.374 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:06:26.374 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:26.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052691,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248964k,nr_inodes=812241,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497936k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-09T05:06:26.428 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:06:26.428 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:26.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:06:26.481 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-05-09T05:06:26.482 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:06:26.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052721,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497984k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-09T05:06:26.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:26.528 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:06:26.585 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T05:06:26.585 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-09T05:06:26.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:26.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:06:26.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:26.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-09T05:06:26.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:26.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-05-09T05:06:26.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:26.869 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-05-09T05:06:26.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:26.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-05-09T05:06:27.031 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-05-09T05:06:27.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:06:27.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:27.035 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-05-09T05:06:27.088 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-09T05:06:27.088 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-09T05:06:27.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:27.089 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-09T05:06:27.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:27.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-09T05:06:27.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:27.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-05-09T05:06:27.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:27.369 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-05-09T05:06:27.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:06:27.410 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-05-09T05:06:27.536 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-05-09T05:06:27.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:06:27.539 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-09T05:06:27.558 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-09T05:06:27.558 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:27.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.770+0000 7ff463200640 1 Processor -- start 2024-05-09T05:06:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.770+0000 7ff463200640 1 -- start start 2024-05-09T05:06:27.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.771+0000 7ff463200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff46415d4d0 0x7ff4640d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.771+0000 7ff463200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4640b3520 con 0x7ff4640d1a10 2024-05-09T05:06:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.771+0000 7ff463200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4640d0190 con 0x7ff46415d0f0 2024-05-09T05:06:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.771+0000 7ff463200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff4640d0470 con 0x7ff46415d4d0 2024-05-09T05:06:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff462800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff4640d1a10 0x7ff4640ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33662/0 (socket says 172.21.15.100:33662) 2024-05-09T05:06:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff462800640 1 -- 172.21.15.100:0/1931141916 learned_addr learned my addr 172.21.15.100:0/1931141916 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff461400640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff46415d4d0 0x7ff4640d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748572125 0 0) 0x7ff4640b3520 con 0x7ff4640d1a10 2024-05-09T05:06:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff448003520 con 0x7ff4640d1a10 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2622041694 0 0) 0x7ff448003520 con 0x7ff4640d1a10 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff46415d4d0 msgr2=0x7ff4640d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff46415d4d0 0x7ff4640d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 >> v1:172.21.15.133:6789/0 conn(0x7ff46415d0f0 legacy=0x7ff4640b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.772+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4640cdbe0 con 0x7ff4640d1a10 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7ff45c001a70 con 0x7ff4640d1a10 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 >> v1:172.21.15.100:6789/0 conn(0x7ff4640d1a10 legacy=0x7ff4640ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448003a30 0x7ff448003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff448004800 0x7ff448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4480052e0 0x7ff44800fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640d0470 con 0x7ff448004800 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4480105c0 con 0x7ff448003a30 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff4480107c0 con 0x7ff4480052e0 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff461400640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff46415d4d0 0x7ff4640d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff461400640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff448004800 0x7ff448004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.773+0000 7ff461e00640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448003a30 0x7ff448003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff462800640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4480052e0 0x7ff44800fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff461400640 1 -- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4480052e0 msgr2=0x7ff44800fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff461400640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4480052e0 0x7ff44800fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff461400640 1 -- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448003a30 msgr2=0x7ff448003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff461400640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448003a30 0x7ff448003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff461400640 1 -- 172.21.15.100:0/1931141916 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff448003520 con 0x7ff448004800 2024-05-09T05:06:27.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.774+0000 7ff462800640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4480052e0 0x7ff44800fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff461400640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff448004800 0x7ff448004c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0288767093d7ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450037070 con 0x7ff448004800 2024-05-09T05:06:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45002ab10 con 0x7ff448004800 2024-05-09T05:06:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff460a00640 1 -- 172.21.15.100:0/1931141916 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45000f040 con 0x7ff448004800 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff463200640 1 -- 172.21.15.100:0/1931141916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff448004800 msgr2=0x7ff448004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff463200640 1 --2- 172.21.15.100:0/1931141916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff448004800 0x7ff448004c80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff450006fd0 tx=0x7ff448005830 comp rx=0 tx=0).stop 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.775+0000 7ff462800640 1 -- 172.21.15.100:0/1931141916 reap_dead start 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.776+0000 7ff463200640 1 -- 172.21.15.100:0/1931141916 shutdown_connections 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.776+0000 7ff463200640 1 -- 172.21.15.100:0/1931141916 >> 172.21.15.100:0/1931141916 conn(0x7ff46409ba10 msgr2=0x7ff46409be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.776+0000 7ff463200640 1 -- 172.21.15.100:0/1931141916 shutdown_connections 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.776+0000 7ff463200640 1 -- 172.21.15.100:0/1931141916 wait complete. 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.777+0000 7ff463200640 1 Processor -- start 2024-05-09T05:06:27.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 -- start start 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448004800 0x7ff46415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4641571a0 0x7ff46414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 0x7ff4641590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640cec70 con 0x7ff464158c30 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640ceaf0 con 0x7ff448004800 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.778+0000 7ff463200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff4640cedf0 con 0x7ff4641571a0 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 0x7ff4641590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:27.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 0x7ff4641590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35246/0 (socket says 172.21.15.100:35246) 2024-05-09T05:06:27.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 -- 172.21.15.100:0/284118849 learned_addr learned my addr 172.21.15.100:0/284118849 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:27.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 -- 172.21.15.100:0/284118849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4641571a0 msgr2=0x7ff46414c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:27.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4641571a0 0x7ff46414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:27.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 -- 172.21.15.100:0/284118849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448004800 msgr2=0x7ff46415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:27.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448004800 0x7ff46415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:27.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 -- 172.21.15.100:0/284118849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4641f46f0 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.779+0000 7ff462800640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 0x7ff4641590b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff464075e60 tx=0x7ff45c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.780+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c004d60 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.780+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c00bb20 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.780+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4641f49d0 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.780+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c007070 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.780+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641f4f90 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.781+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4640ccee0 con 0x7ff464158c30 2024-05-09T05:06:27.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.782+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff45c01b020 con 0x7ff464158c30 2024-05-09T05:06:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.783+0000 7ff45a000640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4440762d0 0x7ff444078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.784+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7ff45c0974f0 con 0x7ff464158c30 2024-05-09T05:06:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.784+0000 7ff461e00640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4440762d0 0x7ff444078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:27.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.784+0000 7ff461e00640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4440762d0 0x7ff444078790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff454007fd0 tx=0x7ff454009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:27.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.788+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff45c0610b0 con 0x7ff464158c30 2024-05-09T05:06:27.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.994+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4640d3c70 con 0x7ff4440762d0 2024-05-09T05:06:27.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:27.997+0000 7ff45a000640 1 -- 172.21.15.100:0/284118849 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13461 (secure 0 0 0) 0x7ff4640d3c70 con 0x7ff4440762d0 2024-05-09T05:06:27.998 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:27.998 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4440762d0 msgr2=0x7ff444078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4440762d0 0x7ff444078790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff454007fd0 tx=0x7ff454009040 comp rx=0 tx=0).stop 2024-05-09T05:06:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 msgr2=0x7ff4641590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 0x7ff4641590b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff464075e60 tx=0x7ff45c00b4a0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 shutdown_connections 2024-05-09T05:06:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4440762d0 0x7ff444078790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff464158c30 0x7ff4641590b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4641571a0 0x7ff46414c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 --2- 172.21.15.100:0/284118849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff448004800 0x7ff46415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 >> 172.21.15.100:0/284118849 conn(0x7ff46409ba10 msgr2=0x7ff4640cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 shutdown_connections 2024-05-09T05:06:28.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.000+0000 7ff463200640 1 -- 172.21.15.100:0/284118849 wait complete. 2024-05-09T05:06:28.019 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-05-09T05:06:27.918635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252196,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722524,"statfs":{"total":773094113280,"available":772835864576,"internally_reserved":0,"allocated":7053312,"data_stored":3703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001794"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":188,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-09T05:06:25.469197+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:06:25.469197+0000","last_peered":"2024-05-09T05:06:25.469197+0000","last_clean":"2024-05-09T05:06:25.469197+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:25.469197+0000","last_undegraded":"2024-05-09T05:06:25.469197+0000","last_fullsized":"2024-05-09T05:06:25.469197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:28.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.220+0000 7f1c9a800640 1 Processor -- start 2024-05-09T05:06:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.221+0000 7f1c9a800640 1 -- start start 2024-05-09T05:06:28.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.222+0000 7f1c9a800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c9415f420 0x7f1c940d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.222+0000 7f1c9a800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c940d3da0 con 0x7f1c940d2980 2024-05-09T05:06:28.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.222+0000 7f1c9a800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c940d4080 con 0x7f1c940d38f0 2024-05-09T05:06:28.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.222+0000 7f1c9a800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1c940d4360 con 0x7f1c9415f420 2024-05-09T05:06:28.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.223+0000 7f1c93e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1c940d2980 0x7f1c940b8440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33672/0 (socket says 172.21.15.100:33672) 2024-05-09T05:06:28.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.223+0000 7f1c93e00640 1 -- 172.21.15.100:0/2142156235 learned_addr learned my addr 172.21.15.100:0/2142156235 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:28.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.223+0000 7f1c93400640 1 --2- 172.21.15.100:0/2142156235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c9415f420 0x7f1c940d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.223+0000 7f1c92000640 1 -- 172.21.15.100:0/2142156235 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301547368 0 0) 0x7f1c940d3da0 con 0x7f1c940d2980 2024-05-09T05:06:28.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.223+0000 7f1c92000640 1 -- 172.21.15.100:0/2142156235 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c78003520 con 0x7f1c940d2980 2024-05-09T05:06:28.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.224+0000 7f1c93400640 1 -- 172.21.15.100:0/2142156235 >> v1:172.21.15.133:6789/0 conn(0x7f1c940d38f0 legacy=0x7f1c940d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.224+0000 7f1c92000640 1 -- 172.21.15.100:0/2142156235 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756179999 0 0) 0x7f1c940d4080 con 0x7f1c940d38f0 2024-05-09T05:06:28.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.224+0000 7f1c93400640 1 -- 172.21.15.100:0/2142156235 >> v1:172.21.15.100:6789/0 conn(0x7f1c940d2980 legacy=0x7f1c940b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.224+0000 7f1c93400640 1 -- 172.21.15.100:0/2142156235 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c940d4640 con 0x7f1c9415f420 2024-05-09T05:06:28.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.225+0000 7f1c93400640 1 --2- 172.21.15.100:0/2142156235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c9415f420 0x7f1c940d33b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009dc0 tx=0x7f1c8402a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1921d0a5918b5bc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:28.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.225+0000 7f1c92000640 1 -- 172.21.15.100:0/2142156235 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84035020 con 0x7f1c9415f420 2024-05-09T05:06:28.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c92000640 1 -- 172.21.15.100:0/2142156235 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c84007540 con 0x7f1c9415f420 2024-05-09T05:06:28.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c92000640 1 -- 172.21.15.100:0/2142156235 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0016f0 con 0x7f1c9415f420 2024-05-09T05:06:28.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 -- 172.21.15.100:0/2142156235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c9415f420 msgr2=0x7f1c940d33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 --2- 172.21.15.100:0/2142156235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c9415f420 0x7f1c940d33b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009dc0 tx=0x7f1c8402a5b0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 -- 172.21.15.100:0/2142156235 shutdown_connections 2024-05-09T05:06:28.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 --2- 172.21.15.100:0/2142156235 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c9415f420 0x7f1c940d33b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 -- 172.21.15.100:0/2142156235 >> 172.21.15.100:0/2142156235 conn(0x7f1c94073f20 msgr2=0x7f1c94074330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 -- 172.21.15.100:0/2142156235 shutdown_connections 2024-05-09T05:06:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.226+0000 7f1c9a800640 1 -- 172.21.15.100:0/2142156235 wait complete. 2024-05-09T05:06:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.228+0000 7f1c9a800640 1 Processor -- start 2024-05-09T05:06:28.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.228+0000 7f1c9a800640 1 -- start start 2024-05-09T05:06:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c9a800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c940d2980 0x7f1c940abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c9a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 0x7f1c940ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c9a800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9415f420 0x7f1c940cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c9a800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c940badf0 con 0x7f1c940d38f0 2024-05-09T05:06:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c9a800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9415f840 con 0x7f1c9415f420 2024-05-09T05:06:28.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c9a800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1c940baf70 con 0x7f1c940d2980 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c92a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 0x7f1c940ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c92a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 0x7f1c940ac1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35250/0 (socket says 172.21.15.100:35250) 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.229+0000 7f1c92a00640 1 -- 172.21.15.100:0/3399941415 learned_addr learned my addr 172.21.15.100:0/3399941415 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c93400640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c940d2980 0x7f1c940abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c93e00640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9415f420 0x7f1c940cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c92a00640 1 -- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c940d2980 msgr2=0x7f1c940abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c92a00640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c940d2980 0x7f1c940abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c92a00640 1 -- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9415f420 msgr2=0x7f1c940cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c92a00640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9415f420 0x7f1c940cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c92a00640 1 -- 172.21.15.100:0/3399941415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9414e010 con 0x7f1c940d38f0 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c93e00640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9415f420 0x7f1c940cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c92a00640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 0x7f1c940ac1f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000c400 tx=0x7f1c8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80017070 con 0x7f1c940d38f0 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c800035f0 con 0x7f1c940d38f0 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c800039e0 con 0x7f1c940d38f0 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.230+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c940ceb70 con 0x7f1c940d38f0 2024-05-09T05:06:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.231+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9414e7d0 con 0x7f1c940d38f0 2024-05-09T05:06:28.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.232+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9406a5c0 con 0x7f1c940d38f0 2024-05-09T05:06:28.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.233+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1c8001a070 con 0x7f1c940d38f0 2024-05-09T05:06:28.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.234+0000 7f1c8b400640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c740762d0 0x7f1c74078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.234+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f1c80096770 con 0x7f1c940d38f0 2024-05-09T05:06:28.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.234+0000 7f1c93400640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c740762d0 0x7f1c74078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.235+0000 7f1c93400640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c740762d0 0x7f1c74078790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1c84033000 tx=0x7f1c8402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:28.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.238+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1c80060330 con 0x7f1c940d38f0 2024-05-09T05:06:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.439+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c9414e340 con 0x7f1c740762d0 2024-05-09T05:06:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.440+0000 7f1c8b400640 1 -- 172.21.15.100:0/3399941415 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13461 (secure 0 0 0) 0x7f1c9414e340 con 0x7f1c740762d0 2024-05-09T05:06:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:28.441 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c740762d0 msgr2=0x7f1c74078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c740762d0 0x7f1c74078790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1c84033000 tx=0x7f1c8402f000 comp rx=0 tx=0).stop 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 msgr2=0x7f1c940ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 0x7f1c940ac1f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000c400 tx=0x7f1c8000c8c0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 shutdown_connections 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1c740762d0 0x7f1c74078790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9415f420 0x7f1c940cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c940d38f0 0x7f1c940ac1f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 --2- 172.21.15.100:0/3399941415 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c940d2980 0x7f1c940abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 >> 172.21.15.100:0/3399941415 conn(0x7f1c94073f20 msgr2=0x7f1c940b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 shutdown_connections 2024-05-09T05:06:28.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.443+0000 7f1c9a800640 1 -- 172.21.15.100:0/3399941415 wait complete. 2024-05-09T05:06:28.463 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-05-09T05:06:27.918635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252196,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722524,"statfs":{"total":773094113280,"available":772835864576,"internally_reserved":0,"allocated":7053312,"data_stored":3703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001794"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":188,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-09T05:06:25.469197+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:06:25.469197+0000","last_peered":"2024-05-09T05:06:25.469197+0000","last_clean":"2024-05-09T05:06:25.469197+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:25.469197+0000","last_undegraded":"2024-05-09T05:06:25.469197+0000","last_fullsized":"2024-05-09T05:06:25.469197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:28.464 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-09T05:06:28.464 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:28.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.666+0000 7f0f56a00640 1 Processor -- start 2024-05-09T05:06:28.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.667+0000 7f0f56a00640 1 -- start start 2024-05-09T05:06:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.668+0000 7f0f56a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0f500b3eb0 0x7f0f500b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.668+0000 7f0f56a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f5006f820 0x7f0f5006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.668+0000 7f0f56a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5006ead0 con 0x7f0f50145900 2024-05-09T05:06:28.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.668+0000 7f0f56a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0f500b4850 con 0x7f0f500b3eb0 2024-05-09T05:06:28.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.668+0000 7f0f56a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5006f390 con 0x7f0f5006f820 2024-05-09T05:06:28.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0f50145900 0x7f0f50073460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33684/0 (socket says 172.21.15.100:33684) 2024-05-09T05:06:28.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4fe00640 1 -- 172.21.15.100:0/2649108004 learned_addr learned my addr 172.21.15.100:0/2649108004 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:28.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4f400640 1 --2- 172.21.15.100:0/2649108004 >> v2:172.21.15.100:3300/0 conn(0x7f0f500b3eb0 0x7f0f500b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f54a00640 1 --2- 172.21.15.100:0/2649108004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f5006f820 0x7f0f5006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4ea00640 1 -- 172.21.15.100:0/2649108004 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650263183 0 0) 0x7f0f5006ead0 con 0x7f0f50145900 2024-05-09T05:06:28.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4f400640 1 -- 172.21.15.100:0/2649108004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f5006f820 msgr2=0x7f0f5006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:28.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4f400640 1 --2- 172.21.15.100:0/2649108004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f5006f820 0x7f0f5006fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4f400640 1 -- 172.21.15.100:0/2649108004 >> v1:172.21.15.100:6789/0 conn(0x7f0f50145900 legacy=0x7f0f50073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.669+0000 7f0f4f400640 1 -- 172.21.15.100:0/2649108004 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5006ed40 con 0x7f0f500b3eb0 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.670+0000 7f0f4f400640 1 --2- 172.21.15.100:0/2649108004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f500b3eb0 0x7f0f500b4310 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097a0 tx=0x7f0f3802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7614011c62611 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f4ea00640 1 -- 172.21.15.100:0/2649108004 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38037070 con 0x7f0f500b3eb0 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f4ea00640 1 -- 172.21.15.100:0/2649108004 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38032440 con 0x7f0f500b3eb0 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f4ea00640 1 -- 172.21.15.100:0/2649108004 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38032810 con 0x7f0f500b3eb0 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 -- 172.21.15.100:0/2649108004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f500b3eb0 msgr2=0x7f0f500b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 --2- 172.21.15.100:0/2649108004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f500b3eb0 0x7f0f500b4310 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097a0 tx=0x7f0f3802a180 comp rx=0 tx=0).stop 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 -- 172.21.15.100:0/2649108004 shutdown_connections 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 --2- 172.21.15.100:0/2649108004 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f5006f820 0x7f0f5006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 --2- 172.21.15.100:0/2649108004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f500b3eb0 0x7f0f500b4310 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 -- 172.21.15.100:0/2649108004 >> 172.21.15.100:0/2649108004 conn(0x7f0f500b31e0 msgr2=0x7f0f500d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 -- 172.21.15.100:0/2649108004 shutdown_connections 2024-05-09T05:06:28.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.671+0000 7f0f56a00640 1 -- 172.21.15.100:0/2649108004 wait complete. 2024-05-09T05:06:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.673+0000 7f0f56a00640 1 Processor -- start 2024-05-09T05:06:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.673+0000 7f0f56a00640 1 -- start start 2024-05-09T05:06:28.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f56a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 0x7f0f501f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f56a00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f500b3eb0 0x7f0f50143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f56a00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f50145900 0x7f0f5009dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f56a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50073e70 con 0x7f0f5006f820 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f56a00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f0f50073b70 con 0x7f0f50145900 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f56a00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f0f500ade90 con 0x7f0f500b3eb0 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 0x7f0f501f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.674+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 0x7f0f501f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35280/0 (socket says 172.21.15.100:35280) 2024-05-09T05:06:28.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 -- 172.21.15.100:0/4014592013 learned_addr learned my addr 172.21.15.100:0/4014592013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4f400640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f500b3eb0 0x7f0f50143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f54a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f50145900 0x7f0f5009dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 -- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f500b3eb0 msgr2=0x7f0f50143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f500b3eb0 0x7f0f50143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 -- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f50145900 msgr2=0x7f0f5009dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f50145900 0x7f0f5009dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 -- 172.21.15.100:0/4014592013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f501f5dd0 con 0x7f0f5006f820 2024-05-09T05:06:28.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4f400640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f500b3eb0 0x7f0f50143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f54a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f50145900 0x7f0f5009dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.675+0000 7f0f4fe00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 0x7f0f501f5890 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c3e0 tx=0x7f0f4000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.676+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400074e0 con 0x7f0f5006f820 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.676+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f400047e0 con 0x7f0f5006f820 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.676+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40004bd0 con 0x7f0f5006f820 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.676+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f500ca560 con 0x7f0f5006f820 2024-05-09T05:06:28.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.676+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f500cab20 con 0x7f0f5006f820 2024-05-09T05:06:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.677+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5006a5c0 con 0x7f0f5006f820 2024-05-09T05:06:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.678+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0f40011070 con 0x7f0f5006f820 2024-05-09T05:06:28.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.679+0000 7f0f47e00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0f2c0762d0 0x7f0f2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:28.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.680+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f0f40096e70 con 0x7f0f5006f820 2024-05-09T05:06:28.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.680+0000 7f0f4f400640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0f2c0762d0 0x7f0f2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:28.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.680+0000 7f0f4f400640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0f2c0762d0 0x7f0f2c078790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f3802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:28.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.684+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0f40060b60 con 0x7f0f5006f820 2024-05-09T05:06:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.887+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f500d1580 con 0x7f0f2c0762d0 2024-05-09T05:06:28.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.889+0000 7f0f47e00640 1 -- 172.21.15.100:0/4014592013 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13461 (secure 0 0 0) 0x7f0f500d1580 con 0x7f0f2c0762d0 2024-05-09T05:06:28.890 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0f2c0762d0 msgr2=0x7f0f2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0f2c0762d0 0x7f0f2c078790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f3802e000 comp rx=0 tx=0).stop 2024-05-09T05:06:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 msgr2=0x7f0f501f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 0x7f0f501f5890 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c3e0 tx=0x7f0f4000c8a0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 shutdown_connections 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f0f2c0762d0 0x7f0f2c078790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.892+0000 7f0f56a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f50145900 0x7f0f5009dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.893+0000 7f0f56a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f500b3eb0 0x7f0f50143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.893+0000 7f0f56a00640 1 --2- 172.21.15.100:0/4014592013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f5006f820 0x7f0f501f5890 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.893+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 >> 172.21.15.100:0/4014592013 conn(0x7f0f500b31e0 msgr2=0x7f0f50148450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.893+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 shutdown_connections 2024-05-09T05:06:28.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:28.893+0000 7f0f56a00640 1 -- 172.21.15.100:0/4014592013 wait complete. 2024-05-09T05:06:28.911 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-05-09T05:06:27.918635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252196,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722524,"statfs":{"total":773094113280,"available":772835864576,"internally_reserved":0,"allocated":7053312,"data_stored":3703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001794"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":188,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-09T05:06:25.469197+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:06:25.469197+0000","last_peered":"2024-05-09T05:06:25.469197+0000","last_clean":"2024-05-09T05:06:25.469197+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:25.469197+0000","last_undegraded":"2024-05-09T05:06:25.469197+0000","last_fullsized":"2024-05-09T05:06:25.469197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:28.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T05:06:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.108+0000 7fb829000640 1 Processor -- start 2024-05-09T05:06:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.108+0000 7fb829000640 1 -- start start 2024-05-09T05:06:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.109+0000 7fb829000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240d0a70 0x7fb82415e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb829000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8240afb70 0x7fb8240affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb829000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82415e780 con 0x7fb8240ade90 2024-05-09T05:06:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb829000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb8240ae3a0 con 0x7fb8240afb70 2024-05-09T05:06:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb829000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb8240b4590 con 0x7fb8240d0a70 2024-05-09T05:06:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb822800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8240afb70 0x7fb8240affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb822800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8240afb70 0x7fb8240affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35292/0 (socket says 172.21.15.100:35292) 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb822800640 1 -- 172.21.15.100:0/587673003 learned_addr learned my addr 172.21.15.100:0/587673003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb821e00640 1 --2- 172.21.15.100:0/587673003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240d0a70 0x7fb82415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb822800640 1 -- 172.21.15.100:0/587673003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240d0a70 msgr2=0x7fb82415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.110+0000 7fb822800640 1 --2- 172.21.15.100:0/587673003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240d0a70 0x7fb82415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.111+0000 7fb822800640 1 -- 172.21.15.100:0/587673003 >> v1:172.21.15.133:6789/0 conn(0x7fb8240ade90 legacy=0x7fb8240b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.111+0000 7fb822800640 1 -- 172.21.15.100:0/587673003 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8240b4870 con 0x7fb8240afb70 2024-05-09T05:06:29.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.112+0000 7fb822800640 1 --2- 172.21.15.100:0/587673003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240afb70 0x7fb8240affc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e50 tx=0x7fb81c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed41f756d6a6c9a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.112+0000 7fb820a00640 1 -- 172.21.15.100:0/587673003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c036070 con 0x7fb8240afb70 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.112+0000 7fb820a00640 1 -- 172.21.15.100:0/587673003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c031600 con 0x7fb8240afb70 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.112+0000 7fb820a00640 1 -- 172.21.15.100:0/587673003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0319d0 con 0x7fb8240afb70 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 -- 172.21.15.100:0/587673003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240afb70 msgr2=0x7fb8240affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 --2- 172.21.15.100:0/587673003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240afb70 0x7fb8240affc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e50 tx=0x7fb81c02a680 comp rx=0 tx=0).stop 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 -- 172.21.15.100:0/587673003 shutdown_connections 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 --2- 172.21.15.100:0/587673003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240afb70 0x7fb8240affc0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 --2- 172.21.15.100:0/587673003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240d0a70 0x7fb82415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 -- 172.21.15.100:0/587673003 >> 172.21.15.100:0/587673003 conn(0x7fb8240b31e0 msgr2=0x7fb8240d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:29.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 -- 172.21.15.100:0/587673003 shutdown_connections 2024-05-09T05:06:29.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.113+0000 7fb829000640 1 -- 172.21.15.100:0/587673003 wait complete. 2024-05-09T05:06:29.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.114+0000 7fb829000640 1 Processor -- start 2024-05-09T05:06:29.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 -- start start 2024-05-09T05:06:29.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240ade90 0x7fb82414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:29.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240afb70 0x7fb82409c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:29.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 0x7fb82415f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8240b0500 con 0x7fb8240d0a70 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fb8240ae680 con 0x7fb8240afb70 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.115+0000 7fb829000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fb824072570 con 0x7fb8240ade90 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 0x7fb82415f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 0x7fb82415f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35296/0 (socket says 172.21.15.100:35296) 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 -- 172.21.15.100:0/2670408370 learned_addr learned my addr 172.21.15.100:0/2670408370 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 -- 172.21.15.100:0/2670408370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240ade90 msgr2=0x7fb82414fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240ade90 0x7fb82414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 -- 172.21.15.100:0/2670408370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240afb70 msgr2=0x7fb82409c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240afb70 0x7fb82409c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 -- 172.21.15.100:0/2670408370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8240ca680 con 0x7fb8240d0a70 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.116+0000 7fb822800640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 0x7fb82415f9b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e50 tx=0x7fb81c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.117+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c036050 con 0x7fb8240d0a70 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.117+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81c042070 con 0x7fb8240d0a70 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.117+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81c009510 con 0x7fb8240d0a70 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.117+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8240ca960 con 0x7fb8240d0a70 2024-05-09T05:06:29.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.117+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8240caf20 con 0x7fb8240d0a70 2024-05-09T05:06:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.118+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82406a5c0 con 0x7fb8240d0a70 2024-05-09T05:06:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.119+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb81c007bd0 con 0x7fb8240d0a70 2024-05-09T05:06:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.120+0000 7fb81a000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb804076300 0x7fb8040787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.120+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fb81c0b8290 con 0x7fb8240d0a70 2024-05-09T05:06:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.120+0000 7fb821e00640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb804076300 0x7fb8040787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:29.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.121+0000 7fb821e00640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb804076300 0x7fb8040787c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb814006fd0 tx=0x7fb814008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:29.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.125+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb82415e780 con 0x7fb8240d0a70 2024-05-09T05:06:29.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.332+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb82406d570 con 0x7fb8240d0a70 2024-05-09T05:06:29.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.334+0000 7fb81a000640 1 -- 172.21.15.100:0/2670408370 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13047 (secure 0 0 0) 0x7fb81c081e50 con 0x7fb8240d0a70 2024-05-09T05:06:29.335 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:29.335 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":60,"fsid":"11e43d29-3063-46a7-bef1-2ecadce2fdc5","created":"2024-05-09T05:03:58.724310+0000","modified":"2024-05-09T05:06:24.002268+0000","last_up_change":"2024-05-09T05:04:11.083233+0000","last_in_change":"2024-05-09T05:04:02.037335+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:04:11.914841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"76d083c1-ce47-4b39-9e16-daf00a71f1dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6812","nonce":4292247992}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6817","nonce":4292247992}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6827","nonce":4292247992}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":4292247992},{"type":"v1","addr":"172.21.15.100:6822","nonce":4292247992}]},"public_addr":"172.21.15.100:6812/4292247992","cluster_addr":"172.21.15.100:6817/4292247992","heartbeat_back_addr":"172.21.15.100:6827/4292247992","heartbeat_front_addr":"172.21.15.100:6822/4292247992","state":["exists","up"]},{"osd":1,"uuid":"874ccff6-39df-4f07-a1d8-b7318906c024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6811","nonce":396670832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6816","nonce":396670832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6825","nonce":396670832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":396670832},{"type":"v1","addr":"172.21.15.100:6821","nonce":396670832}]},"public_addr":"172.21.15.100:6811/396670832","cluster_addr":"172.21.15.100:6816/396670832","heartbeat_back_addr":"172.21.15.100:6825/396670832","heartbeat_front_addr":"172.21.15.100:6821/396670832","state":["exists","up"]},{"osd":2,"uuid":"0d9236fa-1a35-4663-a14c-528110732f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6814","nonce":752925701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6819","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6826","nonce":752925701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6831","nonce":752925701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":752925701},{"type":"v1","addr":"172.21.15.100:6829","nonce":752925701}]},"public_addr":"172.21.15.100:6814/752925701","cluster_addr":"172.21.15.100:6826/752925701","heartbeat_back_addr":"172.21.15.100:6831/752925701","heartbeat_front_addr":"172.21.15.100:6829/752925701","state":["exists","up"]},{"osd":3,"uuid":"0e05dc99-b5a0-4c43-aad6-683d8c627338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6801","nonce":209630893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6803","nonce":209630893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6807","nonce":209630893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":209630893},{"type":"v1","addr":"172.21.15.100:6805","nonce":209630893}]},"public_addr":"172.21.15.100:6801/209630893","cluster_addr":"172.21.15.100:6803/209630893","heartbeat_back_addr":"172.21.15.100:6807/209630893","heartbeat_front_addr":"172.21.15.100:6805/209630893","state":["exists","up"]},{"osd":4,"uuid":"583b4b3c-e1f1-42da-99e2-a052b3d5f5c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6801","nonce":4260847374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6803","nonce":4260847374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6807","nonce":4260847374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":4260847374},{"type":"v1","addr":"172.21.15.133:6805","nonce":4260847374}]},"public_addr":"172.21.15.133:6801/4260847374","cluster_addr":"172.21.15.133:6803/4260847374","heartbeat_back_addr":"172.21.15.133:6807/4260847374","heartbeat_front_addr":"172.21.15.133:6805/4260847374","state":["exists","up"]},{"osd":5,"uuid":"cb91184c-0eaa-4cd0-9dbe-be1931e89c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6809","nonce":2703436583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6811","nonce":2703436583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6817","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6820","nonce":2703436583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2703436583},{"type":"v1","addr":"172.21.15.133:6814","nonce":2703436583}]},"public_addr":"172.21.15.133:6809/2703436583","cluster_addr":"172.21.15.133:6811/2703436583","heartbeat_back_addr":"172.21.15.133:6820/2703436583","heartbeat_front_addr":"172.21.15.133:6814/2703436583","state":["exists","up"]},{"osd":6,"uuid":"b5e48f05-bea8-470e-8489-734309351cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6825","nonce":1215001557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6827","nonce":1215001557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6831","nonce":1215001557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":1215001557},{"type":"v1","addr":"172.21.15.133:6829","nonce":1215001557}]},"public_addr":"172.21.15.133:6825/1215001557","cluster_addr":"172.21.15.133:6827/1215001557","heartbeat_back_addr":"172.21.15.133:6831/1215001557","heartbeat_front_addr":"172.21.15.133:6829/1215001557","state":["exists","up"]},{"osd":7,"uuid":"8db26a90-eef8-4e73-9f8c-7d0ecab1fc16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6813","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6815","nonce":1847228632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6818","nonce":1847228632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6823","nonce":1847228632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6819","nonce":1847228632},{"type":"v1","addr":"172.21.15.133:6821","nonce":1847228632}]},"public_addr":"172.21.15.133:6815/1847228632","cluster_addr":"172.21.15.133:6818/1847228632","heartbeat_back_addr":"172.21.15.133:6823/1847228632","heartbeat_front_addr":"172.21.15.133:6821/1847228632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.132583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.368636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.417608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.401812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.367514+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.473137+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.532386+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:04:07.190673+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/3578202714":"2024-05-10T05:06:18.970647+0000","172.21.15.133:6833/3578202714":"2024-05-10T05:06:18.970647+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.336+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb804076300 msgr2=0x7fb8040787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.336+0000 7fb829000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb804076300 0x7fb8040787c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb814006fd0 tx=0x7fb814008040 comp rx=0 tx=0).stop 2024-05-09T05:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.336+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 msgr2=0x7fb82415f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:29.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.336+0000 7fb829000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 0x7fb82415f9b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e50 tx=0x7fb81c004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 shutdown_connections 2024-05-09T05:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fb804076300 0x7fb8040787c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8240d0a70 0x7fb82415f9b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8240afb70 0x7fb82409c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 --2- 172.21.15.100:0/2670408370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8240ade90 0x7fb82414fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:29.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 >> 172.21.15.100:0/2670408370 conn(0x7fb8240b31e0 msgr2=0x7fb8240b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 shutdown_connections 2024-05-09T05:06:29.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:29.337+0000 7fb829000640 1 -- 172.21.15.100:0/2670408370 wait complete. 2024-05-09T05:06:30.356 INFO:tasks.ceph:Scrubbing osd.0 2024-05-09T05:06:30.356 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:30.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.571+0000 7fc934e00640 1 Processor -- start 2024-05-09T05:06:30.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.571+0000 7fc934e00640 1 -- start start 2024-05-09T05:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.573+0000 7fc934e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9300b6920 0x7fc93015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.573+0000 7fc934e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93015e290 con 0x7fc9301574e0 2024-05-09T05:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.573+0000 7fc934e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc930160ca0 con 0x7fc930161780 2024-05-09T05:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.573+0000 7fc934e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fc930160f80 con 0x7fc9300b6920 2024-05-09T05:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.573+0000 7fc92f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc9301574e0 0x7fc9300b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33700/0 (socket says 172.21.15.100:33700) 2024-05-09T05:06:30.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.573+0000 7fc92f400640 1 -- 172.21.15.100:0/1001011148 learned_addr learned my addr 172.21.15.100:0/1001011148 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:30.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92ea00640 1 --2- 172.21.15.100:0/1001011148 >> v2:172.21.15.133:3300/0 conn(0x7fc9300b6920 0x7fc93015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997958153 0 0) 0x7fc93015e290 con 0x7fc9301574e0 2024-05-09T05:06:30.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc914003520 con 0x7fc9301574e0 2024-05-09T05:06:30.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4266711705 0 0) 0x7fc914003520 con 0x7fc9301574e0 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 >> v2:172.21.15.133:3300/0 conn(0x7fc9300b6920 msgr2=0x7fc93015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 --2- 172.21.15.100:0/1001011148 >> v2:172.21.15.133:3300/0 conn(0x7fc9300b6920 0x7fc93015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 >> v1:172.21.15.133:6789/0 conn(0x7fc930161780 legacy=0x7fc93015da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc930161260 con 0x7fc9301574e0 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.574+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fc9200016f0 con 0x7fc9301574e0 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 >> v1:172.21.15.100:6789/0 conn(0x7fc9301574e0 legacy=0x7fc9300b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc914003a50 0x7fc914003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc914004800 0x7fc914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc91400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc930160f80 con 0x7fc9140052e0 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc91400c1b0 con 0x7fc914003a50 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc91400c3b0 con 0x7fc914004800 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92fe00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc91400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92f400640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc914003a50 0x7fc914003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92ea00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc914004800 0x7fc914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92fe00640 1 -- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc914004800 msgr2=0x7fc914004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92fe00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc914004800 0x7fc914004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92fe00640 1 -- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc914003a50 msgr2=0x7fc914003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92fe00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc914003a50 0x7fc914003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.575+0000 7fc92fe00640 1 -- 172.21.15.100:0/1001011148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914003520 con 0x7fc9140052e0 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.576+0000 7fc92f400640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc914003a50 0x7fc914003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.576+0000 7fc92fe00640 1 -- 172.21.15.100:0/1001011148 reap_dead start 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc92fe00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc91400b9c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc928001e60 tx=0x7fc914005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7303cc18308b0528 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928001ab0 con 0x7fc9140052e0 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92802ae40 con 0x7fc9140052e0 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc92e000640 1 -- 172.21.15.100:0/1001011148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928003b70 con 0x7fc9140052e0 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc934e00640 1 -- 172.21.15.100:0/1001011148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 msgr2=0x7fc91400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc934e00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc91400b9c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc928001e60 tx=0x7fc914005830 comp rx=0 tx=0).stop 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc934e00640 1 -- 172.21.15.100:0/1001011148 shutdown_connections 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc934e00640 1 --2- 172.21.15.100:0/1001011148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc91400b9c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.577+0000 7fc934e00640 1 -- 172.21.15.100:0/1001011148 >> 172.21.15.100:0/1001011148 conn(0x7fc93006c3d0 msgr2=0x7fc93006c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:30.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.578+0000 7fc934e00640 1 -- 172.21.15.100:0/1001011148 shutdown_connections 2024-05-09T05:06:30.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.578+0000 7fc934e00640 1 -- 172.21.15.100:0/1001011148 wait complete. 2024-05-09T05:06:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.579+0000 7fc934e00640 1 Processor -- start 2024-05-09T05:06:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.579+0000 7fc934e00640 1 -- start start 2024-05-09T05:06:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.580+0000 7fc934e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc93014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.580+0000 7fc934e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc93014d230 0x7fc93014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.580+0000 7fc934e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9300afb80 0x7fc9300b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.580+0000 7fc934e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc9300b6390 con 0x7fc9140052e0 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.580+0000 7fc934e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fc9300b6210 con 0x7fc9300afb80 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.580+0000 7fc934e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fc9300b6510 con 0x7fc93014d230 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc93014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc93014ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35312/0 (socket says 172.21.15.100:35312) 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 -- 172.21.15.100:0/391896241 learned_addr learned my addr 172.21.15.100:0/391896241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92ea00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc93014d230 0x7fc93014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92fe00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9300afb80 0x7fc9300b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 -- 172.21.15.100:0/391896241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc93014d230 msgr2=0x7fc93014dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc93014d230 0x7fc93014dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 -- 172.21.15.100:0/391896241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9300afb80 msgr2=0x7fc9300b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9300afb80 0x7fc9300b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 -- 172.21.15.100:0/391896241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc930153ee0 con 0x7fc9140052e0 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc92f400640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc93014ccd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e770 tx=0x7fc92000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.581+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920019070 con 0x7fc9140052e0 2024-05-09T05:06:30.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.582+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92000ee80 con 0x7fc9140052e0 2024-05-09T05:06:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.582+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9301541c0 con 0x7fc9140052e0 2024-05-09T05:06:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.582+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92000caf0 con 0x7fc9140052e0 2024-05-09T05:06:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.582+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93015a4f0 con 0x7fc9140052e0 2024-05-09T05:06:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.583+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc93006a630 con 0x7fc9140052e0 2024-05-09T05:06:30.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.584+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc92000cc90 con 0x7fc9140052e0 2024-05-09T05:06:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.585+0000 7fc927400640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc90c076300 0x7fc90c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.585+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fc9200975c0 con 0x7fc9140052e0 2024-05-09T05:06:30.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.585+0000 7fc92ea00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc90c076300 0x7fc90c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.585+0000 7fc927400640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7fc90c07c1c0 0x7fc90c07e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.585+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 --> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc90c07ec90 con 0x7fc90c07c1c0 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.585+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc920097970 con 0x7fc9140052e0 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.586+0000 7fc92fe00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7fc90c07c1c0 0x7fc90c07e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.586+0000 7fc92ea00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc90c076300 0x7fc90c0787c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9300b0750 tx=0x7fc918008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.586+0000 7fc92fe00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7fc90c07c1c0 0x7fc90c07e5e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.587+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== osd.0 v2:172.21.15.100:6809/4292247992 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc90c07ec90 con 0x7fc90c07c1c0 2024-05-09T05:06:30.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.601+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 --> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc930072d80 con 0x7fc90c07c1c0 2024-05-09T05:06:30.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc927400640 1 -- 172.21.15.100:0/391896241 <== osd.0 v2:172.21.15.100:6809/4292247992 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc930072d80 con 0x7fc90c07c1c0 2024-05-09T05:06:30.603 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:30.603 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:30.603 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:30.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7fc90c07c1c0 msgr2=0x7fc90c07e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc934e00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6809/4292247992,v1:172.21.15.100:6812/4292247992] conn(0x7fc90c07c1c0 0x7fc90c07e5e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc90c076300 msgr2=0x7fc90c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc934e00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fc90c076300 0x7fc90c0787c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9300b0750 tx=0x7fc918008040 comp rx=0 tx=0).stop 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 msgr2=0x7fc93014ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.602+0000 7fc934e00640 1 --2- 172.21.15.100:0/391896241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9140052e0 0x7fc93014ccd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e770 tx=0x7fc92000ec30 comp rx=0 tx=0).stop 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.603+0000 7fc92fe00640 1 -- 172.21.15.100:0/391896241 reap_dead start 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.603+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 shutdown_connections 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.603+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 >> 172.21.15.100:0/391896241 conn(0x7fc93006c3d0 msgr2=0x7fc93015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.603+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 shutdown_connections 2024-05-09T05:06:30.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.603+0000 7fc934e00640 1 -- 172.21.15.100:0/391896241 wait complete. 2024-05-09T05:06:30.619 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-09T05:06:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.811+0000 7fdca1e00640 1 Processor -- start 2024-05-09T05:06:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.812+0000 7fdca1e00640 1 -- start start 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.813+0000 7fdca1e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc9c15d5a0 0x7fdc9c073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.813+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 0x7fdc9c0cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.813+0000 7fdca1e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9c06e520 con 0x7fdc9c0cff40 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.813+0000 7fdca1e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c15d980 con 0x7fdc9c15d5a0 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.813+0000 7fdca1e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c0cf440 con 0x7fdc9c074490 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.814+0000 7fdc93e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 0x7fdc9c0cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.814+0000 7fdc93e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 0x7fdc9c0cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52224/0 (socket says 172.21.15.100:52224) 2024-05-09T05:06:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.814+0000 7fdc93e00640 1 -- 172.21.15.100:0/526725256 learned_addr learned my addr 172.21.15.100:0/526725256 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.814+0000 7fdc9aa00640 1 --2- 172.21.15.100:0/526725256 >> v2:172.21.15.133:3300/0 conn(0x7fdc9c15d5a0 0x7fdc9c073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.815+0000 7fdc93e00640 1 -- 172.21.15.100:0/526725256 >> v2:172.21.15.133:3300/0 conn(0x7fdc9c15d5a0 msgr2=0x7fdc9c073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:30.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.815+0000 7fdc93e00640 1 --2- 172.21.15.100:0/526725256 >> v2:172.21.15.133:3300/0 conn(0x7fdc9c15d5a0 0x7fdc9c073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.815+0000 7fdc93e00640 1 -- 172.21.15.100:0/526725256 >> v1:172.21.15.133:6789/0 conn(0x7fdc9c0cff40 legacy=0x7fdc9c161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.815+0000 7fdc93e00640 1 -- 172.21.15.100:0/526725256 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c0cf720 con 0x7fdc9c074490 2024-05-09T05:06:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.815+0000 7fdc9aa00640 1 --2- 172.21.15.100:0/526725256 >> v2:172.21.15.133:3300/0 conn(0x7fdc9c15d5a0 0x7fdc9c073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:06:30.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.816+0000 7fdc93e00640 1 --2- 172.21.15.100:0/526725256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 0x7fdc9c0cfa00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009870 tx=0x7fdc8402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed1ebdcb4615aaf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.817+0000 7fdc9a000640 1 -- 172.21.15.100:0/526725256 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84037070 con 0x7fdc9c074490 2024-05-09T05:06:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.817+0000 7fdc9a000640 1 -- 172.21.15.100:0/526725256 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84032440 con 0x7fdc9c074490 2024-05-09T05:06:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.817+0000 7fdc9a000640 1 -- 172.21.15.100:0/526725256 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84032810 con 0x7fdc9c074490 2024-05-09T05:06:30.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.817+0000 7fdca1e00640 1 -- 172.21.15.100:0/526725256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 msgr2=0x7fdc9c0cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.817+0000 7fdca1e00640 1 --2- 172.21.15.100:0/526725256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 0x7fdc9c0cfa00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009870 tx=0x7fdc8402a1c0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.818+0000 7fdca1e00640 1 -- 172.21.15.100:0/526725256 shutdown_connections 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.818+0000 7fdca1e00640 1 --2- 172.21.15.100:0/526725256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c074490 0x7fdc9c0cfa00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.818+0000 7fdca1e00640 1 --2- 172.21.15.100:0/526725256 >> v2:172.21.15.133:3300/0 conn(0x7fdc9c15d5a0 0x7fdc9c073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.818+0000 7fdca1e00640 1 -- 172.21.15.100:0/526725256 >> 172.21.15.100:0/526725256 conn(0x7fdc9c0b2c90 msgr2=0x7fdc9c0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.818+0000 7fdca1e00640 1 -- 172.21.15.100:0/526725256 shutdown_connections 2024-05-09T05:06:30.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.818+0000 7fdca1e00640 1 -- 172.21.15.100:0/526725256 wait complete. 2024-05-09T05:06:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.820+0000 7fdca1e00640 1 Processor -- start 2024-05-09T05:06:30.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.820+0000 7fdca1e00640 1 -- start start 2024-05-09T05:06:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc9c074490 0x7fdc9c15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 0x7fdc9c144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdca1e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c15d5a0 0x7fdc9c155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdca1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c09ef60 con 0x7fdc9c0cff40 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdca1e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c09ede0 con 0x7fdc9c074490 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdca1e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c0d03d0 con 0x7fdc9c15d5a0 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdc93e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 0x7fdc9c144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdc93e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 0x7fdc9c144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35314/0 (socket says 172.21.15.100:35314) 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.821+0000 7fdc93e00640 1 -- 172.21.15.100:0/2126255232 learned_addr learned my addr 172.21.15.100:0/2126255232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc9aa00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc9c074490 0x7fdc9c15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc9b400640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c15d5a0 0x7fdc9c155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93e00640 1 -- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c15d5a0 msgr2=0x7fdc9c155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c15d5a0 0x7fdc9c155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93e00640 1 -- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc9c074490 msgr2=0x7fdc9c15dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc9c074490 0x7fdc9c15dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93e00640 1 -- 172.21.15.100:0/2126255232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c1e6fa0 con 0x7fdc9c0cff40 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc9aa00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc9c074490 0x7fdc9c15dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:30.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 0x7fdc9c144390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000c00 tx=0x7fdc840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.822+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84037040 con 0x7fdc9c0cff40 2024-05-09T05:06:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.823+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84042070 con 0x7fdc9c0cff40 2024-05-09T05:06:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.823+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c1e7280 con 0x7fdc9c0cff40 2024-05-09T05:06:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.823+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84030940 con 0x7fdc9c0cff40 2024-05-09T05:06:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.823+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c1e7840 con 0x7fdc9c0cff40 2024-05-09T05:06:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.824+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9c06a630 con 0x7fdc9c0cff40 2024-05-09T05:06:30.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.825+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc8402ad10 con 0x7fdc9c0cff40 2024-05-09T05:06:30.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.826+0000 7fdc93400640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdc780762d0 0x7fdc78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:30.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.827+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fdc840b7850 con 0x7fdc9c0cff40 2024-05-09T05:06:30.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.827+0000 7fdc9aa00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdc780762d0 0x7fdc78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:30.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.827+0000 7fdc9aa00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdc780762d0 0x7fdc78078790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009a20 tx=0x7fdc8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:30.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:30.831+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc840814a0 con 0x7fdc9c0cff40 2024-05-09T05:06:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.040+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdc9c0b08e0 con 0x7fdc780762d0 2024-05-09T05:06:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.041+0000 7fdc93400640 1 -- 172.21.15.100:0/2126255232 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc9c0b08e0 con 0x7fdc780762d0 2024-05-09T05:06:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-05-09T05:06:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdc780762d0 msgr2=0x7fdc78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdc780762d0 0x7fdc78078790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009a20 tx=0x7fdc8c008040 comp rx=0 tx=0).stop 2024-05-09T05:06:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 msgr2=0x7fdc9c144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 0x7fdc9c144390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdc84000c00 tx=0x7fdc840046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 shutdown_connections 2024-05-09T05:06:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fdc780762d0 0x7fdc78078790 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdc9c15d5a0 0x7fdc9c155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc9c0cff40 0x7fdc9c144390 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 --2- 172.21.15.100:0/2126255232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc9c074490 0x7fdc9c15dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 >> 172.21.15.100:0/2126255232 conn(0x7fdc9c0b2c90 msgr2=0x7fdc9c06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 shutdown_connections 2024-05-09T05:06:31.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.044+0000 7fdca1e00640 1 -- 172.21.15.100:0/2126255232 wait complete. 2024-05-09T05:06:31.064 INFO:tasks.ceph:Scrubbing osd.1 2024-05-09T05:06:31.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.263+0000 7f3f37e00640 1 Processor -- start 2024-05-09T05:06:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.263+0000 7f3f37e00640 1 -- start start 2024-05-09T05:06:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.265+0000 7f3f37e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f3006fd50 0x7f3f301639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.265+0000 7f3f37e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 0x7f3f30160380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.265+0000 7f3f37e00640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3015f8c0 con 0x7f3f300724b0 2024-05-09T05:06:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.265+0000 7f3f37e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f3f301608c0 con 0x7f3f3006fd50 2024-05-09T05:06:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.265+0000 7f3f37e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3015fef0 con 0x7f3f300b5e10 2024-05-09T05:06:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 0x7f3f30160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 0x7f3f30160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52240/0 (socket says 172.21.15.100:52240) 2024-05-09T05:06:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 -- 172.21.15.100:0/59638982 learned_addr learned my addr 172.21.15.100:0/59638982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35400640 1 --2- 172.21.15.100:0/59638982 >> v2:172.21.15.133:3300/0 conn(0x7f3f3006fd50 0x7f3f301639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 -- 172.21.15.100:0/59638982 >> v2:172.21.15.133:3300/0 conn(0x7f3f3006fd50 msgr2=0x7f3f301639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 --2- 172.21.15.100:0/59638982 >> v2:172.21.15.133:3300/0 conn(0x7f3f3006fd50 0x7f3f301639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 -- 172.21.15.100:0/59638982 >> v1:172.21.15.133:6789/0 conn(0x7f3f300724b0 legacy=0x7f3f300b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.266+0000 7f3f35e00640 1 -- 172.21.15.100:0/59638982 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f30072960 con 0x7f3f300b5e10 2024-05-09T05:06:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.268+0000 7f3f35e00640 1 --2- 172.21.15.100:0/59638982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 0x7f3f30160380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009e50 tx=0x7f3f2802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f7e1cdd033ac705 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.268+0000 7f3f2fe00640 1 -- 172.21.15.100:0/59638982 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28036070 con 0x7f3f300b5e10 2024-05-09T05:06:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.268+0000 7f3f2fe00640 1 -- 172.21.15.100:0/59638982 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28031600 con 0x7f3f300b5e10 2024-05-09T05:06:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.268+0000 7f3f2fe00640 1 -- 172.21.15.100:0/59638982 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280319d0 con 0x7f3f300b5e10 2024-05-09T05:06:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 -- 172.21.15.100:0/59638982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 msgr2=0x7f3f30160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 --2- 172.21.15.100:0/59638982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 0x7f3f30160380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009e50 tx=0x7f3f2802a710 comp rx=0 tx=0).stop 2024-05-09T05:06:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 -- 172.21.15.100:0/59638982 shutdown_connections 2024-05-09T05:06:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 --2- 172.21.15.100:0/59638982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300b5e10 0x7f3f30160380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 --2- 172.21.15.100:0/59638982 >> v2:172.21.15.133:3300/0 conn(0x7f3f3006fd50 0x7f3f301639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 -- 172.21.15.100:0/59638982 >> 172.21.15.100:0/59638982 conn(0x7f3f300b2c20 msgr2=0x7f3f300b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 -- 172.21.15.100:0/59638982 shutdown_connections 2024-05-09T05:06:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.269+0000 7f3f37e00640 1 -- 172.21.15.100:0/59638982 wait complete. 2024-05-09T05:06:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.271+0000 7f3f37e00640 1 Processor -- start 2024-05-09T05:06:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.271+0000 7f3f37e00640 1 -- start start 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f37e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f3006fd50 0x7f3f3015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f37e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300724b0 0x7f3f3009dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f37e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f300b5e10 0x7f3f3009e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f37e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3015fb80 con 0x7f3f300b5e10 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f37e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30072f10 con 0x7f3f3006fd50 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f37e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3006e470 con 0x7f3f300724b0 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f35e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f300b5e10 0x7f3f3009e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f35e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f300b5e10 0x7f3f3009e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35320/0 (socket says 172.21.15.100:35320) 2024-05-09T05:06:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.272+0000 7f3f35e00640 1 -- 172.21.15.100:0/39466244 learned_addr learned my addr 172.21.15.100:0/39466244 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f34a00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300724b0 0x7f3f3009dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35400640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f3006fd50 0x7f3f3015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35e00640 1 -- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300724b0 msgr2=0x7f3f3009dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35e00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300724b0 0x7f3f3009dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35e00640 1 -- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f3006fd50 msgr2=0x7f3f3015ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35e00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f3006fd50 0x7f3f3015ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35e00640 1 -- 172.21.15.100:0/39466244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f300b1cc0 con 0x7f3f300b5e10 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f34a00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f300724b0 0x7f3f3009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35400640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f3006fd50 0x7f3f3015ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.273+0000 7f3f35e00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f300b5e10 0x7f3f3009e1c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009f70 tx=0x7f3f28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.274+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28041020 con 0x7f3f300b5e10 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.274+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28037040 con 0x7f3f300b5e10 2024-05-09T05:06:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.274+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28036070 con 0x7f3f300b5e10 2024-05-09T05:06:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.274+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f301f6200 con 0x7f3f300b5e10 2024-05-09T05:06:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.274+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f301f67c0 con 0x7f3f300b5e10 2024-05-09T05:06:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.275+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f30069500 con 0x7f3f300b5e10 2024-05-09T05:06:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.276+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f28044020 con 0x7f3f300b5e10 2024-05-09T05:06:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.277+0000 7f3f2d600640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3f100762d0 0x7f3f10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.277+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f3f280b8390 con 0x7f3f300b5e10 2024-05-09T05:06:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.277+0000 7f3f2d600640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f3f1007c190 0x7f3f1007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.277+0000 7f3f35400640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3f100762d0 0x7f3f10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.277+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 --> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f28047e50 con 0x7f3f1007c190 2024-05-09T05:06:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.277+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3f280b8820 con 0x7f3f300b5e10 2024-05-09T05:06:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.278+0000 7f3f34a00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f3f1007c190 0x7f3f1007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.278+0000 7f3f35400640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3f100762d0 0x7f3f10078790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009ac0 tx=0x7f3f24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.278+0000 7f3f34a00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f3f1007c190 0x7f3f1007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.279+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== osd.1 v2:172.21.15.100:6808/396670832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f28047e50 con 0x7f3f1007c190 2024-05-09T05:06:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.293+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 --> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3f300b3810 con 0x7f3f1007c190 2024-05-09T05:06:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f2d600640 1 -- 172.21.15.100:0/39466244 <== osd.1 v2:172.21.15.100:6808/396670832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3f300b3810 con 0x7f3f1007c190 2024-05-09T05:06:31.295 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:31.295 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:31.295 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f3f1007c190 msgr2=0x7f3f1007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f37e00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6808/396670832,v1:172.21.15.100:6811/396670832] conn(0x7f3f1007c190 0x7f3f1007e5b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3f100762d0 msgr2=0x7f3f10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f37e00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f3f100762d0 0x7f3f10078790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009ac0 tx=0x7f3f24008040 comp rx=0 tx=0).stop 2024-05-09T05:06:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f300b5e10 msgr2=0x7f3f3009e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f37e00640 1 --2- 172.21.15.100:0/39466244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f300b5e10 0x7f3f3009e1c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009f70 tx=0x7f3f28004a40 comp rx=0 tx=0).stop 2024-05-09T05:06:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.294+0000 7f3f35e00640 1 -- 172.21.15.100:0/39466244 reap_dead start 2024-05-09T05:06:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.295+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 shutdown_connections 2024-05-09T05:06:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.295+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 >> 172.21.15.100:0/39466244 conn(0x7f3f300b2c20 msgr2=0x7f3f30161d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.295+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 shutdown_connections 2024-05-09T05:06:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.295+0000 7f3f37e00640 1 -- 172.21.15.100:0/39466244 wait complete. 2024-05-09T05:06:31.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-09T05:06:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.500+0000 7f0007200640 1 Processor -- start 2024-05-09T05:06:31.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.500+0000 7f0007200640 1 -- start start 2024-05-09T05:06:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.502+0000 7f0007200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f00080b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.502+0000 7f0007200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f000806eb90 0x7f00080721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.502+0000 7f0007200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000806f090 con 0x7f00080b6980 2024-05-09T05:06:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.502+0000 7f0007200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f00080b5fb0 con 0x7f000806eb90 2024-05-09T05:06:31.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.502+0000 7f0007200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f00080b4000 con 0x7f000815d630 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f00080b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0006800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f000806eb90 0x7f00080721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f00080b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.100:52258/0 (socket says 172.21.15.100:52258) 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 -- 172.21.15.100:0/3059053181 learned_addr learned my addr 172.21.15.100:0/3059053181 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 -- 172.21.15.100:0/3059053181 >> v2:172.21.15.133:3300/0 conn(0x7f000806eb90 msgr2=0x7f00080721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 --2- 172.21.15.100:0/3059053181 >> v2:172.21.15.133:3300/0 conn(0x7f000806eb90 0x7f00080721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 -- 172.21.15.100:0/3059053181 >> v1:172.21.15.133:6789/0 conn(0x7f00080b6980 legacy=0x7f000806e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0005e00640 1 -- 172.21.15.100:0/3059053181 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000806f370 con 0x7f000815d630 2024-05-09T05:06:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.503+0000 7f0006800640 1 --2- 172.21.15.100:0/3059053181 >> v2:172.21.15.133:3300/0 conn(0x7f000806eb90 0x7f00080721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:06:31.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.505+0000 7f0005e00640 1 --2- 172.21.15.100:0/3059053181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f00080b6440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efff8009870 tx=0x7efff802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21fe85a3121eb81 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.505+0000 7f0004a00640 1 -- 172.21.15.100:0/3059053181 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8037070 con 0x7f000815d630 2024-05-09T05:06:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.505+0000 7f0004a00640 1 -- 172.21.15.100:0/3059053181 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff8032440 con 0x7f000815d630 2024-05-09T05:06:31.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.505+0000 7f0004a00640 1 -- 172.21.15.100:0/3059053181 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8032810 con 0x7f000815d630 2024-05-09T05:06:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 -- 172.21.15.100:0/3059053181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 msgr2=0x7f00080b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 --2- 172.21.15.100:0/3059053181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f00080b6440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efff8009870 tx=0x7efff802a250 comp rx=0 tx=0).stop 2024-05-09T05:06:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 -- 172.21.15.100:0/3059053181 shutdown_connections 2024-05-09T05:06:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 --2- 172.21.15.100:0/3059053181 >> v2:172.21.15.133:3300/0 conn(0x7f000806eb90 0x7f00080721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 --2- 172.21.15.100:0/3059053181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f00080b6440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 -- 172.21.15.100:0/3059053181 >> 172.21.15.100:0/3059053181 conn(0x7f00080b29b0 msgr2=0x7f00080b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 -- 172.21.15.100:0/3059053181 shutdown_connections 2024-05-09T05:06:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.506+0000 7f0007200640 1 -- 172.21.15.100:0/3059053181 wait complete. 2024-05-09T05:06:31.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.508+0000 7f0007200640 1 Processor -- start 2024-05-09T05:06:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.508+0000 7f0007200640 1 -- start start 2024-05-09T05:06:31.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0007200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 0x7f00081583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0007200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b6980 0x7f000814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0007200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f000814ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0007200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0008072720 con 0x7f000806eb90 2024-05-09T05:06:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0007200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f00080b5c40 con 0x7f00080b6980 2024-05-09T05:06:31.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0007200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f00080728a0 con 0x7f000815d630 2024-05-09T05:06:31.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.509+0000 7f0005e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 0x7f00081583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 0x7f00081583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35332/0 (socket says 172.21.15.100:35332) 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 -- 172.21.15.100:0/2522069934 learned_addr learned my addr 172.21.15.100:0/2522069934 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005400640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b6980 0x7f000814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0006800640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f000814ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 -- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 msgr2=0x7f000814ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f000814ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 -- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b6980 msgr2=0x7f000814d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b6980 0x7f000814d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 -- 172.21.15.100:0/2522069934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00080cfc90 con 0x7f000806eb90 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.510+0000 7f0005e00640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 0x7f00081583d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efff8000c00 tx=0x7efff80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.511+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8037040 con 0x7f000806eb90 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.511+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff8042070 con 0x7f000806eb90 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.511+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8030880 con 0x7f000806eb90 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.511+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00080ae9b0 con 0x7f000806eb90 2024-05-09T05:06:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.511+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00080aef70 con 0x7f000806eb90 2024-05-09T05:06:31.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.512+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00080721e0 con 0x7f000806eb90 2024-05-09T05:06:31.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.513+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efff8030a20 con 0x7f000806eb90 2024-05-09T05:06:31.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.515+0000 7efffe000640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7effe80762d0 0x7effe8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.515+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7efff80b7af0 con 0x7f000806eb90 2024-05-09T05:06:31.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.515+0000 7f0005400640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7effe80762d0 0x7effe8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.515+0000 7f0005400640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7effe80762d0 0x7effe8078790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f00080cf6e0 tx=0x7efff4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.519+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00080721e0 con 0x7f000806eb90 2024-05-09T05:06:31.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.722+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0008157960 con 0x7effe80762d0 2024-05-09T05:06:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.723+0000 7efffe000640 1 -- 172.21.15.100:0/2522069934 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0008157960 con 0x7effe80762d0 2024-05-09T05:06:31.724 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-05-09T05:06:31.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7effe80762d0 msgr2=0x7effe8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7effe80762d0 0x7effe8078790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f00080cf6e0 tx=0x7efff4009040 comp rx=0 tx=0).stop 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 msgr2=0x7f00081583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 0x7f00081583d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7efff8000c00 tx=0x7efff80046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 shutdown_connections 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7effe80762d0 0x7effe8078790 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000815d630 0x7f000814ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b6980 0x7f000814d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 --2- 172.21.15.100:0/2522069934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f000806eb90 0x7f00081583d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 >> 172.21.15.100:0/2522069934 conn(0x7f00080b29b0 msgr2=0x7f000815c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 shutdown_connections 2024-05-09T05:06:31.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.726+0000 7f0007200640 1 -- 172.21.15.100:0/2522069934 wait complete. 2024-05-09T05:06:31.746 INFO:tasks.ceph:Scrubbing osd.2 2024-05-09T05:06:31.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:31.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.956+0000 7f49e8000640 1 Processor -- start 2024-05-09T05:06:31.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.956+0000 7f49e8000640 1 -- start start 2024-05-09T05:06:31.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.958+0000 7f49e8000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49e0072d30 0x7f49e0073130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.958+0000 7f49e8000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e0073670 con 0x7f49e00ae290 2024-05-09T05:06:31.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.958+0000 7f49e8000640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e00ae670 con 0x7f49e015b710 2024-05-09T05:06:31.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.958+0000 7f49e8000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f49e006eb80 con 0x7f49e0072d30 2024-05-09T05:06:31.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.958+0000 7f49e5600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f49e00ae290 0x7f49e006e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40684/0 (socket says 172.21.15.100:40684) 2024-05-09T05:06:31.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.958+0000 7f49e5600640 1 -- 172.21.15.100:0/3796633724 learned_addr learned my addr 172.21.15.100:0/3796633724 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016840012 0 0) 0x7f49e0073670 con 0x7f49e00ae290 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c8005730 con 0x7f49e00ae290 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49e6000640 1 --2- 172.21.15.100:0/3796633724 >> v2:172.21.15.133:3300/0 conn(0x7f49e0072d30 0x7f49e0073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1464797602 0 0) 0x7f49c8005730 con 0x7f49e00ae290 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 >> v2:172.21.15.133:3300/0 conn(0x7f49e0072d30 msgr2=0x7f49e0073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 --2- 172.21.15.100:0/3796633724 >> v2:172.21.15.133:3300/0 conn(0x7f49e0072d30 0x7f49e0073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 >> v1:172.21.15.133:6789/0 conn(0x7f49e015b710 legacy=0x7f49e006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e006fdc0 con 0x7f49e00ae290 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f49d40016f0 con 0x7f49e00ae290 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 >> v1:172.21.15.100:6789/0 conn(0x7f49e00ae290 legacy=0x7f49e006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8005c60 0x7f49c8006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49c8006a10 0x7f49c8006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c80074f0 0x7f49c800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f49e006eb80 con 0x7f49c8006a10 2024-05-09T05:06:31.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f49c800e3c0 con 0x7f49c8005c60 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.959+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f49c800e5c0 con 0x7f49c80074f0 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e4c00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49c8006a10 0x7f49c8006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e5600640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8005c60 0x7f49c8006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e4c00640 1 -- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c80074f0 msgr2=0x7f49c800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e4c00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c80074f0 0x7f49c800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e4c00640 1 -- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8005c60 msgr2=0x7f49c8006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e4c00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c8005c60 0x7f49c8006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e4c00640 1 -- 172.21.15.100:0/3796633724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c8005730 con 0x7f49c8006a10 2024-05-09T05:06:31.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.960+0000 7f49e6000640 1 -- 172.21.15.100:0/3796633724 reap_dead start 2024-05-09T05:06:31.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.961+0000 7f49e4c00640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49c8006a10 0x7f49c8006e90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f49cc001760 tx=0x7f49c8007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301c1831c881491a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0013b0 con 0x7f49c8006a10 2024-05-09T05:06:31.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc0052d0 con 0x7f49c8006a10 2024-05-09T05:06:31.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49dfe00640 1 -- 172.21.15.100:0/3796633724 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc02aa90 con 0x7f49c8006a10 2024-05-09T05:06:31.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 -- 172.21.15.100:0/3796633724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49c8006a10 msgr2=0x7f49c8006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49c8006a10 0x7f49c8006e90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f49cc001760 tx=0x7f49c8007a40 comp rx=0 tx=0).stop 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 -- 172.21.15.100:0/3796633724 shutdown_connections 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 --2- 172.21.15.100:0/3796633724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49c8006a10 0x7f49c8006e90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 -- 172.21.15.100:0/3796633724 >> 172.21.15.100:0/3796633724 conn(0x7f49e00b2c20 msgr2=0x7f49e00b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 -- 172.21.15.100:0/3796633724 shutdown_connections 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.962+0000 7f49e8000640 1 -- 172.21.15.100:0/3796633724 wait complete. 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.964+0000 7f49e8000640 1 Processor -- start 2024-05-09T05:06:31.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.964+0000 7f49e8000640 1 -- start start 2024-05-09T05:06:31.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.965+0000 7f49e8000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c8006a10 0x7f49e014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.965+0000 7f49e8000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e00ce250 0x7f49e00ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.965+0000 7f49e8000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e015cce0 0x7f49e015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.965+0000 7f49e8000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b45d0 con 0x7f49e015cce0 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.965+0000 7f49e8000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b42f0 con 0x7f49e00ce250 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.965+0000 7f49e8000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f49e00b48b0 con 0x7f49c8006a10 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e015cce0 0x7f49e015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e015cce0 0x7f49e015d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36418/0 (socket says 172.21.15.100:36418) 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 -- 172.21.15.100:0/165528797 learned_addr learned my addr 172.21.15.100:0/165528797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e4c00640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e00ce250 0x7f49e00ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e5600640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c8006a10 0x7f49e014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 -- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c8006a10 msgr2=0x7f49e014f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c8006a10 0x7f49e014f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 -- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e00ce250 msgr2=0x7f49e00ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49e00ce250 0x7f49e00ce6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 -- 172.21.15.100:0/165528797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e01f8fb0 con 0x7f49e015cce0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e5600640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f49c8006a10 0x7f49e014f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.966+0000 7f49e6000640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e015cce0 0x7f49e015d160 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f49e009f230 tx=0x7f49d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.967+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d800ed90 con 0x7f49e015cce0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.967+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d8019070 con 0x7f49e015cce0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.967+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8014660 con 0x7f49e015cce0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.967+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e01f9290 con 0x7f49e015cce0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.967+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e01f9850 con 0x7f49e015cce0 2024-05-09T05:06:31.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.968+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49e014fb00 con 0x7f49e015cce0 2024-05-09T05:06:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.969+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f49d8014800 con 0x7f49e015cce0 2024-05-09T05:06:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.970+0000 7f49dd600640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f49c0076300 0x7f49c00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.970+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f49d8097770 con 0x7f49e015cce0 2024-05-09T05:06:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.970+0000 7f49dd600640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f49c007c1c0 0x7f49c007e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.970+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 --> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49c007ec90 con 0x7f49c007c1c0 2024-05-09T05:06:31.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.970+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f49d809e050 con 0x7f49e015cce0 2024-05-09T05:06:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.970+0000 7f49e5600640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f49c0076300 0x7f49c00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.971+0000 7f49e4c00640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f49c007c1c0 0x7f49c007e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.971+0000 7f49e5600640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f49c0076300 0x7f49c00787c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f49d4000fb0 tx=0x7f49d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.971+0000 7f49e4c00640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f49c007c1c0 0x7f49c007e5e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:31.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.972+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== osd.2 v2:172.21.15.100:6810/752925701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49c007ec90 con 0x7f49c007c1c0 2024-05-09T05:06:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.986+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 --> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f49e0069500 con 0x7f49c007c1c0 2024-05-09T05:06:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.987+0000 7f49dd600640 1 -- 172.21.15.100:0/165528797 <== osd.2 v2:172.21.15.100:6810/752925701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f49e0069500 con 0x7f49c007c1c0 2024-05-09T05:06:31.988 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:31.988 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:31.988 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.987+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f49c007c1c0 msgr2=0x7f49c007e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.987+0000 7f49e8000640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6810/752925701,v1:172.21.15.100:6814/752925701] conn(0x7f49c007c1c0 0x7f49c007e5e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f49c0076300 msgr2=0x7f49c00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f49c0076300 0x7f49c00787c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f49d4000fb0 tx=0x7f49d4009040 comp rx=0 tx=0).stop 2024-05-09T05:06:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e015cce0 msgr2=0x7f49e015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 --2- 172.21.15.100:0/165528797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e015cce0 0x7f49e015d160 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f49e009f230 tx=0x7f49d800e4b0 comp rx=0 tx=0).stop 2024-05-09T05:06:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e6000640 1 -- 172.21.15.100:0/165528797 reap_dead start 2024-05-09T05:06:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 shutdown_connections 2024-05-09T05:06:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 >> 172.21.15.100:0/165528797 conn(0x7f49e00b2c20 msgr2=0x7f49e015aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 shutdown_connections 2024-05-09T05:06:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:31.988+0000 7f49e8000640 1 -- 172.21.15.100:0/165528797 wait complete. 2024-05-09T05:06:32.007 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-09T05:06:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.205+0000 7fd986400640 1 Processor -- start 2024-05-09T05:06:32.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.205+0000 7fd986400640 1 -- start start 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd986400640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd98015d630 0x7fd9800b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd986400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 0x7fd98006e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd986400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98006f090 con 0x7fd98006e9c0 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd986400640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fd98006ee70 con 0x7fd98015d630 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd986400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800b5fb0 con 0x7fd9800b6980 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd985a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd98006e9c0 0x7fd9800721e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40700/0 (socket says 172.21.15.100:40700) 2024-05-09T05:06:32.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.207+0000 7fd985a00640 1 -- 172.21.15.100:0/2293915076 learned_addr learned my addr 172.21.15.100:0/2293915076 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd985000640 1 --2- 172.21.15.100:0/2293915076 >> v2:172.21.15.133:3300/0 conn(0x7fd98015d630 0x7fd9800b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd977e00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 0x7fd98006e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027882498 0 0) 0x7fd98006f090 con 0x7fd98006e9c0 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd964003520 con 0x7fd98006e9c0 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 949666277 0 0) 0x7fd964003520 con 0x7fd98006e9c0 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 msgr2=0x7fd98006e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:32.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 0x7fd98006e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 >> v2:172.21.15.133:3300/0 conn(0x7fd98015d630 msgr2=0x7fd9800b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 --2- 172.21.15.100:0/2293915076 >> v2:172.21.15.133:3300/0 conn(0x7fd98015d630 0x7fd9800b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98006f370 con 0x7fd98006e9c0 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.208+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fd978001a70 con 0x7fd98006e9c0 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 >> v1:172.21.15.100:6789/0 conn(0x7fd98006e9c0 legacy=0x7fd9800721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 0x7fd964003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd964003fd0 0x7fd964004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd98006ee70 con 0x7fd964004d40 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800b5fb0 con 0x7fd964003fd0 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd96400ba10 con 0x7fd9800b6980 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd985a00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd985000640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 0x7fd964003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd977e00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd964003fd0 0x7fd964004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd985a00640 1 -- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 msgr2=0x7fd964003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:32.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd985a00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd9800b6980 0x7fd964003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd985a00640 1 -- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd964003fd0 msgr2=0x7fd964004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:32.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.209+0000 7fd985a00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd964003fd0 0x7fd964004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.210+0000 7fd985a00640 1 -- 172.21.15.100:0/2293915076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd964003520 con 0x7fd964004d40 2024-05-09T05:06:32.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd985a00640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd97800a880 tx=0x7fd964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a14c12048d4e84e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97800a4a0 con 0x7fd964004d40 2024-05-09T05:06:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97802f070 con 0x7fd964004d40 2024-05-09T05:06:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd97fe00640 1 -- 172.21.15.100:0/2293915076 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97802bc30 con 0x7fd964004d40 2024-05-09T05:06:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd986400640 1 -- 172.21.15.100:0/2293915076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd964004d40 msgr2=0x7fd9640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd986400640 1 --2- 172.21.15.100:0/2293915076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd964004d40 0x7fd9640051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd97800a880 tx=0x7fd964005830 comp rx=0 tx=0).stop 2024-05-09T05:06:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.211+0000 7fd985a00640 1 -- 172.21.15.100:0/2293915076 reap_dead start 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.212+0000 7fd986400640 1 -- 172.21.15.100:0/2293915076 shutdown_connections 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.212+0000 7fd986400640 1 -- 172.21.15.100:0/2293915076 >> 172.21.15.100:0/2293915076 conn(0x7fd9800b29b0 msgr2=0x7fd9800b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.212+0000 7fd986400640 1 -- 172.21.15.100:0/2293915076 shutdown_connections 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.212+0000 7fd986400640 1 -- 172.21.15.100:0/2293915076 wait complete. 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.213+0000 7fd986400640 1 Processor -- start 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.214+0000 7fd986400640 1 -- start start 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.214+0000 7fd986400640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd964004d40 0x7fd9800c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.214+0000 7fd986400640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd980157e60 0x7fd98014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd986400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 0x7fd9800d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd986400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800b5c40 con 0x7fd9800d0c60 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd986400640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800b4000 con 0x7fd980157e60 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd986400640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800728f0 con 0x7fd964004d40 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 0x7fd9800d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 0x7fd9800d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36440/0 (socket says 172.21.15.100:36440) 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 -- 172.21.15.100:0/3816863542 learned_addr learned my addr 172.21.15.100:0/3816863542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985000640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd964004d40 0x7fd9800c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd977e00640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd980157e60 0x7fd98014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 -- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd964004d40 msgr2=0x7fd9800c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd964004d40 0x7fd9800c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 -- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd980157e60 msgr2=0x7fd98014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd980157e60 0x7fd98014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.215+0000 7fd985a00640 1 -- 172.21.15.100:0/3816863542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd980158620 con 0x7fd9800d0c60 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd977e00640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd980157e60 0x7fd98014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd985a00640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 0x7fd9800d1110 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd97802b4c0 tx=0x7fd98006f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978044070 con 0x7fd9800d0c60 2024-05-09T05:06:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97800a480 con 0x7fd9800d0c60 2024-05-09T05:06:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd980158900 con 0x7fd9800d0c60 2024-05-09T05:06:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978001fe0 con 0x7fd9800d0c60 2024-05-09T05:06:32.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.216+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd980158ec0 con 0x7fd9800d0c60 2024-05-09T05:06:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.218+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98006a550 con 0x7fd9800d0c60 2024-05-09T05:06:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.219+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd978047070 con 0x7fd9800d0c60 2024-05-09T05:06:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.220+0000 7fd97d600640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd95c0762d0 0x7fd95c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.220+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fd9780b7430 con 0x7fd9800d0c60 2024-05-09T05:06:32.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.220+0000 7fd985000640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd95c0762d0 0x7fd95c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.221+0000 7fd985000640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd95c0762d0 0x7fd95c078790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd980160850 tx=0x7fd970008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.224+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd978080ad0 con 0x7fd9800d0c60 2024-05-09T05:06:32.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.434+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd9800c6f80 con 0x7fd95c0762d0 2024-05-09T05:06:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.435+0000 7fd97d600640 1 -- 172.21.15.100:0/3816863542 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd970014ac0 con 0x7fd95c0762d0 2024-05-09T05:06:32.436 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-05-09T05:06:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd95c0762d0 msgr2=0x7fd95c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd95c0762d0 0x7fd95c078790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd980160850 tx=0x7fd970008040 comp rx=0 tx=0).stop 2024-05-09T05:06:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 msgr2=0x7fd9800d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 0x7fd9800d1110 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd97802b4c0 tx=0x7fd98006f260 comp rx=0 tx=0).stop 2024-05-09T05:06:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 shutdown_connections 2024-05-09T05:06:32.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fd95c0762d0 0x7fd95c078790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9800d0c60 0x7fd9800d1110 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd980157e60 0x7fd98014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 --2- 172.21.15.100:0/3816863542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd964004d40 0x7fd9800c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 >> 172.21.15.100:0/3816863542 conn(0x7fd9800b29b0 msgr2=0x7fd9800ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 shutdown_connections 2024-05-09T05:06:32.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.438+0000 7fd986400640 1 -- 172.21.15.100:0/3816863542 wait complete. 2024-05-09T05:06:32.458 INFO:tasks.ceph:Scrubbing osd.3 2024-05-09T05:06:32.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:32.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.660+0000 7f893b800640 1 Processor -- start 2024-05-09T05:06:32.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.660+0000 7f893b800640 1 -- start start 2024-05-09T05:06:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f893b800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89340d01e0 0x7f89340afc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f893b800640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8934074460 0x7f89340b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f893b800640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893415d5c0 con 0x7f89340d0760 2024-05-09T05:06:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f893b800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f89340d05c0 con 0x7f89340d01e0 2024-05-09T05:06:32.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f893b800640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f89340b06d0 con 0x7f8934074460 2024-05-09T05:06:32.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89340d01e0 0x7f89340afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89340d01e0 0x7f89340afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36448/0 (socket says 172.21.15.100:36448) 2024-05-09T05:06:32.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 -- 172.21.15.100:0/1832170310 learned_addr learned my addr 172.21.15.100:0/1832170310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:32.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 -- 172.21.15.100:0/1832170310 >> v2:172.21.15.133:3300/0 conn(0x7f8934074460 msgr2=0x7f89340b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:32.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 --2- 172.21.15.100:0/1832170310 >> v2:172.21.15.133:3300/0 conn(0x7f8934074460 0x7f89340b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 -- 172.21.15.100:0/1832170310 >> v1:172.21.15.133:6789/0 conn(0x7f89340d0760 legacy=0x7f893406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:32.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.662+0000 7f8938e00640 1 -- 172.21.15.100:0/1832170310 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8934072c90 con 0x7f89340d01e0 2024-05-09T05:06:32.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.663+0000 7f8938e00640 1 --2- 172.21.15.100:0/1832170310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89340d01e0 0x7f89340afc50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8934073cd0 tx=0x7f892402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88230791c701fbbe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f8933e00640 1 -- 172.21.15.100:0/1832170310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037070 con 0x7f89340d01e0 2024-05-09T05:06:32.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f8933e00640 1 -- 172.21.15.100:0/1832170310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924032440 con 0x7f89340d01e0 2024-05-09T05:06:32.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f8933e00640 1 -- 172.21.15.100:0/1832170310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924032810 con 0x7f89340d01e0 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f893b800640 1 -- 172.21.15.100:0/1832170310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89340d01e0 msgr2=0x7f89340afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f893b800640 1 --2- 172.21.15.100:0/1832170310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89340d01e0 0x7f89340afc50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8934073cd0 tx=0x7f892402a1e0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f893b800640 1 -- 172.21.15.100:0/1832170310 shutdown_connections 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f893b800640 1 --2- 172.21.15.100:0/1832170310 >> v2:172.21.15.133:3300/0 conn(0x7f8934074460 0x7f89340b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f893b800640 1 --2- 172.21.15.100:0/1832170310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89340d01e0 0x7f89340afc50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.664+0000 7f893b800640 1 -- 172.21.15.100:0/1832170310 >> 172.21.15.100:0/1832170310 conn(0x7f89340b2c20 msgr2=0x7f89340b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.665+0000 7f893b800640 1 -- 172.21.15.100:0/1832170310 shutdown_connections 2024-05-09T05:06:32.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.665+0000 7f893b800640 1 -- 172.21.15.100:0/1832170310 wait complete. 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.666+0000 7f893b800640 1 Processor -- start 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.666+0000 7f893b800640 1 -- start start 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.667+0000 7f893b800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8934074460 0x7f89341f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.667+0000 7f893b800640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89340d01e0 0x7f89341e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.667+0000 7f893b800640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89340d0760 0x7f89341f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.667+0000 7f893b800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8934073530 con 0x7f8934074460 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.667+0000 7f893b800640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f8934073250 con 0x7f89340d0760 2024-05-09T05:06:32.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.667+0000 7f893b800640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f8934073810 con 0x7f89340d01e0 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8934074460 0x7f89341f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8934074460 0x7f89341f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36462/0 (socket says 172.21.15.100:36462) 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 -- 172.21.15.100:0/245858228 learned_addr learned my addr 172.21.15.100:0/245858228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8939800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89340d0760 0x7f89341f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f892be00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89340d01e0 0x7f89341e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 -- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89340d01e0 msgr2=0x7f89341e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89340d01e0 0x7f89341e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 -- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89340d0760 msgr2=0x7f89341f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89340d0760 0x7f89341f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8938e00640 1 -- 172.21.15.100:0/245858228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89341e6f90 con 0x7f8934074460 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f8939800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89340d0760 0x7f89341f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.668+0000 7f892be00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89340d01e0 0x7f89341e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.669+0000 7f8938e00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8934074460 0x7f89341f4c30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f892402a220 tx=0x7f89240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.669+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924041070 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.669+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892403c870 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.669+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037040 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.669+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89341e7270 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.669+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341e7830 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.670+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89341f5170 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.671+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8924044070 con 0x7f8934074460 2024-05-09T05:06:32.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.672+0000 7f8931600640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f89100762d0 0x7f8910078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.672+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f89240b7ed0 con 0x7f8934074460 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.672+0000 7f8931600640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f891007c190 0x7f891007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.672+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8924048e50 con 0x7f891007c190 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.672+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f89240ba4f0 con 0x7f8934074460 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.673+0000 7f892be00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f89100762d0 0x7f8910078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.673+0000 7f8939800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f891007c190 0x7f891007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:32.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.673+0000 7f892be00640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f89100762d0 0x7f8910078790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89341e8b10 tx=0x7f891c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.673+0000 7f8939800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f891007c190 0x7f891007e5b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.674+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== osd.3 v2:172.21.15.100:6800/209630893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8924048e50 con 0x7f891007c190 2024-05-09T05:06:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.689+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 --> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8934069500 con 0x7f891007c190 2024-05-09T05:06:32.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.689+0000 7f8931600640 1 -- 172.21.15.100:0/245858228 <== osd.3 v2:172.21.15.100:6800/209630893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8934069500 con 0x7f891007c190 2024-05-09T05:06:32.818 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:32.818 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:32.818 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.689+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f891007c190 msgr2=0x7f891007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.689+0000 7f893b800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6800/209630893,v1:172.21.15.100:6801/209630893] conn(0x7f891007c190 0x7f891007e5b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f89100762d0 msgr2=0x7f8910078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f89100762d0 0x7f8910078790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89341e8b10 tx=0x7f891c008040 comp rx=0 tx=0).stop 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8934074460 msgr2=0x7f89341f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 --2- 172.21.15.100:0/245858228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8934074460 0x7f89341f4c30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f892402a220 tx=0x7f89240046c0 comp rx=0 tx=0).stop 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f8939800640 1 -- 172.21.15.100:0/245858228 reap_dead start 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 shutdown_connections 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 >> 172.21.15.100:0/245858228 conn(0x7f89340b2c20 msgr2=0x7f89340b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 shutdown_connections 2024-05-09T05:06:32.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:32.690+0000 7f893b800640 1 -- 172.21.15.100:0/245858228 wait complete. 2024-05-09T05:06:32.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-09T05:06:33.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.030+0000 7f82a3e00640 1 Processor -- start 2024-05-09T05:06:33.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.030+0000 7f82a3e00640 1 -- start start 2024-05-09T05:06:33.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.032+0000 7f82a3e00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a41599d0 0x7f82a415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.032+0000 7f82a3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82a415d670 0x7f82a415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.032+0000 7f82a3e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82a4160240 con 0x7f82a406f590 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.032+0000 7f82a3e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f82a415ffe0 con 0x7f82a415d670 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.032+0000 7f82a3e00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f82a4160520 con 0x7f82a41599d0 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.032+0000 7f829be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82a415d670 0x7f82a415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f829be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82a415d670 0x7f82a415faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36474/0 (socket says 172.21.15.100:36474) 2024-05-09T05:06:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f829be00640 1 -- 172.21.15.100:0/845631956 learned_addr learned my addr 172.21.15.100:0/845631956 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f82a2a00640 1 --2- 172.21.15.100:0/845631956 >> v2:172.21.15.133:3300/0 conn(0x7f82a41599d0 0x7f82a415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f829be00640 1 -- 172.21.15.100:0/845631956 >> v2:172.21.15.133:3300/0 conn(0x7f82a41599d0 msgr2=0x7f82a415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f829be00640 1 --2- 172.21.15.100:0/845631956 >> v2:172.21.15.133:3300/0 conn(0x7f82a41599d0 0x7f82a415d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f829be00640 1 -- 172.21.15.100:0/845631956 >> v1:172.21.15.100:6789/0 conn(0x7f82a406f590 legacy=0x7f82a406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.033+0000 7f829be00640 1 -- 172.21.15.100:0/845631956 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a4160800 con 0x7f82a415d670 2024-05-09T05:06:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.034+0000 7f829be00640 1 --2- 172.21.15.100:0/845631956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a415d670 0x7f82a415faa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f82a40ce6c0 tx=0x7f828c02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bf3b7bd8bb240c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.034+0000 7f82a2000640 1 -- 172.21.15.100:0/845631956 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c033640 con 0x7f82a415d670 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.034+0000 7f82a2000640 1 -- 172.21.15.100:0/845631956 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c038070 con 0x7f82a415d670 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.034+0000 7f82a2000640 1 -- 172.21.15.100:0/845631956 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c033a00 con 0x7f82a415d670 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 -- 172.21.15.100:0/845631956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a415d670 msgr2=0x7f82a415faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 --2- 172.21.15.100:0/845631956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a415d670 0x7f82a415faa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f82a40ce6c0 tx=0x7f828c02c8b0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 -- 172.21.15.100:0/845631956 shutdown_connections 2024-05-09T05:06:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 --2- 172.21.15.100:0/845631956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a415d670 0x7f82a415faa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 --2- 172.21.15.100:0/845631956 >> v2:172.21.15.133:3300/0 conn(0x7f82a41599d0 0x7f82a415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 -- 172.21.15.100:0/845631956 >> 172.21.15.100:0/845631956 conn(0x7f82a40b29b0 msgr2=0x7f82a40b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 -- 172.21.15.100:0/845631956 shutdown_connections 2024-05-09T05:06:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.035+0000 7f82a3e00640 1 -- 172.21.15.100:0/845631956 wait complete. 2024-05-09T05:06:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.037+0000 7f82a3e00640 1 Processor -- start 2024-05-09T05:06:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.037+0000 7f82a3e00640 1 -- start start 2024-05-09T05:06:33.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f82a3e00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a406f590 0x7f82a41eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f82a3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 0x7f82a415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f82a3e00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a415d670 0x7f82a4155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f82a3e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f82a4159f30 con 0x7f82a41599d0 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f82a3e00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f82a4159db0 con 0x7f82a415d670 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f82a3e00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f82a40cfbd0 con 0x7f82a406f590 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f829be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 0x7f82a415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f829be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 0x7f82a415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36478/0 (socket says 172.21.15.100:36478) 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.038+0000 7f829be00640 1 -- 172.21.15.100:0/654939991 learned_addr learned my addr 172.21.15.100:0/654939991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f82a2a00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a406f590 0x7f82a41eb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f82a3400640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a415d670 0x7f82a4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f829be00640 1 -- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a406f590 msgr2=0x7f82a41eb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f829be00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a406f590 0x7f82a41eb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f829be00640 1 -- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a415d670 msgr2=0x7f82a4155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f829be00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a415d670 0x7f82a4155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f829be00640 1 -- 172.21.15.100:0/654939991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a4156100 con 0x7f82a41599d0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f82a3400640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a415d670 0x7f82a4155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.039+0000 7f829be00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 0x7f82a415b370 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f828c000c00 tx=0x7f828c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.040+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c043070 con 0x7f82a41599d0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.040+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c0329d0 con 0x7f82a41599d0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.040+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c032dc0 con 0x7f82a41599d0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.040+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a41f90e0 con 0x7f82a41599d0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.040+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a41f96a0 con 0x7f82a41599d0 2024-05-09T05:06:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.041+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a40cee00 con 0x7f82a41599d0 2024-05-09T05:06:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.042+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f828c046070 con 0x7f82a41599d0 2024-05-09T05:06:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.043+0000 7f829aa00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82800762d0 0x7f8280078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.043+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f828c0b7e30 con 0x7f82a41599d0 2024-05-09T05:06:33.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.044+0000 7f82a2a00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82800762d0 0x7f8280078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.044+0000 7f82a2a00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82800762d0 0x7f8280078790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8294006fd0 tx=0x7f8294008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.047+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82a40cee00 con 0x7f82a41599d0 2024-05-09T05:06:33.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.249+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f82a406a550 con 0x7f82800762d0 2024-05-09T05:06:33.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.250+0000 7f829aa00640 1 -- 172.21.15.100:0/654939991 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f82a406a550 con 0x7f82800762d0 2024-05-09T05:06:33.251 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-05-09T05:06:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.252+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82800762d0 msgr2=0x7f8280078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.252+0000 7f82a3e00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82800762d0 0x7f8280078790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8294006fd0 tx=0x7f8294008040 comp rx=0 tx=0).stop 2024-05-09T05:06:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.252+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 msgr2=0x7f82a415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.252+0000 7f82a3e00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 0x7f82a415b370 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f828c000c00 tx=0x7f828c004730 comp rx=0 tx=0).stop 2024-05-09T05:06:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 shutdown_connections 2024-05-09T05:06:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f82800762d0 0x7f8280078790 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a415d670 0x7f82a4155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a41599d0 0x7f82a415b370 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 --2- 172.21.15.100:0/654939991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a406f590 0x7f82a41eb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 >> 172.21.15.100:0/654939991 conn(0x7f82a40b29b0 msgr2=0x7f82a40ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 shutdown_connections 2024-05-09T05:06:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.253+0000 7f82a3e00640 1 -- 172.21.15.100:0/654939991 wait complete. 2024-05-09T05:06:33.270 INFO:tasks.ceph:Scrubbing osd.4 2024-05-09T05:06:33.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.476+0000 7f648ac00640 1 Processor -- start 2024-05-09T05:06:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.476+0000 7f648ac00640 1 -- start start 2024-05-09T05:06:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.477+0000 7f648ac00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 0x7f648415d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.477+0000 7f648ac00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6484161780 0x7f648415da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.477+0000 7f648ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648415e290 con 0x7f64841574e0 2024-05-09T05:06:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.477+0000 7f648ac00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f6484160ca0 con 0x7f6484161780 2024-05-09T05:06:33.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.477+0000 7f648ac00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f6484160f80 con 0x7f64840b6920 2024-05-09T05:06:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6489800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f64841574e0 0x7f64840b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40714/0 (socket says 172.21.15.100:40714) 2024-05-09T05:06:33.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6489800640 1 -- 172.21.15.100:0/1865385814 learned_addr learned my addr 172.21.15.100:0/1865385814 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6488e00640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 0x7f648415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f648a200640 1 --2- 172.21.15.100:0/1865385814 >> v2:172.21.15.133:3300/0 conn(0x7f6484161780 0x7f648415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360844183 0 0) 0x7f648415e290 con 0x7f64841574e0 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f646c003520 con 0x7f64841574e0 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 242105518 0 0) 0x7f646c003520 con 0x7f64841574e0 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.478+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 msgr2=0x7f648415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 0x7f648415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 >> v2:172.21.15.133:3300/0 conn(0x7f6484161780 msgr2=0x7f648415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:33.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 --2- 172.21.15.100:0/1865385814 >> v2:172.21.15.133:3300/0 conn(0x7f6484161780 0x7f648415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6484161260 con 0x7f64841574e0 2024-05-09T05:06:33.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f64780016f0 con 0x7f64841574e0 2024-05-09T05:06:33.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 >> v1:172.21.15.100:6789/0 conn(0x7f64841574e0 legacy=0x7f64840b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f646c003a00 0x7f646c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f646c004800 0x7f646c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 0x7f646c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6484160ca0 con 0x7f646c003a00 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f6484160f80 con 0x7f646c004800 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f646c00b9f0 con 0x7f64840b6920 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6489800640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f646c003a00 0x7f646c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6489800640 1 -- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 msgr2=0x7f646c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6489800640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840b6920 0x7f646c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6489800640 1 -- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f646c004800 msgr2=0x7f646c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6489800640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f646c004800 0x7f646c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.479+0000 7f6489800640 1 -- 172.21.15.100:0/1865385814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c003520 con 0x7f646c003a00 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.480+0000 7f6489800640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f646c003a00 0x7f646c003e20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f647800c290 tx=0x7f646c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f221a50d354662f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.480+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478007d50 con 0x7f646c003a00 2024-05-09T05:06:33.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.480+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6478005af0 con 0x7f646c003a00 2024-05-09T05:06:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.480+0000 7f6483e00640 1 -- 172.21.15.100:0/1865385814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478007070 con 0x7f646c003a00 2024-05-09T05:06:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648ac00640 1 -- 172.21.15.100:0/1865385814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f646c003a00 msgr2=0x7f646c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648ac00640 1 --2- 172.21.15.100:0/1865385814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f646c003a00 0x7f646c003e20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f647800c290 tx=0x7f646c005830 comp rx=0 tx=0).stop 2024-05-09T05:06:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648a200640 1 -- 172.21.15.100:0/1865385814 reap_dead start 2024-05-09T05:06:33.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648ac00640 1 -- 172.21.15.100:0/1865385814 shutdown_connections 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648ac00640 1 -- 172.21.15.100:0/1865385814 >> 172.21.15.100:0/1865385814 conn(0x7f648406c3d0 msgr2=0x7f648406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648ac00640 1 -- 172.21.15.100:0/1865385814 shutdown_connections 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.481+0000 7f648ac00640 1 -- 172.21.15.100:0/1865385814 wait complete. 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.483+0000 7f648ac00640 1 Processor -- start 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.483+0000 7f648ac00640 1 -- start start 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648ac00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f646c003a00 0x7f64841f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648ac00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840ae880 0x7f6484148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6484159be0 0x7f648415a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64841578c0 con 0x7f6484159be0 2024-05-09T05:06:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648ac00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f648415d510 con 0x7f646c003a00 2024-05-09T05:06:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648ac00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f64840afb20 con 0x7f64840ae880 2024-05-09T05:06:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6484159be0 0x7f648415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6484159be0 0x7f648415a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36506/0 (socket says 172.21.15.100:36506) 2024-05-09T05:06:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f648a200640 1 -- 172.21.15.100:0/3733826295 learned_addr learned my addr 172.21.15.100:0/3733826295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.484+0000 7f6488e00640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840ae880 0x7f6484148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648a200640 1 -- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840ae880 msgr2=0x7f6484148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648a200640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f64840ae880 0x7f6484148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648a200640 1 -- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f646c003a00 msgr2=0x7f64841f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648a200640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f646c003a00 0x7f64841f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648a200640 1 -- 172.21.15.100:0/3733826295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64840aef10 con 0x7f6484159be0 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648a200640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6484159be0 0x7f648415a060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6484072ab0 tx=0x7f647c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c00bab0 con 0x7f6484159be0 2024-05-09T05:06:33.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647c01a070 con 0x7f6484159be0 2024-05-09T05:06:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64840af1f0 con 0x7f6484159be0 2024-05-09T05:06:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c014400 con 0x7f6484159be0 2024-05-09T05:06:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.485+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64840af7b0 con 0x7f6484159be0 2024-05-09T05:06:33.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.486+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f648406a630 con 0x7f6484159be0 2024-05-09T05:06:33.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.488+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f647c005d10 con 0x7f6484159be0 2024-05-09T05:06:33.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.488+0000 7f6481600640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6464076300 0x7f64640787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.489+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f647c098040 con 0x7f6484159be0 2024-05-09T05:06:33.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.489+0000 7f6489800640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6464076300 0x7f64640787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.489+0000 7f6481600640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f646407c1c0 0x7f646407e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.489+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 --> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f646407ec90 con 0x7f646407c1c0 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.489+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f647c0984d0 con 0x7f6484159be0 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.489+0000 7f6489800640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6464076300 0x7f64640787c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6478032000 tx=0x7f6478009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.490+0000 7f6488e00640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f646407c1c0 0x7f646407e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.490+0000 7f6488e00640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f646407c1c0 0x7f646407e5e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.493+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== osd.4 v2:172.21.15.133:6800/4260847374 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f646407ec90 con 0x7f646407c1c0 2024-05-09T05:06:33.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.507+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 --> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6484072d80 con 0x7f646407c1c0 2024-05-09T05:06:33.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f6481600640 1 -- 172.21.15.100:0/3733826295 <== osd.4 v2:172.21.15.133:6800/4260847374 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6484072d80 con 0x7f646407c1c0 2024-05-09T05:06:33.509 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:33.509 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:33.509 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f646407c1c0 msgr2=0x7f646407e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.133:6800/4260847374,v1:172.21.15.133:6801/4260847374] conn(0x7f646407c1c0 0x7f646407e5e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6464076300 msgr2=0x7f64640787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f6464076300 0x7f64640787c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6478032000 tx=0x7f6478009030 comp rx=0 tx=0).stop 2024-05-09T05:06:33.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6484159be0 msgr2=0x7f648415a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 --2- 172.21.15.100:0/3733826295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6484159be0 0x7f648415a060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6484072ab0 tx=0x7f647c00b480 comp rx=0 tx=0).stop 2024-05-09T05:06:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648a200640 1 -- 172.21.15.100:0/3733826295 reap_dead start 2024-05-09T05:06:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 shutdown_connections 2024-05-09T05:06:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.508+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 >> 172.21.15.100:0/3733826295 conn(0x7f648406c3d0 msgr2=0x7f648406e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.509+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 shutdown_connections 2024-05-09T05:06:33.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.509+0000 7f648ac00640 1 -- 172.21.15.100:0/3733826295 wait complete. 2024-05-09T05:06:33.526 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-09T05:06:33.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.725+0000 7f1254600640 1 Processor -- start 2024-05-09T05:06:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.725+0000 7f1254600640 1 -- start start 2024-05-09T05:06:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1254600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f124c15d5a0 0x7f124c073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1254600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f124c0d0110 0x7f124c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1254600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f124c06e520 con 0x7f124c074490 2024-05-09T05:06:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1254600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f124c15d980 con 0x7f124c0d0110 2024-05-09T05:06:33.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1254600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f124c0cf440 con 0x7f124c15d5a0 2024-05-09T05:06:33.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1251200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f124c074490 0x7f124c0cfa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40726/0 (socket says 172.21.15.100:40726) 2024-05-09T05:06:33.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1251200640 1 -- 172.21.15.100:0/4263383747 learned_addr learned my addr 172.21.15.100:0/4263383747 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:33.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.727+0000 7f1252600640 1 --2- 172.21.15.100:0/4263383747 >> v2:172.21.15.100:3300/0 conn(0x7f124c0d0110 0x7f124c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f1251c00640 1 --2- 172.21.15.100:0/4263383747 >> v2:172.21.15.133:3300/0 conn(0x7f124c15d5a0 0x7f124c073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f124be00640 1 -- 172.21.15.100:0/4263383747 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299367624 0 0) 0x7f124c06e520 con 0x7f124c074490 2024-05-09T05:06:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f124be00640 1 -- 172.21.15.100:0/4263383747 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1234003520 con 0x7f124c074490 2024-05-09T05:06:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f1252600640 1 -- 172.21.15.100:0/4263383747 >> v2:172.21.15.133:3300/0 conn(0x7f124c15d5a0 msgr2=0x7f124c073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f1252600640 1 --2- 172.21.15.100:0/4263383747 >> v2:172.21.15.133:3300/0 conn(0x7f124c15d5a0 0x7f124c073f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f1252600640 1 -- 172.21.15.100:0/4263383747 >> v1:172.21.15.100:6789/0 conn(0x7f124c074490 legacy=0x7f124c0cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.728+0000 7f1252600640 1 -- 172.21.15.100:0/4263383747 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124c0cf720 con 0x7f124c0d0110 2024-05-09T05:06:33.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.729+0000 7f1252600640 1 --2- 172.21.15.100:0/4263383747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c0d0110 0x7f124c06ecb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f124c0764f0 tx=0x7f124402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deac281c764da2a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.730+0000 7f124be00640 1 -- 172.21.15.100:0/4263383747 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1244007740 con 0x7f124c0d0110 2024-05-09T05:06:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.730+0000 7f124be00640 1 -- 172.21.15.100:0/4263383747 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12440078e0 con 0x7f124c0d0110 2024-05-09T05:06:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.730+0000 7f124be00640 1 -- 172.21.15.100:0/4263383747 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1244007cb0 con 0x7f124c0d0110 2024-05-09T05:06:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.730+0000 7f1254600640 1 -- 172.21.15.100:0/4263383747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c0d0110 msgr2=0x7f124c06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.730+0000 7f1254600640 1 --2- 172.21.15.100:0/4263383747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c0d0110 0x7f124c06ecb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f124c0764f0 tx=0x7f124402a5f0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.731+0000 7f1254600640 1 -- 172.21.15.100:0/4263383747 shutdown_connections 2024-05-09T05:06:33.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.731+0000 7f1254600640 1 --2- 172.21.15.100:0/4263383747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c0d0110 0x7f124c06ecb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.731+0000 7f1254600640 1 --2- 172.21.15.100:0/4263383747 >> v2:172.21.15.133:3300/0 conn(0x7f124c15d5a0 0x7f124c073f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.731+0000 7f1254600640 1 -- 172.21.15.100:0/4263383747 >> 172.21.15.100:0/4263383747 conn(0x7f124c0b2c90 msgr2=0x7f124c0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:33.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.731+0000 7f1254600640 1 -- 172.21.15.100:0/4263383747 shutdown_connections 2024-05-09T05:06:33.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.731+0000 7f1254600640 1 -- 172.21.15.100:0/4263383747 wait complete. 2024-05-09T05:06:33.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.732+0000 7f1254600640 1 Processor -- start 2024-05-09T05:06:33.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.733+0000 7f1254600640 1 -- start start 2024-05-09T05:06:33.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.733+0000 7f1254600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 0x7f124c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.733+0000 7f1254600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124c0d0110 0x7f124c09ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1254600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124c15d5a0 0x7f124c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1254600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f124c09ede0 con 0x7f124c074490 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1254600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f124c0d0520 con 0x7f124c15d5a0 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1254600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f124c09ef60 con 0x7f124c0d0110 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 0x7f124c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 0x7f124c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36520/0 (socket says 172.21.15.100:36520) 2024-05-09T05:06:33.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 -- 172.21.15.100:0/3754145984 learned_addr learned my addr 172.21.15.100:0/3754145984 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1252600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124c15d5a0 0x7f124c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 -- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124c0d0110 msgr2=0x7f124c09ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251200640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124c0d0110 0x7f124c09ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124c0d0110 0x7f124c09ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 -- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124c15d5a0 msgr2=0x7f124c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124c15d5a0 0x7f124c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1251c00640 1 -- 172.21.15.100:0/3754145984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124c09d2b0 con 0x7f124c074490 2024-05-09T05:06:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.734+0000 7f1252600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124c15d5a0 0x7f124c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.735+0000 7f1251c00640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 0x7f124c1569a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f124000d800 tx=0x7f124000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.735+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000b6c0 con 0x7f124c074490 2024-05-09T05:06:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.735+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1240019070 con 0x7f124c074490 2024-05-09T05:06:33.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.735+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124c09d590 con 0x7f124c074490 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.735+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000ba80 con 0x7f124c074490 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.735+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124c15a940 con 0x7f124c074490 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.736+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124c06a630 con 0x7f124c074490 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.738+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f124000bc20 con 0x7f124c074490 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.738+0000 7f1249600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f122c0762d0 0x7f122c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.739+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f12400977d0 con 0x7f124c074490 2024-05-09T05:06:33.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.739+0000 7f1251200640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f122c0762d0 0x7f122c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.740+0000 7f1251200640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f122c0762d0 0x7f122c078790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1238001220 tx=0x7f1238009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:33.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.743+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1240061430 con 0x7f124c074490 2024-05-09T05:06:33.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.948+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f124c156fa0 con 0x7f122c0762d0 2024-05-09T05:06:33.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.949+0000 7f1249600640 1 -- 172.21.15.100:0/3754145984 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f124c156fa0 con 0x7f122c0762d0 2024-05-09T05:06:33.950 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-05-09T05:06:33.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f122c0762d0 msgr2=0x7f122c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f122c0762d0 0x7f122c078790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1238001220 tx=0x7f1238009040 comp rx=0 tx=0).stop 2024-05-09T05:06:33.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 msgr2=0x7f124c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:33.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 0x7f124c1569a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f124000d800 tx=0x7f124000dcc0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 shutdown_connections 2024-05-09T05:06:33.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f122c0762d0 0x7f122c078790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f124c15d5a0 0x7f124c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f124c0d0110 0x7f124c09ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 --2- 172.21.15.100:0/3754145984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f124c074490 0x7f124c1569a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:33.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 >> 172.21.15.100:0/3754145984 conn(0x7f124c0b2c90 msgr2=0x7f124c157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:33.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 shutdown_connections 2024-05-09T05:06:33.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:33.952+0000 7f1254600640 1 -- 172.21.15.100:0/3754145984 wait complete. 2024-05-09T05:06:33.972 INFO:tasks.ceph:Scrubbing osd.5 2024-05-09T05:06:33.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.185+0000 7ff4f4000640 1 Processor -- start 2024-05-09T05:06:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.185+0000 7ff4f4000640 1 -- start start 2024-05-09T05:06:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f4000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 0x7ff4ec164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f4000640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0d0760 0x7ff4ec167220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f4000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4ec15d5c0 con 0x7ff4ec0d01e0 2024-05-09T05:06:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f4000640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ec0d05c0 con 0x7ff4ec0d0760 2024-05-09T05:06:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f4000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec072c90 con 0x7ff4ec06f510 2024-05-09T05:06:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f1600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff4ec0d01e0 0x7ff4ec0afc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40738/0 (socket says 172.21.15.100:40738) 2024-05-09T05:06:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.187+0000 7ff4f1600640 1 -- 172.21.15.100:0/966578418 learned_addr learned my addr 172.21.15.100:0/966578418 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4f0c00640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 0x7ff4ec164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4f2000640 1 --2- 172.21.15.100:0/966578418 >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0d0760 0x7ff4ec167220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978268084 0 0) 0x7ff4ec15d5c0 con 0x7ff4ec0d01e0 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4d4003520 con 0x7ff4ec0d01e0 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 795258254 0 0) 0x7ff4d4003520 con 0x7ff4ec0d01e0 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 msgr2=0x7ff4ec164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 0x7ff4ec164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0d0760 msgr2=0x7ff4ec167220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 --2- 172.21.15.100:0/966578418 >> v2:172.21.15.133:3300/0 conn(0x7ff4ec0d0760 0x7ff4ec167220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec072f70 con 0x7ff4ec0d01e0 2024-05-09T05:06:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7ff4e0001a70 con 0x7ff4ec0d01e0 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 >> v1:172.21.15.100:6789/0 conn(0x7ff4ec0d01e0 legacy=0x7ff4ec0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 0x7ff4d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4d4004d40 0x7ff4d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec0d05c0 con 0x7ff4d4003a00 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec072c90 con 0x7ff4d4004d40 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.188+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d400b9f0 con 0x7ff4ec06f510 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f1600640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f0c00640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 0x7ff4d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f2000640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4d4004d40 0x7ff4d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f1600640 1 -- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 msgr2=0x7ff4d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f1600640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec06f510 0x7ff4d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f1600640 1 -- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4d4004d40 msgr2=0x7ff4d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f1600640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4d4004d40 0x7ff4d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f1600640 1 -- 172.21.15.100:0/966578418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d4003520 con 0x7ff4d4003a00 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.189+0000 7ff4f2000640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4d4004d40 0x7ff4d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:34.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.190+0000 7ff4f1600640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4d4003e20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000a920 tx=0x7ff4d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b05c71ba48ff400 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.190+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000a4c0 con 0x7ff4d4003a00 2024-05-09T05:06:34.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.190+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e002f070 con 0x7ff4d4003a00 2024-05-09T05:06:34.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.190+0000 7ff4ebe00640 1 -- 172.21.15.100:0/966578418 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e002bc70 con 0x7ff4d4003a00 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f4000640 1 -- 172.21.15.100:0/966578418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 msgr2=0x7ff4d4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f4000640 1 --2- 172.21.15.100:0/966578418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4d4003e20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000a920 tx=0x7ff4d4005830 comp rx=0 tx=0).stop 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f2000640 1 -- 172.21.15.100:0/966578418 reap_dead start 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f4000640 1 -- 172.21.15.100:0/966578418 shutdown_connections 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f4000640 1 -- 172.21.15.100:0/966578418 >> 172.21.15.100:0/966578418 conn(0x7ff4ec0b2c20 msgr2=0x7ff4ec0b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f4000640 1 -- 172.21.15.100:0/966578418 shutdown_connections 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.191+0000 7ff4f4000640 1 -- 172.21.15.100:0/966578418 wait complete. 2024-05-09T05:06:34.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.193+0000 7ff4f4000640 1 Processor -- start 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.193+0000 7ff4f4000640 1 -- start start 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f4000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4ec1f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f4000640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec15f8a0 0x7ff4ec15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f4000640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec09ba10 0x7ff4ec09bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f4000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec073810 con 0x7ff4d4003a00 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f4000640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec073530 con 0x7ff4ec15f8a0 2024-05-09T05:06:34.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f4000640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec072980 con 0x7ff4ec09ba10 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4ec1f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4ec1f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36540/0 (socket says 172.21.15.100:36540) 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.194+0000 7ff4f1600640 1 -- 172.21.15.100:0/2966063603 learned_addr learned my addr 172.21.15.100:0/2966063603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f1600640 1 -- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec09ba10 msgr2=0x7ff4ec09bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f1600640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4ec09ba10 0x7ff4ec09bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f1600640 1 -- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec15f8a0 msgr2=0x7ff4ec15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f0c00640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec15f8a0 0x7ff4ec15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f1600640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4ec15f8a0 0x7ff4ec15fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f1600640 1 -- 172.21.15.100:0/2966063603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec09c620 con 0x7ff4d4003a00 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.195+0000 7ff4f1600640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4ec1f7c70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000aa40 tx=0x7ff4ec073140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.196+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0045070 con 0x7ff4d4003a00 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.196+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e002bc20 con 0x7ff4d4003a00 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.196+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0034470 con 0x7ff4d4003a00 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.196+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec09c900 con 0x7ff4d4003a00 2024-05-09T05:06:34.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.196+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec09cec0 con 0x7ff4d4003a00 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.197+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4ec09e5b0 con 0x7ff4d4003a00 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.198+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4e0048070 con 0x7ff4d4003a00 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.199+0000 7ff4e9600640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4cc076300 0x7ff4cc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.199+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7ff4e00b7430 con 0x7ff4d4003a00 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.199+0000 7ff4e9600640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7ff4cc07c1c0 0x7ff4cc07e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.199+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 --> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4e0036e50 con 0x7ff4cc07c1c0 2024-05-09T05:06:34.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.199+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff4e00be050 con 0x7ff4d4003a00 2024-05-09T05:06:34.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.199+0000 7ff4f0c00640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4cc076300 0x7ff4cc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.200+0000 7ff4f2000640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7ff4cc07c1c0 0x7ff4cc07e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.200+0000 7ff4f0c00640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4cc076300 0x7ff4cc0787c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec09e000 tx=0x7ff4d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.201+0000 7ff4f2000640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7ff4cc07c1c0 0x7ff4cc07e5e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.203+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== osd.5 v2:172.21.15.133:6808/2703436583 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4e0036e50 con 0x7ff4cc07c1c0 2024-05-09T05:06:34.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.217+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 --> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff4ec069500 con 0x7ff4cc07c1c0 2024-05-09T05:06:34.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.218+0000 7ff4e9600640 1 -- 172.21.15.100:0/2966063603 <== osd.5 v2:172.21.15.133:6808/2703436583 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff4ec069500 con 0x7ff4cc07c1c0 2024-05-09T05:06:34.219 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:34.220 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:34.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7ff4cc07c1c0 msgr2=0x7ff4cc07e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.133:6808/2703436583,v1:172.21.15.133:6809/2703436583] conn(0x7ff4cc07c1c0 0x7ff4cc07e5e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4cc076300 msgr2=0x7ff4cc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7ff4cc076300 0x7ff4cc0787c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec09e000 tx=0x7ff4d8008040 comp rx=0 tx=0).stop 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 msgr2=0x7ff4ec1f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 --2- 172.21.15.100:0/2966063603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4d4003a00 0x7ff4ec1f7c70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000aa40 tx=0x7ff4ec073140 comp rx=0 tx=0).stop 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f2000640 1 -- 172.21.15.100:0/2966063603 reap_dead start 2024-05-09T05:06:34.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 shutdown_connections 2024-05-09T05:06:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.219+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 >> 172.21.15.100:0/2966063603 conn(0x7ff4ec0b2c20 msgr2=0x7ff4ec0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.220+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 shutdown_connections 2024-05-09T05:06:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.220+0000 7ff4f4000640 1 -- 172.21.15.100:0/2966063603 wait complete. 2024-05-09T05:06:34.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-09T05:06:34.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.436+0000 7f9eef600640 1 Processor -- start 2024-05-09T05:06:34.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.437+0000 7f9eef600640 1 -- start start 2024-05-09T05:06:34.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.438+0000 7f9eef600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ee806fcc0 0x7f9ee8168350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.438+0000 7f9eef600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee806e520 con 0x7f9ee80cfa00 2024-05-09T05:06:34.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.438+0000 7f9eef600640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee80cf440 con 0x7f9ee815d5a0 2024-05-09T05:06:34.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.438+0000 7f9eef600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee815d980 con 0x7f9ee806fcc0 2024-05-09T05:06:34.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9edfe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9ee80cfa00 0x7f9ee80cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40744/0 (socket says 172.21.15.100:40744) 2024-05-09T05:06:34.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9edfe00640 1 -- 172.21.15.100:0/309631268 learned_addr learned my addr 172.21.15.100:0/309631268 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9eed600640 1 --2- 172.21.15.100:0/309631268 >> v2:172.21.15.133:3300/0 conn(0x7f9ee806fcc0 0x7f9ee8168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559106476 0 0) 0x7f9ee806e520 con 0x7f9ee80cfa00 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ecc003520 con 0x7f9ee80cfa00 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2975064127 0 0) 0x7f9ecc003520 con 0x7f9ee80cfa00 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 >> v2:172.21.15.133:3300/0 conn(0x7f9ee806fcc0 msgr2=0x7f9ee8168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 --2- 172.21.15.100:0/309631268 >> v2:172.21.15.133:3300/0 conn(0x7f9ee806fcc0 0x7f9ee8168350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 >> v1:172.21.15.133:6789/0 conn(0x7f9ee815d5a0 legacy=0x7f9ee8073f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee80cf720 con 0x7f9ee80cfa00 2024-05-09T05:06:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.439+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f9ed00016f0 con 0x7f9ee80cfa00 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 >> v1:172.21.15.100:6789/0 conn(0x7f9ee80cfa00 legacy=0x7f9ee80cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ecc003a50 0x7f9ecc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc004800 0x7f9ecc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ecc0053c0 0x7f9ecc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee815d980 con 0x7f9ecc003a50 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc00c230 con 0x7f9ecc004800 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9ecc00c430 con 0x7f9ecc0053c0 2024-05-09T05:06:34.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eecc00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ecc003a50 0x7f9ecc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eed600640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ecc0053c0 0x7f9ecc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9edfe00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc004800 0x7f9ecc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eecc00640 1 -- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ecc0053c0 msgr2=0x7f9ecc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eecc00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ecc0053c0 0x7f9ecc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eecc00640 1 -- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc004800 msgr2=0x7f9ecc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eecc00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc004800 0x7f9ecc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eecc00640 1 -- 172.21.15.100:0/309631268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc003520 con 0x7f9ecc003a50 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9edfe00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc004800 0x7f9ecc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.440+0000 7f9eed600640 1 -- 172.21.15.100:0/309631268 reap_dead start 2024-05-09T05:06:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.442+0000 7f9eecc00640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ecc003a50 0x7f9ecc003e70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8001790 tx=0x7f9ecc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9cc43de7bd2602 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.442+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80013b0 con 0x7f9ecc003a50 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.442+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed80052d0 con 0x7f9ecc003a50 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.442+0000 7f9ee7e00640 1 -- 172.21.15.100:0/309631268 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed802aaa0 con 0x7f9ecc003a50 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.442+0000 7f9eef600640 1 -- 172.21.15.100:0/309631268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ecc003a50 msgr2=0x7f9ecc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.442+0000 7f9eef600640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ecc003a50 0x7f9ecc003e70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8001790 tx=0x7f9ecc005830 comp rx=0 tx=0).stop 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.443+0000 7f9eef600640 1 -- 172.21.15.100:0/309631268 shutdown_connections 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.443+0000 7f9eef600640 1 --2- 172.21.15.100:0/309631268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ecc003a50 0x7f9ecc003e70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.443+0000 7f9eef600640 1 -- 172.21.15.100:0/309631268 >> 172.21.15.100:0/309631268 conn(0x7f9ee80b2c90 msgr2=0x7f9ee80b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.443+0000 7f9eef600640 1 -- 172.21.15.100:0/309631268 shutdown_connections 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.443+0000 7f9eef600640 1 -- 172.21.15.100:0/309631268 wait complete. 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.445+0000 7f9eef600640 1 Processor -- start 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.445+0000 7f9eef600640 1 -- start start 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eef600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc003a50 0x7f9ee815f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eef600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 0x7f9ee8158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eef600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ee8155510 0x7f9ee8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eef600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee809ef60 con 0x7f9ee8157f10 2024-05-09T05:06:34.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eef600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee809ede0 con 0x7f9ecc003a50 2024-05-09T05:06:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eef600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee80cfeb0 con 0x7f9ee8155510 2024-05-09T05:06:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 0x7f9ee8158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 0x7f9ee8158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36558/0 (socket says 172.21.15.100:36558) 2024-05-09T05:06:34.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 -- 172.21.15.100:0/993734013 learned_addr learned my addr 172.21.15.100:0/993734013 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9eecc00640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc003a50 0x7f9ee815f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 -- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ee8155510 msgr2=0x7f9ee8155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ee8155510 0x7f9ee8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 -- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc003a50 msgr2=0x7f9ee815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc003a50 0x7f9ee815f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.446+0000 7f9edfe00640 1 -- 172.21.15.100:0/993734013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee8156260 con 0x7f9ee8157f10 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.447+0000 7f9edfe00640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 0x7f9ee8158390 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000d770 tx=0x7f9ed000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.447+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed00072d0 con 0x7f9ee8157f10 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.447+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed0007470 con 0x7f9ee8157f10 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.447+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee8156540 con 0x7f9ee8157f10 2024-05-09T05:06:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.447+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed00049e0 con 0x7f9ee8157f10 2024-05-09T05:06:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.447+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee8156b00 con 0x7f9ee8157f10 2024-05-09T05:06:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.448+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee806a630 con 0x7f9ee8157f10 2024-05-09T05:06:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.449+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ed001b020 con 0x7f9ee8157f10 2024-05-09T05:06:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.450+0000 7f9ee5600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9ec40762d0 0x7f9ec4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.450+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f9ed0096f40 con 0x7f9ee8157f10 2024-05-09T05:06:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.451+0000 7f9eecc00640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9ec40762d0 0x7f9ec4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.451+0000 7f9eecc00640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9ec40762d0 0x7f9ec4078790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8032000 tx=0x7f9ed802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.455+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ed0060ba0 con 0x7f9ee8157f10 2024-05-09T05:06:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.658+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9ee80b08e0 con 0x7f9ec40762d0 2024-05-09T05:06:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.659+0000 7f9ee5600640 1 -- 172.21.15.100:0/993734013 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9ee80b08e0 con 0x7f9ec40762d0 2024-05-09T05:06:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.661+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9ec40762d0 msgr2=0x7f9ec4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.661+0000 7f9eef600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9ec40762d0 0x7f9ec4078790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8032000 tx=0x7f9ed802e000 comp rx=0 tx=0).stop 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.661+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 msgr2=0x7f9ee8158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.661+0000 7f9eef600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 0x7f9ee8158390 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000d770 tx=0x7f9ed000dc30 comp rx=0 tx=0).stop 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 shutdown_connections 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f9ec40762d0 0x7f9ec4078790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ee8155510 0x7f9ee8155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ee8157f10 0x7f9ee8158390 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 --2- 172.21.15.100:0/993734013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ecc003a50 0x7f9ee815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 >> 172.21.15.100:0/993734013 conn(0x7f9ee80b2c90 msgr2=0x7f9ee80aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 shutdown_connections 2024-05-09T05:06:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.662+0000 7f9eef600640 1 -- 172.21.15.100:0/993734013 wait complete. 2024-05-09T05:06:34.680 INFO:tasks.ceph:Scrubbing osd.6 2024-05-09T05:06:34.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:34.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.884+0000 7fa41f200640 1 Processor -- start 2024-05-09T05:06:34.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.885+0000 7fa41f200640 1 -- start start 2024-05-09T05:06:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.886+0000 7fa41f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4200cfb00 0x7fa4200d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.886+0000 7fa41f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4200d2140 0x7fa4200b8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.886+0000 7fa41f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4200d4fd0 con 0x7fa42015f390 2024-05-09T05:06:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.886+0000 7fa41f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa4200d3f30 con 0x7fa4200cfb00 2024-05-09T05:06:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.886+0000 7fa41f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200d4210 con 0x7fa4200d2140 2024-05-09T05:06:34.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.886+0000 7fa41d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4200cfb00 0x7fa4200d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa4200cfb00 0x7fa4200d1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36560/0 (socket says 172.21.15.100:36560) 2024-05-09T05:06:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa42015f390 0x7fa4200d36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40746/0 (socket says 172.21.15.100:40746) 2024-05-09T05:06:34.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41d400640 1 -- 172.21.15.100:0/2375417322 learned_addr learned my addr 172.21.15.100:0/2375417322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:34.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41e800640 1 --2- 172.21.15.100:0/2375417322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4200d2140 0x7fa4200b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41d400640 1 -- 172.21.15.100:0/2375417322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4200d2140 msgr2=0x7fa4200b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41d400640 1 --2- 172.21.15.100:0/2375417322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4200d2140 0x7fa4200b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41d400640 1 -- 172.21.15.100:0/2375417322 >> v1:172.21.15.100:6789/0 conn(0x7fa42015f390 legacy=0x7fa4200d36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41d400640 1 -- 172.21.15.100:0/2375417322 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4200d44f0 con 0x7fa4200cfb00 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.887+0000 7fa41ca00640 1 -- 172.21.15.100:0/2375417322 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665852931 0 0) 0x7fa4200d4fd0 con 0x7fa42015f390 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.888+0000 7fa41d400640 1 --2- 172.21.15.100:0/2375417322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200cfb00 0x7fa4200d1c00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa408009e50 tx=0x7fa40802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d587e30f427bfc80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.888+0000 7fa41ca00640 1 -- 172.21.15.100:0/2375417322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408036070 con 0x7fa4200cfb00 2024-05-09T05:06:34.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.888+0000 7fa41ca00640 1 -- 172.21.15.100:0/2375417322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408031600 con 0x7fa4200cfb00 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.888+0000 7fa41ca00640 1 -- 172.21.15.100:0/2375417322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4080319d0 con 0x7fa4200cfb00 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 -- 172.21.15.100:0/2375417322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200cfb00 msgr2=0x7fa4200d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 --2- 172.21.15.100:0/2375417322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200cfb00 0x7fa4200d1c00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa408009e50 tx=0x7fa40802a710 comp rx=0 tx=0).stop 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 -- 172.21.15.100:0/2375417322 shutdown_connections 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 --2- 172.21.15.100:0/2375417322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4200d2140 0x7fa4200b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 --2- 172.21.15.100:0/2375417322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200cfb00 0x7fa4200d1c00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 -- 172.21.15.100:0/2375417322 >> 172.21.15.100:0/2375417322 conn(0x7fa420074130 msgr2=0x7fa42006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 -- 172.21.15.100:0/2375417322 shutdown_connections 2024-05-09T05:06:34.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.889+0000 7fa41f200640 1 -- 172.21.15.100:0/2375417322 wait complete. 2024-05-09T05:06:34.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.891+0000 7fa41f200640 1 Processor -- start 2024-05-09T05:06:34.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.891+0000 7fa41f200640 1 -- start start 2024-05-09T05:06:34.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200d2140 0x7fa4201545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41f200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa42015f390 0x7fa4200cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41f200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42014b730 0x7fa4200ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa42015f8f0 con 0x7fa4200d2140 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41f200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa42015f770 con 0x7fa42014b730 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41f200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200b8a50 con 0x7fa42015f390 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200d2140 0x7fa4201545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200d2140 0x7fa4201545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36566/0 (socket says 172.21.15.100:36566) 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 -- 172.21.15.100:0/2105531953 learned_addr learned my addr 172.21.15.100:0/2105531953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 -- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa42015f390 msgr2=0x7fa4200cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa42015f390 0x7fa4200cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 -- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42014b730 msgr2=0x7fa4200ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42014b730 0x7fa4200ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.892+0000 7fa41de00640 1 -- 172.21.15.100:0/2105531953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4200cf430 con 0x7fa4200d2140 2024-05-09T05:06:34.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.893+0000 7fa41de00640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200d2140 0x7fa4201545a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa41000c410 tx=0x7fa41000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.893+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4100074e0 con 0x7fa4200d2140 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.893+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4100047e0 con 0x7fa4200d2140 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.893+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410004bd0 con 0x7fa4200d2140 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.893+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4200cd1e0 con 0x7fa4200d2140 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.893+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4200ce8b0 con 0x7fa4200d2140 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.894+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4200ceaf0 con 0x7fa4200d2140 2024-05-09T05:06:34.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.896+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa410011070 con 0x7fa4200d2140 2024-05-09T05:06:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.896+0000 7fa416000640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa3fc0762d0 0x7fa3fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.897+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fa410097720 con 0x7fa4200d2140 2024-05-09T05:06:34.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.897+0000 7fa41d400640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa3fc0762d0 0x7fa3fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.897+0000 7fa416000640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7fa3fc07c190 0x7fa3fc07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.897+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 --> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa41000de50 con 0x7fa3fc07c190 2024-05-09T05:06:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.897+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa410097ad0 con 0x7fa4200d2140 2024-05-09T05:06:34.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.897+0000 7fa41d400640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa3fc0762d0 0x7fa3fc078790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa408033000 tx=0x7fa40802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.898+0000 7fa41e800640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7fa3fc07c190 0x7fa3fc07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:34.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.899+0000 7fa41e800640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7fa3fc07c190 0x7fa3fc07e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:34.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.900+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== osd.6 v2:172.21.15.133:6824/1215001557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa41000de50 con 0x7fa3fc07c190 2024-05-09T05:06:34.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.915+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 --> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa42006a630 con 0x7fa3fc07c190 2024-05-09T05:06:34.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.916+0000 7fa416000640 1 -- 172.21.15.100:0/2105531953 <== osd.6 v2:172.21.15.133:6824/1215001557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa42006a630 con 0x7fa3fc07c190 2024-05-09T05:06:34.917 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:34.917 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:34.917 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7fa3fc07c190 msgr2=0x7fa3fc07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.133:6824/1215001557,v1:172.21.15.133:6825/1215001557] conn(0x7fa3fc07c190 0x7fa3fc07e5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa3fc0762d0 msgr2=0x7fa3fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa3fc0762d0 0x7fa3fc078790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa408033000 tx=0x7fa40802e000 comp rx=0 tx=0).stop 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200d2140 msgr2=0x7fa4201545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 --2- 172.21.15.100:0/2105531953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4200d2140 0x7fa4201545a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa41000c410 tx=0x7fa41000c8d0 comp rx=0 tx=0).stop 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41e800640 1 -- 172.21.15.100:0/2105531953 reap_dead start 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 shutdown_connections 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 >> 172.21.15.100:0/2105531953 conn(0x7fa420074130 msgr2=0x7fa420160300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 shutdown_connections 2024-05-09T05:06:34.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:34.917+0000 7fa41f200640 1 -- 172.21.15.100:0/2105531953 wait complete. 2024-05-09T05:06:34.936 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-09T05:06:35.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.125+0000 7f9092600640 1 Processor -- start 2024-05-09T05:06:35.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.125+0000 7f9092600640 1 -- start start 2024-05-09T05:06:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9092600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 0x7f908c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9092600640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f908c06fca0 0x7f908c15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9092600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f908c160240 con 0x7f908c15d670 2024-05-09T05:06:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9092600640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f908c15ffe0 con 0x7f908c06fca0 2024-05-09T05:06:35.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9092600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f908c160520 con 0x7f908c1599d0 2024-05-09T05:06:35.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f908be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f908c15d670 0x7f908c06f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40748/0 (socket says 172.21.15.100:40748) 2024-05-09T05:06:35.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f908be00640 1 -- 172.21.15.100:0/599519433 learned_addr learned my addr 172.21.15.100:0/599519433 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9091200640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 0x7f908c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628731441 0 0) 0x7f908c160240 con 0x7f908c15d670 2024-05-09T05:06:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9074003520 con 0x7f908c15d670 2024-05-09T05:06:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.127+0000 7f9091c00640 1 --2- 172.21.15.100:0/599519433 >> v2:172.21.15.133:3300/0 conn(0x7f908c06fca0 0x7f908c15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1664151447 0 0) 0x7f9074003520 con 0x7f908c15d670 2024-05-09T05:06:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 msgr2=0x7f908c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 0x7f908c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 >> v2:172.21.15.133:3300/0 conn(0x7f908c06fca0 msgr2=0x7f908c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 --2- 172.21.15.100:0/599519433 >> v2:172.21.15.133:3300/0 conn(0x7f908c06fca0 0x7f908c15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c160800 con 0x7f908c15d670 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f90780016f0 con 0x7f908c15d670 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 >> v1:172.21.15.100:6789/0 conn(0x7f908c15d670 legacy=0x7f908c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9074003a00 0x7f9074003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 0x7f9074004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9074004d40 0x7f90740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f908c15ffe0 con 0x7f9074003a00 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f908c160520 con 0x7f9074004d40 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f907400baf0 con 0x7f908c1599d0 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f9091200640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9074003a00 0x7f9074003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f9091200640 1 -- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 msgr2=0x7f9074004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f9091200640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f908c1599d0 0x7f9074004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.128+0000 7f9091200640 1 -- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9074004d40 msgr2=0x7f90740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.129+0000 7f9091200640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9074004d40 0x7f90740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.129+0000 7f9091200640 1 -- 172.21.15.100:0/599519433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9074003520 con 0x7f9074003a00 2024-05-09T05:06:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.129+0000 7f9091200640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9074003a00 0x7f9074003e20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9080009ac0 tx=0x7f9074005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26bbbdf944a60e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080036070 con 0x7f9074003a00 2024-05-09T05:06:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9080031400 con 0x7f9074003a00 2024-05-09T05:06:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f908b400640 1 -- 172.21.15.100:0/599519433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080009690 con 0x7f9074003a00 2024-05-09T05:06:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9092600640 1 -- 172.21.15.100:0/599519433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9074003a00 msgr2=0x7f9074003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9092600640 1 --2- 172.21.15.100:0/599519433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9074003a00 0x7f9074003e20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9080009ac0 tx=0x7f9074005830 comp rx=0 tx=0).stop 2024-05-09T05:06:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9091c00640 1 -- 172.21.15.100:0/599519433 reap_dead start 2024-05-09T05:06:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9092600640 1 -- 172.21.15.100:0/599519433 shutdown_connections 2024-05-09T05:06:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9092600640 1 -- 172.21.15.100:0/599519433 >> 172.21.15.100:0/599519433 conn(0x7f908c0b29b0 msgr2=0x7f908c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9092600640 1 -- 172.21.15.100:0/599519433 shutdown_connections 2024-05-09T05:06:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.130+0000 7f9092600640 1 -- 172.21.15.100:0/599519433 wait complete. 2024-05-09T05:06:35.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.132+0000 7f9092600640 1 Processor -- start 2024-05-09T05:06:35.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.132+0000 7f9092600640 1 -- start start 2024-05-09T05:06:35.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9092600640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9074003a00 0x7f908c145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9092600640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c145570 0x7f908c0b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9092600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 0x7f908c15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9092600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f908c159f30 con 0x7f908c0b5be0 2024-05-09T05:06:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9092600640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f908c159db0 con 0x7f908c145570 2024-05-09T05:06:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9092600640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f908c15d030 con 0x7f9074003a00 2024-05-09T05:06:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9091c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 0x7f908c15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9091c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 0x7f908c15a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36582/0 (socket says 172.21.15.100:36582) 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.133+0000 7f9091c00640 1 -- 172.21.15.100:0/1622797833 learned_addr learned my addr 172.21.15.100:0/1622797833 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9091c00640 1 -- 172.21.15.100:0/1622797833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9074003a00 msgr2=0x7f908c145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9091c00640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9074003a00 0x7f908c145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9091c00640 1 -- 172.21.15.100:0/1622797833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c145570 msgr2=0x7f908c0b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9091c00640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c145570 0x7f908c0b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9091c00640 1 -- 172.21.15.100:0/1622797833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c148a90 con 0x7f908c0b5be0 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9091c00640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 0x7f908c15a0b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f908c070690 tx=0x7f908400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908400ed30 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9084019070 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084014660 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c1552a0 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.134+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c155860 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.136+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c06a550 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.137+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9084014800 con 0x7f908c0b5be0 2024-05-09T05:06:35.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.137+0000 7f9088c00640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f906c076300 0x7f906c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.138+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f9084097420 con 0x7f908c0b5be0 2024-05-09T05:06:35.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.138+0000 7f9091200640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f906c076300 0x7f906c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.138+0000 7f9091200640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f906c076300 0x7f906c0787c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9080033000 tx=0x7f908002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.142+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9084023020 con 0x7f908c0b5be0 2024-05-09T05:06:35.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.333+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f908c070380 con 0x7f906c076300 2024-05-09T05:06:35.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.334+0000 7f9088c00640 1 -- 172.21.15.100:0/1622797833 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f908c070380 con 0x7f906c076300 2024-05-09T05:06:35.334 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-05-09T05:06:35.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.336+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f906c076300 msgr2=0x7f906c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.336+0000 7f9092600640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f906c076300 0x7f906c0787c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9080033000 tx=0x7f908002e000 comp rx=0 tx=0).stop 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.336+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 msgr2=0x7f908c15a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.336+0000 7f9092600640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 0x7f908c15a0b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f908c070690 tx=0x7f908400e4b0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 shutdown_connections 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f906c076300 0x7f906c0787c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f908c0b5be0 0x7f908c15a0b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c145570 0x7f908c0b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 --2- 172.21.15.100:0/1622797833 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9074003a00 0x7f908c145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 >> 172.21.15.100:0/1622797833 conn(0x7f908c0b29b0 msgr2=0x7f908c15c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:35.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 shutdown_connections 2024-05-09T05:06:35.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.337+0000 7f9092600640 1 -- 172.21.15.100:0/1622797833 wait complete. 2024-05-09T05:06:35.355 INFO:tasks.ceph:Scrubbing osd.7 2024-05-09T05:06:35.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-09T05:06:35.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.558+0000 7f1a3fe00640 1 Processor -- start 2024-05-09T05:06:35.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.559+0000 7f1a3fe00640 1 -- start start 2024-05-09T05:06:35.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.560+0000 7f1a3fe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a400b32a0 0x7f1a40074200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.560+0000 7f1a3fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a40148450 0x7f1a400b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.560+0000 7f1a3fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a40163790 con 0x7f1a40147f10 2024-05-09T05:06:35.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.560+0000 7f1a3fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1a40163a70 con 0x7f1a40148450 2024-05-09T05:06:35.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.560+0000 7f1a3fe00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1a400b40a0 con 0x7f1a400b32a0 2024-05-09T05:06:35.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1a40147f10 0x7f1a400b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40764/0 (socket says 172.21.15.100:40764) 2024-05-09T05:06:35.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3ea00640 1 -- 172.21.15.100:0/3822463125 learned_addr learned my addr 172.21.15.100:0/3822463125 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:35.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3f400640 1 --2- 172.21.15.100:0/3822463125 >> v2:172.21.15.100:3300/0 conn(0x7f1a40148450 0x7f1a400b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a37e00640 1 --2- 172.21.15.100:0/3822463125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a400b32a0 0x7f1a40074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3e000640 1 -- 172.21.15.100:0/3822463125 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224354506 0 0) 0x7f1a40163790 con 0x7f1a40147f10 2024-05-09T05:06:35.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3e000640 1 -- 172.21.15.100:0/3822463125 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a24003520 con 0x7f1a40147f10 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3f400640 1 -- 172.21.15.100:0/3822463125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a400b32a0 msgr2=0x7f1a40074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3f400640 1 --2- 172.21.15.100:0/3822463125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a400b32a0 0x7f1a40074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3f400640 1 -- 172.21.15.100:0/3822463125 >> v1:172.21.15.100:6789/0 conn(0x7f1a40147f10 legacy=0x7f1a400b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.561+0000 7f1a3f400640 1 -- 172.21.15.100:0/3822463125 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a400b4380 con 0x7f1a40148450 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.562+0000 7f1a3f400640 1 --2- 172.21.15.100:0/3822463125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a40148450 0x7f1a400b5fa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009d90 tx=0x7f1a3802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a773c526255c27f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3e000640 1 -- 172.21.15.100:0/3822463125 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38007740 con 0x7f1a40148450 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3e000640 1 -- 172.21.15.100:0/3822463125 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a380078e0 con 0x7f1a40148450 2024-05-09T05:06:35.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3e000640 1 -- 172.21.15.100:0/3822463125 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38007cb0 con 0x7f1a40148450 2024-05-09T05:06:35.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3fe00640 1 -- 172.21.15.100:0/3822463125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a40148450 msgr2=0x7f1a400b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3fe00640 1 --2- 172.21.15.100:0/3822463125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a40148450 0x7f1a400b5fa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009d90 tx=0x7f1a3802a660 comp rx=0 tx=0).stop 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3fe00640 1 -- 172.21.15.100:0/3822463125 shutdown_connections 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3fe00640 1 --2- 172.21.15.100:0/3822463125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a40148450 0x7f1a400b5fa0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3fe00640 1 --2- 172.21.15.100:0/3822463125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a400b32a0 0x7f1a40074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.563+0000 7f1a3fe00640 1 -- 172.21.15.100:0/3822463125 >> 172.21.15.100:0/3822463125 conn(0x7f1a4006c3d0 msgr2=0x7f1a4006c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.564+0000 7f1a3fe00640 1 -- 172.21.15.100:0/3822463125 shutdown_connections 2024-05-09T05:06:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.564+0000 7f1a3fe00640 1 -- 172.21.15.100:0/3822463125 wait complete. 2024-05-09T05:06:35.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.565+0000 7f1a3fe00640 1 Processor -- start 2024-05-09T05:06:35.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.565+0000 7f1a3fe00640 1 -- start start 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.566+0000 7f1a3fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a400b32a0 0x7f1a4015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.566+0000 7f1a3fe00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a40147f10 0x7f1a401e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.566+0000 7f1a3fe00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a40148450 0x7f1a40144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.566+0000 7f1a3fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a400b47e0 con 0x7f1a400b32a0 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.566+0000 7f1a3fe00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f1a400b4660 con 0x7f1a40147f10 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.566+0000 7f1a3fe00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f1a400b64e0 con 0x7f1a40148450 2024-05-09T05:06:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a400b32a0 0x7f1a4015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a400b32a0 0x7f1a4015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36606/0 (socket says 172.21.15.100:36606) 2024-05-09T05:06:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 -- 172.21.15.100:0/2264679167 learned_addr learned my addr 172.21.15.100:0/2264679167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 -- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a40148450 msgr2=0x7f1a40144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a40148450 0x7f1a40144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 -- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a40147f10 msgr2=0x7f1a401e8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a40147f10 0x7f1a401e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.567+0000 7f1a3ea00640 1 -- 172.21.15.100:0/2264679167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a401f9260 con 0x7f1a400b32a0 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.568+0000 7f1a3ea00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a400b32a0 0x7f1a4015aab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000c530 tx=0x7f1a3000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.568+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30017070 con 0x7f1a400b32a0 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.568+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a30005da0 con 0x7f1a400b32a0 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.568+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30007270 con 0x7f1a400b32a0 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.568+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a40143f20 con 0x7f1a400b32a0 2024-05-09T05:06:35.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.568+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4015e9b0 con 0x7f1a400b32a0 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.569+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a4006a630 con 0x7f1a400b32a0 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.570+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a3001a070 con 0x7f1a400b32a0 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.571+0000 7f1a37400640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1a1c0762d0 0x7f1a1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.571+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f1a300964f0 con 0x7f1a400b32a0 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.571+0000 7f1a37e00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1a1c0762d0 0x7f1a1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.571+0000 7f1a37400640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1a1c07c190 0x7f1a1c07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.572+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 --> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a3001be50 con 0x7f1a1c07c190 2024-05-09T05:06:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.572+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f1a3009d050 con 0x7f1a400b32a0 2024-05-09T05:06:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.572+0000 7f1a37e00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1a1c0762d0 0x7f1a1c078790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1a28006fd0 tx=0x7f1a28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.572+0000 7f1a3f400640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1a1c07c190 0x7f1a1c07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.573+0000 7f1a3f400640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1a1c07c190 0x7f1a1c07e5b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.575+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== osd.7 v2:172.21.15.133:6813/1847228632 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a3001be50 con 0x7f1a1c07c190 2024-05-09T05:06:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.590+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 --> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1a401475b0 con 0x7f1a1c07c190 2024-05-09T05:06:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.591+0000 7f1a37400640 1 -- 172.21.15.100:0/2264679167 <== osd.7 v2:172.21.15.133:6813/1847228632 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1a401475b0 con 0x7f1a1c07c190 2024-05-09T05:06:35.592 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:06:35.592 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-09T05:06:35.592 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:06:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1a1c07c190 msgr2=0x7f1a1c07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.133:6813/1847228632,v1:172.21.15.133:6815/1847228632] conn(0x7f1a1c07c190 0x7f1a1c07e5b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1a1c0762d0 msgr2=0x7f1a1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f1a1c0762d0 0x7f1a1c078790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1a28006fd0 tx=0x7f1a28008040 comp rx=0 tx=0).stop 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a400b32a0 msgr2=0x7f1a4015aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 --2- 172.21.15.100:0/2264679167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a400b32a0 0x7f1a4015aab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000c530 tx=0x7f1a3000c9f0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3f400640 1 -- 172.21.15.100:0/2264679167 reap_dead start 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 shutdown_connections 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 >> 172.21.15.100:0/2264679167 conn(0x7f1a4006c3d0 msgr2=0x7f1a4006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 shutdown_connections 2024-05-09T05:06:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.592+0000 7f1a3fe00640 1 -- 172.21.15.100:0/2264679167 wait complete. 2024-05-09T05:06:35.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-09T05:06:35.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.816+0000 7f5b1ac00640 1 Processor -- start 2024-05-09T05:06:35.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.817+0000 7f5b1ac00640 1 -- start start 2024-05-09T05:06:35.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1ac00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 0x7f5b140d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1ac00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b140d0fe0 0x7f5b140d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b140ce800 con 0x7f5b140d19f0 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1ac00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7f5b140b23a0 con 0x7f5b140d0fe0 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1ac00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5b140ceaa0 con 0x7f5b1415d2e0 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1a200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5b140d19f0 0x7f5b140cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40774/0 (socket says 172.21.15.100:40774) 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.818+0000 7f5b1a200640 1 -- 172.21.15.100:0/2260931965 learned_addr learned my addr 172.21.15.100:0/2260931965 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b18e00640 1 --2- 172.21.15.100:0/2260931965 >> v2:172.21.15.133:3300/0 conn(0x7f5b140d0fe0 0x7f5b140d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b19800640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 0x7f5b140d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226485278 0 0) 0x7f5b140ce800 con 0x7f5b140d19f0 2024-05-09T05:06:35.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5afc003520 con 0x7f5b140d19f0 2024-05-09T05:06:35.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2866449200 0 0) 0x7f5afc003520 con 0x7f5b140d19f0 2024-05-09T05:06:35.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 msgr2=0x7f5b140d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 0x7f5b140d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 >> v2:172.21.15.133:3300/0 conn(0x7f5b140d0fe0 msgr2=0x7f5b140d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 --2- 172.21.15.100:0/2260931965 >> v2:172.21.15.133:3300/0 conn(0x7f5b140d0fe0 0x7f5b140d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b140ced80 con 0x7f5b140d19f0 2024-05-09T05:06:35.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7f5b0c001a70 con 0x7f5b140d19f0 2024-05-09T05:06:35.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 >> v1:172.21.15.100:6789/0 conn(0x7f5b140d19f0 legacy=0x7f5b140cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 0x7f5afc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.819+0000 7f5b13e00640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5afc003fd0 0x7f5afc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b13e00640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5afc004d40 0x7f5afc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b140b23a0 con 0x7f5afc004d40 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5b140ceaa0 con 0x7f5afc003fd0 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5afc00ba10 con 0x7f5b1415d2e0 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5afc004d40 0x7f5afc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b18e00640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5afc003fd0 0x7f5afc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b19800640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 0x7f5afc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b1a200640 1 -- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 msgr2=0x7f5afc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b1415d2e0 0x7f5afc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b1a200640 1 -- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5afc003fd0 msgr2=0x7f5afc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5afc003fd0 0x7f5afc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.820+0000 7f5b1a200640 1 -- 172.21.15.100:0/2260931965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc003520 con 0x7f5afc004d40 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.821+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5afc004d40 0x7f5afc0051c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00a8d0 tx=0x7f5afc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d833c4e8fcdf6e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00a4c0 con 0x7f5afc004d40 2024-05-09T05:06:35.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c02f070 con 0x7f5afc004d40 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b13e00640 1 -- 172.21.15.100:0/2260931965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c02bc90 con 0x7f5afc004d40 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2260931965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5afc004d40 msgr2=0x7f5afc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2260931965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5afc004d40 0x7f5afc0051c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00a8d0 tx=0x7f5afc005830 comp rx=0 tx=0).stop 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b1a200640 1 -- 172.21.15.100:0/2260931965 reap_dead start 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2260931965 shutdown_connections 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.822+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2260931965 >> 172.21.15.100:0/2260931965 conn(0x7f5b140d2ed0 msgr2=0x7f5b140d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.823+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2260931965 shutdown_connections 2024-05-09T05:06:35.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.823+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2260931965 wait complete. 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.824+0000 7f5b1ac00640 1 Processor -- start 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.824+0000 7f5b1ac00640 1 -- start start 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.825+0000 7f5b1ac00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5afc004d40 0x7f5b140b8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.825+0000 7f5b1ac00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b140b5a60 0x7f5b140b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.825+0000 7f5b1ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 0x7f5b1414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.825+0000 7f5b1ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1415d6c0 con 0x7f5b1414aa00 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.825+0000 7f5b1ac00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f5b140ce4f0 con 0x7f5b140b5a60 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.825+0000 7f5b1ac00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f5b140b3b20 con 0x7f5afc004d40 2024-05-09T05:06:35.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 0x7f5b1414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 0x7f5b1414ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36620/0 (socket says 172.21.15.100:36620) 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 -- 172.21.15.100:0/2101116714 learned_addr learned my addr 172.21.15.100:0/2101116714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b18e00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b140b5a60 0x7f5b140b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b19800640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5afc004d40 0x7f5b140b8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 -- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5afc004d40 msgr2=0x7f5b140b8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5afc004d40 0x7f5b140b8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 -- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b140b5a60 msgr2=0x7f5b140b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:35.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b140b5a60 0x7f5b140b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 -- 172.21.15.100:0/2101116714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b1415e170 con 0x7f5b1414aa00 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b19800640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5afc004d40 0x7f5b140b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b18e00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b140b5a60 0x7f5b140b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.826+0000 7f5b1a200640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 0x7f5b1414ae80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c02b500 tx=0x7f5b0c001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.827+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c044070 con 0x7f5b1414aa00 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.827+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c034470 con 0x7f5b1414aa00 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.827+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00a4c0 con 0x7f5b1414aa00 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.827+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1415e450 con 0x7f5b1414aa00 2024-05-09T05:06:35.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.827+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1415ea10 con 0x7f5b1414aa00 2024-05-09T05:06:35.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.828+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b1406a550 con 0x7f5b1414aa00 2024-05-09T05:06:35.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.829+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b0c047070 con 0x7f5b1414aa00 2024-05-09T05:06:35.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.830+0000 7f5b11600640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5af40762d0 0x7f5af4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:35.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.830+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f5b0c0b7340 con 0x7f5b1414aa00 2024-05-09T05:06:35.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.830+0000 7f5b19800640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5af40762d0 0x7f5af4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:35.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.831+0000 7f5b19800640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5af40762d0 0x7f5af4078790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009a00 tx=0x7f5b08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:35.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:35.835+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b0c080f00 con 0x7f5b1414aa00 2024-05-09T05:06:36.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.040+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5b140c9810 con 0x7f5af40762d0 2024-05-09T05:06:36.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.041+0000 7f5b11600640 1 -- 172.21.15.100:0/2101116714 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5b140c9810 con 0x7f5af40762d0 2024-05-09T05:06:36.042 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-05-09T05:06:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5af40762d0 msgr2=0x7f5af4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5af40762d0 0x7f5af4078790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009a00 tx=0x7f5b08008040 comp rx=0 tx=0).stop 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 msgr2=0x7f5b1414ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 0x7f5b1414ae80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c02b500 tx=0x7f5b0c001db0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 shutdown_connections 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f5af40762d0 0x7f5af4078790 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b1414aa00 0x7f5b1414ae80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b140b5a60 0x7f5b140b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 --2- 172.21.15.100:0/2101116714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5afc004d40 0x7f5b140b8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.043+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 >> 172.21.15.100:0/2101116714 conn(0x7f5b140d2ed0 msgr2=0x7f5b140cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.044+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 shutdown_connections 2024-05-09T05:06:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.044+0000 7f5b1ac00640 1 -- 172.21.15.100:0/2101116714 wait complete. 2024-05-09T05:06:36.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.255+0000 7f2c1a200640 1 Processor -- start 2024-05-09T05:06:36.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.256+0000 7f2c1a200640 1 -- start start 2024-05-09T05:06:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.257+0000 7f2c1a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c14073cd0 0x7f2c140af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.257+0000 7f2c1a200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1406f390 con 0x7f2c14073840 2024-05-09T05:06:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.257+0000 7f2c1a200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1406e810 con 0x7f2c1406fd60 2024-05-09T05:06:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.257+0000 7f2c1a200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1406eaf0 con 0x7f2c14073cd0 2024-05-09T05:06:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c13e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c14073cd0 0x7f2c140af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c12a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2c14073840 0x7f2c140aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40778/0 (socket says 172.21.15.100:40778) 2024-05-09T05:06:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c12a00640 1 -- 172.21.15.100:0/1509145781 learned_addr learned my addr 172.21.15.100:0/1509145781 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c13e00640 1 -- 172.21.15.100:0/1509145781 >> v1:172.21.15.133:6789/0 conn(0x7f2c1406fd60 legacy=0x7f2c14070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c13e00640 1 -- 172.21.15.100:0/1509145781 >> v1:172.21.15.100:6789/0 conn(0x7f2c14073840 legacy=0x7f2c140aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c12000640 1 -- 172.21.15.100:0/1509145781 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500651037 0 0) 0x7f2c1406f390 con 0x7f2c14073840 2024-05-09T05:06:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.258+0000 7f2c13e00640 1 -- 172.21.15.100:0/1509145781 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1406edd0 con 0x7f2c14073cd0 2024-05-09T05:06:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.259+0000 7f2c13e00640 1 --2- 172.21.15.100:0/1509145781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c14073cd0 0x7f2c140af520 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0097a0 tx=0x7f2c0c02c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444ae15d8ef94a2d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c12000640 1 -- 172.21.15.100:0/1509145781 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c039070 con 0x7f2c14073cd0 2024-05-09T05:06:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c12000640 1 -- 172.21.15.100:0/1509145781 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c034640 con 0x7f2c14073cd0 2024-05-09T05:06:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c12000640 1 -- 172.21.15.100:0/1509145781 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c034a10 con 0x7f2c14073cd0 2024-05-09T05:06:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 -- 172.21.15.100:0/1509145781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c14073cd0 msgr2=0x7f2c140af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 --2- 172.21.15.100:0/1509145781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c14073cd0 0x7f2c140af520 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0097a0 tx=0x7f2c0c02c390 comp rx=0 tx=0).stop 2024-05-09T05:06:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 -- 172.21.15.100:0/1509145781 shutdown_connections 2024-05-09T05:06:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 --2- 172.21.15.100:0/1509145781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c14073cd0 0x7f2c140af520 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 -- 172.21.15.100:0/1509145781 >> 172.21.15.100:0/1509145781 conn(0x7f2c140b31e0 msgr2=0x7f2c140d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 -- 172.21.15.100:0/1509145781 shutdown_connections 2024-05-09T05:06:36.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.260+0000 7f2c1a200640 1 -- 172.21.15.100:0/1509145781 wait complete. 2024-05-09T05:06:36.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.262+0000 7f2c1a200640 1 Processor -- start 2024-05-09T05:06:36.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.262+0000 7f2c1a200640 1 -- start start 2024-05-09T05:06:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c1a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 0x7f2c14150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c1a200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c14073840 0x7f2c14152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c1a200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c14073cd0 0x7f2c1415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c1a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14159f00 con 0x7f2c1406fd60 2024-05-09T05:06:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c1a200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1406e4a0 con 0x7f2c14073840 2024-05-09T05:06:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c1a200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140d04f0 con 0x7f2c14073cd0 2024-05-09T05:06:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c13400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 0x7f2c14150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c13400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 0x7f2c14150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36638/0 (socket says 172.21.15.100:36638) 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.263+0000 7f2c13400640 1 -- 172.21.15.100:0/3249798917 learned_addr learned my addr 172.21.15.100:0/3249798917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c12a00640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c14073840 0x7f2c14152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c13400640 1 -- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c14073cd0 msgr2=0x7f2c1415a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c13400640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c14073cd0 0x7f2c1415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c13400640 1 -- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c14073840 msgr2=0x7f2c14152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c13400640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c14073840 0x7f2c14152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c13400640 1 -- 172.21.15.100:0/3249798917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c14152b50 con 0x7f2c1406fd60 2024-05-09T05:06:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c13400640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 0x7f2c14150330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c490 tx=0x7f2c0400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:36.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04011790 con 0x7f2c1406fd60 2024-05-09T05:06:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04017070 con 0x7f2c1406fd60 2024-05-09T05:06:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c14152df0 con 0x7f2c1406fd60 2024-05-09T05:06:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.264+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04011b70 con 0x7f2c1406fd60 2024-05-09T05:06:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.265+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c14151800 con 0x7f2c1406fd60 2024-05-09T05:06:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.266+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c14076070 con 0x7f2c1406fd60 2024-05-09T05:06:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.267+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c04011d10 con 0x7f2c1406fd60 2024-05-09T05:06:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.268+0000 7f2c0b400640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf00762d0 0x7f2bf0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.268+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f2c04096fb0 con 0x7f2c1406fd60 2024-05-09T05:06:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.269+0000 7f2c12a00640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf00762d0 0x7f2bf0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.269+0000 7f2c12a00640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf00762d0 0x7f2bf0078790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005fd0 tx=0x7f2bfc007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.273+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c04021020 con 0x7f2c1406fd60 2024-05-09T05:06:36.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.475+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c140b5f30 con 0x7f2bf00762d0 2024-05-09T05:06:36.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.477+0000 7f2c0b400640 1 -- 172.21.15.100:0/3249798917 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13340 (secure 0 0 0) 0x7f2c140b5f30 con 0x7f2bf00762d0 2024-05-09T05:06:36.478 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:36.478 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:36.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf00762d0 msgr2=0x7f2bf0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf00762d0 0x7f2bf0078790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005fd0 tx=0x7f2bfc007ed0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 msgr2=0x7f2c14150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 0x7f2c14150330 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c490 tx=0x7f2c0400c950 comp rx=0 tx=0).stop 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 shutdown_connections 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7f2bf00762d0 0x7f2bf0078790 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2c14073cd0 0x7f2c1415a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c14073840 0x7f2c14152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 --2- 172.21.15.100:0/3249798917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406fd60 0x7f2c14150330 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:36.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 >> 172.21.15.100:0/3249798917 conn(0x7f2c140b31e0 msgr2=0x7f2c14154900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:36.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 shutdown_connections 2024-05-09T05:06:36.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:36.480+0000 7f2c1a200640 1 -- 172.21.15.100:0/3249798917 wait complete. 2024-05-09T05:06:36.500 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-05-09T05:06:35.920891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252196,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722524,"statfs":{"total":773094113280,"available":772835864576,"internally_reserved":0,"allocated":7053312,"data_stored":3703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.905850"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":188,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-09T05:06:25.469197+0000","last_change":"2024-05-09T05:04:13.728141+0000","last_active":"2024-05-09T05:06:25.469197+0000","last_peered":"2024-05-09T05:06:25.469197+0000","last_clean":"2024-05-09T05:06:25.469197+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:25.469197+0000","last_undegraded":"2024-05-09T05:06:25.469197+0000","last_fullsized":"2024-05-09T05:06:25.469197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:04:12.105646+0000","last_clean_scrub_stamp":"2024-05-09T05:04:12.105646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:39:35.426915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:36.502 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-09T05:04:12.105646+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=130, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=9, tm_hour=5, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=130, tm_isdst=0) 2024-05-09T05:06:36.503 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-09T05:06:41.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:06:41.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:06:56.503 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T05:06:56.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.714+0000 7fa498200640 1 Processor -- start 2024-05-09T05:06:56.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.714+0000 7fa498200640 1 -- start start 2024-05-09T05:06:56.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.715+0000 7fa498200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa490073840 0x7fa490073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa498200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4900aee10 0x7fa4900af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa498200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49006f390 con 0x7fa49006fd60 2024-05-09T05:06:56.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa498200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fa49006e810 con 0x7fa4900aee10 2024-05-09T05:06:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa498200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa49006eaf0 con 0x7fa490073840 2024-05-09T05:06:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa495800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa49006fd60 0x7fa490070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39266/0 (socket says 172.21.15.100:39266) 2024-05-09T05:06:56.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa495800640 1 -- 172.21.15.100:0/3697823827 learned_addr learned my addr 172.21.15.100:0/3697823827 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-05-09T05:06:56.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa496200640 1 --2- 172.21.15.100:0/3697823827 >> v2:172.21.15.133:3300/0 conn(0x7fa4900aee10 0x7fa4900af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283521433 0 0) 0x7fa49006f390 con 0x7fa49006fd60 2024-05-09T05:06:56.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.716+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa478003520 con 0x7fa49006fd60 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa494e00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa490073840 0x7fa490073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 778623815 0 0) 0x7fa478003520 con 0x7fa49006fd60 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa490073840 msgr2=0x7fa490073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa490073840 0x7fa490073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 >> v2:172.21.15.133:3300/0 conn(0x7fa4900aee10 msgr2=0x7fa4900af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 --2- 172.21.15.100:0/3697823827 >> v2:172.21.15.133:3300/0 conn(0x7fa4900aee10 0x7fa4900af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49006edd0 con 0x7fa49006fd60 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4163300121 0 0) 0x7fa4840016f0 con 0x7fa49006fd60 2024-05-09T05:06:56.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 >> v1:172.21.15.100:6789/0 conn(0x7fa49006fd60 legacy=0x7fa490070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa478003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa478004800 0x7fa478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4780051c0 0x7fa47800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa49006e810 con 0x7fa478003a50 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa49006eaf0 con 0x7fa478004800 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa47800e240 con 0x7fa4780051c0 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa494e00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa490073840 0x7fa490073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.717+0000 7fa495800640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa478003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa496200640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4780051c0 0x7fa47800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa494e00640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa478004800 0x7fa478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa495800640 1 -- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4780051c0 msgr2=0x7fa47800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa495800640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4780051c0 0x7fa47800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa495800640 1 -- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa478004800 msgr2=0x7fa478004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa495800640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa478004800 0x7fa478004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.718+0000 7fa495800640 1 -- 172.21.15.100:0/3697823827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa478003520 con 0x7fa478003a50 2024-05-09T05:06:56.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.719+0000 7fa495800640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa478003e70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c190 tx=0x7fa478005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf95ee3b3a427379 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.719+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484007cc0 con 0x7fa478003a50 2024-05-09T05:06:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.719+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484005ad0 con 0x7fa478003a50 2024-05-09T05:06:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.719+0000 7fa48fe00640 1 -- 172.21.15.100:0/3697823827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484007070 con 0x7fa478003a50 2024-05-09T05:06:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa498200640 1 -- 172.21.15.100:0/3697823827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 msgr2=0x7fa478003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:56.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa498200640 1 --2- 172.21.15.100:0/3697823827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa478003e70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa48400c190 tx=0x7fa478005830 comp rx=0 tx=0).stop 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa496200640 1 -- 172.21.15.100:0/3697823827 reap_dead start 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa498200640 1 -- 172.21.15.100:0/3697823827 shutdown_connections 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa498200640 1 -- 172.21.15.100:0/3697823827 >> 172.21.15.100:0/3697823827 conn(0x7fa4900b31e0 msgr2=0x7fa4900d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa498200640 1 -- 172.21.15.100:0/3697823827 shutdown_connections 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.720+0000 7fa498200640 1 -- 172.21.15.100:0/3697823827 wait complete. 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.722+0000 7fa498200640 1 Processor -- start 2024-05-09T05:06:56.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.722+0000 7fa498200640 1 -- start start 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa498200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa4900cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa498200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4900ce6e0 0x7fa490155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa498200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa49009d140 0x7fa4901f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa498200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa490159f00 con 0x7fa478003a50 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa498200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa49006e4a0 con 0x7fa4900ce6e0 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa498200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa4900ce250 con 0x7fa49009d140 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa495800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa4900cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa495800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa4900cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58022/0 (socket says 172.21.15.100:58022) 2024-05-09T05:06:56.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.723+0000 7fa495800640 1 -- 172.21.15.100:0/2468282180 learned_addr learned my addr 172.21.15.100:0/2468282180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa496200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa49009d140 0x7fa4901f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa495800640 1 -- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa49009d140 msgr2=0x7fa4901f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa495800640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa49009d140 0x7fa4901f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa495800640 1 -- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4900ce6e0 msgr2=0x7fa490155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa495800640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4900ce6e0 0x7fa490155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa495800640 1 -- 172.21.15.100:0/2468282180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4900cf3d0 con 0x7fa478003a50 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa496200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa49009d140 0x7fa4901f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:56.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa495800640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa4900cfc10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa48402ac70 tx=0x7fa484001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:56.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484041030 con 0x7fa478003a50 2024-05-09T05:06:56.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484038040 con 0x7fa478003a50 2024-05-09T05:06:56.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa490156310 con 0x7fa478003a50 2024-05-09T05:06:56.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840016c0 con 0x7fa478003a50 2024-05-09T05:06:56.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.724+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4900cdc00 con 0x7fa478003a50 2024-05-09T05:06:56.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.726+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490076070 con 0x7fa478003a50 2024-05-09T05:06:56.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.727+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa484044070 con 0x7fa478003a50 2024-05-09T05:06:56.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.727+0000 7fa48d600640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa470076300 0x7fa4700787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:56.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.728+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fa4840b7540 con 0x7fa478003a50 2024-05-09T05:06:56.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.728+0000 7fa494e00640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa470076300 0x7fa4700787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:56.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.729+0000 7fa494e00640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa470076300 0x7fa4700787c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa49009e7b0 tx=0x7fa47c00c2d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:56.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.733+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa484081110 con 0x7fa478003a50 2024-05-09T05:06:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.936+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 --> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa49006a5c0 con 0x7fa470076300 2024-05-09T05:06:56.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.937+0000 7fa48d600640 1 -- 172.21.15.100:0/2468282180 <== mgr.4107 v2:172.21.15.100:6832/1219178136 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13344 (secure 0 0 0) 0x7fa49006a5c0 con 0x7fa470076300 2024-05-09T05:06:56.938 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:56.938 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa470076300 msgr2=0x7fa4700787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa470076300 0x7fa4700787c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa49009e7b0 tx=0x7fa47c00c2d0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 msgr2=0x7fa4900cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa4900cfc10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa48402ac70 tx=0x7fa484001930 comp rx=0 tx=0).stop 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 shutdown_connections 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa470076300 0x7fa4700787c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa49009d140 0x7fa4901f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4900ce6e0 0x7fa490155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 --2- 172.21.15.100:0/2468282180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa478003a50 0x7fa4900cfc10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:56.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 >> 172.21.15.100:0/2468282180 conn(0x7fa4900b31e0 msgr2=0x7fa49015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:56.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 shutdown_connections 2024-05-09T05:06:56.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:56.940+0000 7fa498200640 1 -- 172.21.15.100:0/2468282180 wait complete. 2024-05-09T05:06:56.961 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-05-09T05:06:55.926938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":252180,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722540,"statfs":{"total":773094113280,"available":772835880960,"internally_reserved":0,"allocated":7053312,"data_stored":3703800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003882"},"pg_stats":[{"pgid":"1.0","version":"60'74","reported_seq":199,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-09T05:06:36.507767+0000","last_change":"2024-05-09T05:06:36.507951+0000","last_active":"2024-05-09T05:06:36.507767+0000","last_peered":"2024-05-09T05:06:36.507767+0000","last_clean":"2024-05-09T05:06:36.507767+0000","last_became_active":"2024-05-09T05:04:13.725029+0000","last_became_peered":"2024-05-09T05:04:13.725029+0000","last_unstale":"2024-05-09T05:06:36.507767+0000","last_undegraded":"2024-05-09T05:06:36.507767+0000","last_fullsized":"2024-05-09T05:06:36.507767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'74","last_scrub_stamp":"2024-05-09T05:06:36.507506+0000","last_deep_scrub":"60'74","last_deep_scrub_stamp":"2024-05-09T05:06:36.507506+0000","last_clean_scrub_stamp":"2024-05-09T05:06:36.507506+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:08.114004+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":315383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1327104,"data_stored":905751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:06:56.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-09T05:06:57.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.145+0000 7fa56b200640 1 Processor -- start 2024-05-09T05:06:57.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.145+0000 7fa56b200640 1 -- start start 2024-05-09T05:06:57.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56b200640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa56c0d22c0 0x7fa56c0d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56b200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa56c0d5cc0 0x7fa56c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56b200640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56c1630d0 con 0x7fa56c162cf0 2024-05-09T05:06:57.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56b200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c0d0fb0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56b200640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fa56c0d44c0 con 0x7fa56c0d22c0 2024-05-09T05:06:57.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa56c0d5cc0 0x7fa56c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa56c0d5cc0 0x7fa56c0c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58038/0 (socket says 172.21.15.100:58038) 2024-05-09T05:06:57.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56a800640 1 -- 172.21.15.100:0/1273325749 learned_addr learned my addr 172.21.15.100:0/1273325749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:57.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56a800640 1 -- 172.21.15.100:0/1273325749 >> v2:172.21.15.133:3300/0 conn(0x7fa56c0d22c0 msgr2=0x7fa56c0d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:57.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56a800640 1 --2- 172.21.15.100:0/1273325749 >> v2:172.21.15.133:3300/0 conn(0x7fa56c0d22c0 0x7fa56c0d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.147+0000 7fa56a800640 1 -- 172.21.15.100:0/1273325749 >> v1:172.21.15.133:6789/0 conn(0x7fa56c162cf0 legacy=0x7fa56c0d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:57.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.148+0000 7fa56a800640 1 -- 172.21.15.100:0/1273325749 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c0d41e0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.148+0000 7fa56a800640 1 --2- 172.21.15.100:0/1273325749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0c8cf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0d2b90 tx=0x7fa56402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8f376716dbd82 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.149+0000 7fa568a00640 1 -- 172.21.15.100:0/1273325749 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564037070 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.149+0000 7fa568a00640 1 -- 172.21.15.100:0/1273325749 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa564032440 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.149+0000 7fa568a00640 1 -- 172.21.15.100:0/1273325749 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564032810 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.149+0000 7fa56b200640 1 -- 172.21.15.100:0/1273325749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 msgr2=0x7fa56c0c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.149+0000 7fa56b200640 1 --2- 172.21.15.100:0/1273325749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0c8cf0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0d2b90 tx=0x7fa56402a1e0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.150+0000 7fa56b200640 1 -- 172.21.15.100:0/1273325749 shutdown_connections 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.150+0000 7fa56b200640 1 --2- 172.21.15.100:0/1273325749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0c8cf0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.150+0000 7fa56b200640 1 --2- 172.21.15.100:0/1273325749 >> v2:172.21.15.133:3300/0 conn(0x7fa56c0d22c0 0x7fa56c0d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.150+0000 7fa56b200640 1 -- 172.21.15.100:0/1273325749 >> 172.21.15.100:0/1273325749 conn(0x7fa56c0d51a0 msgr2=0x7fa56c0d55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.150+0000 7fa56b200640 1 -- 172.21.15.100:0/1273325749 shutdown_connections 2024-05-09T05:06:57.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.150+0000 7fa56b200640 1 -- 172.21.15.100:0/1273325749 wait complete. 2024-05-09T05:06:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.151+0000 7fa56b200640 1 Processor -- start 2024-05-09T05:06:57.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.151+0000 7fa56b200640 1 -- start start 2024-05-09T05:06:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.152+0000 7fa56b200640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa56c0d22c0 0x7fa56c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.152+0000 7fa56b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.152+0000 7fa56b200640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c162cf0 0x7fa56c0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.152+0000 7fa56b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c0b6440 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.152+0000 7fa56b200640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c0d3f90 con 0x7fa56c162cf0 2024-05-09T05:06:57.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.152+0000 7fa56b200640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fa56c0b65c0 con 0x7fa56c0d22c0 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58054/0 (socket says 172.21.15.100:58054) 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 -- 172.21.15.100:0/2789033814 learned_addr learned my addr 172.21.15.100:0/2789033814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 -- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa56c0d22c0 msgr2=0x7fa56c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa56c0d22c0 0x7fa56c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa56a800640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c162cf0 0x7fa56c0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 -- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c162cf0 msgr2=0x7fa56c0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c162cf0 0x7fa56c0b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 -- 172.21.15.100:0/2789033814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c0b42d0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.153+0000 7fa569400640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0b3730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b4a0 tx=0x7fa55400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.154+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554014070 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.154+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa554010610 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.154+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554010a00 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.154+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c0b45b0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.154+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c0b7960 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.155+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56c0699e0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.156+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa554017070 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.157+0000 7fa562000640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa5480762d0 0x7fa548078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.157+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fa554096e10 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.157+0000 7fa569e00640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa5480762d0 0x7fa548078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.158+0000 7fa569e00640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa5480762d0 0x7fa548078790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00ab90 tx=0x7fa55c009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.166+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa55409a030 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.370+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa56c06a550 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.377+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7fa5540609d0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.380+0000 7fa562000640 1 -- 172.21.15.100:0/2789033814 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa55405fde0 con 0x7fa56c0d5cc0 2024-05-09T05:06:57.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa5480762d0 msgr2=0x7fa548078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa5480762d0 0x7fa548078790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00ab90 tx=0x7fa55c009230 comp rx=0 tx=0).stop 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 msgr2=0x7fa56c0b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0b3730 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b4a0 tx=0x7fa55400b960 comp rx=0 tx=0).stop 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 shutdown_connections 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fa5480762d0 0x7fa548078790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa56c162cf0 0x7fa56c0b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa56c0d5cc0 0x7fa56c0b3730 secure :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa55400b4a0 tx=0x7fa55400b960 comp rx=0 tx=0).stop 2024-05-09T05:06:57.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 --2- 172.21.15.100:0/2789033814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa56c0d22c0 0x7fa56c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 >> 172.21.15.100:0/2789033814 conn(0x7fa56c0d51a0 msgr2=0x7fa56c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:57.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 shutdown_connections 2024-05-09T05:06:57.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.382+0000 7fa56b200640 1 -- 172.21.15.100:0/2789033814 wait complete. 2024-05-09T05:06:57.401 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T05:06:57.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T05:06:57.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.576+0000 7fbb8be00640 1 Processor -- start 2024-05-09T05:06:57.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.576+0000 7fbb8be00640 1 -- start start 2024-05-09T05:06:57.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.577+0000 7fbb8be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb8c143710 0x7fbb8c161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.577+0000 7fbb8be00640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb8c0ce330 0x7fbb8c15db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c143af0 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c160ce0 con 0x7fbb8c143710 2024-05-09T05:06:57.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8be00640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c161c70 con 0x7fbb8c0ce330 2024-05-09T05:06:57.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb8c143710 0x7fbb8c161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb8c143710 0x7fbb8c161730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58056/0 (socket says 172.21.15.100:58056) 2024-05-09T05:06:57.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 -- 172.21.15.100:0/142190240 learned_addr learned my addr 172.21.15.100:0/142190240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:57.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb82000640 1 --1- 172.21.15.100:0/142190240 >> v1:172.21.15.100:6789/0 conn(0x7fbb8c15d6c0 0x7fbb8c0cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39278/0 (socket says 172.21.15.100:39278) 2024-05-09T05:06:57.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8b400640 1 --2- 172.21.15.100:0/142190240 >> v2:172.21.15.133:3300/0 conn(0x7fbb8c0ce330 0x7fbb8c15db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 -- 172.21.15.100:0/142190240 >> v2:172.21.15.133:3300/0 conn(0x7fbb8c0ce330 msgr2=0x7fbb8c15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:06:57.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 --2- 172.21.15.100:0/142190240 >> v2:172.21.15.133:3300/0 conn(0x7fbb8c0ce330 0x7fbb8c15db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 -- 172.21.15.100:0/142190240 >> v1:172.21.15.100:6789/0 conn(0x7fbb8c15d6c0 legacy=0x7fbb8c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8a000640 1 -- 172.21.15.100:0/142190240 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092044255 0 0) 0x7fbb8c143af0 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8aa00640 1 -- 172.21.15.100:0/142190240 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c15e240 con 0x7fbb8c143710 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.578+0000 7fbb8b400640 1 --2- 172.21.15.100:0/142190240 >> v2:172.21.15.133:3300/0 conn(0x7fbb8c0ce330 0x7fbb8c15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.579+0000 7fbb8aa00640 1 --2- 172.21.15.100:0/142190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c143710 0x7fbb8c161730 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0d06a0 tx=0x7fbb7c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6400d05852daf042 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8a000640 1 -- 172.21.15.100:0/142190240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c036070 con 0x7fbb8c143710 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8a000640 1 -- 172.21.15.100:0/142190240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbb7c031600 con 0x7fbb8c143710 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8a000640 1 -- 172.21.15.100:0/142190240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c0319f0 con 0x7fbb8c143710 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 -- 172.21.15.100:0/142190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c143710 msgr2=0x7fbb8c161730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 --2- 172.21.15.100:0/142190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c143710 0x7fbb8c161730 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0d06a0 tx=0x7fbb7c02a6a0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 -- 172.21.15.100:0/142190240 shutdown_connections 2024-05-09T05:06:57.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 --2- 172.21.15.100:0/142190240 >> v2:172.21.15.133:3300/0 conn(0x7fbb8c0ce330 0x7fbb8c15db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 --2- 172.21.15.100:0/142190240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c143710 0x7fbb8c161730 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 -- 172.21.15.100:0/142190240 >> 172.21.15.100:0/142190240 conn(0x7fbb8c06c7f0 msgr2=0x7fbb8c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:57.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 -- 172.21.15.100:0/142190240 shutdown_connections 2024-05-09T05:06:57.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.580+0000 7fbb8be00640 1 -- 172.21.15.100:0/142190240 wait complete. 2024-05-09T05:06:57.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.582+0000 7fbb8be00640 1 Processor -- start 2024-05-09T05:06:57.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.582+0000 7fbb8be00640 1 -- start start 2024-05-09T05:06:57.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8c0ce330 0x7fbb8c146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8c143710 0x7fbb8c13a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 0x7fbb8c13d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c161210 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8be00640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c160f30 con 0x7fbb8c143710 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8be00640 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c072490 con 0x7fbb8c0ce330 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 0x7fbb8c13d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 0x7fbb8c13d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58072/0 (socket says 172.21.15.100:58072) 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.583+0000 7fbb8b400640 1 -- 172.21.15.100:0/2904651555 learned_addr learned my addr 172.21.15.100:0/2904651555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8b400640 1 -- 172.21.15.100:0/2904651555 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8c0ce330 msgr2=0x7fbb8c146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8b400640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8c0ce330 0x7fbb8c146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8b400640 1 -- 172.21.15.100:0/2904651555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8c143710 msgr2=0x7fbb8c13a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8b400640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8c143710 0x7fbb8c13a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8b400640 1 -- 172.21.15.100:0/2904651555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c139480 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8b400640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 0x7fbb8c13d9b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c820 tx=0x7fbb8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84015070 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbb84007a30 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c139760 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84007e40 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.584+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c139d20 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.585+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c0740f0 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.587+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb84018070 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.588+0000 7fbb83400640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbb680762d0 0x7fbb68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:06:57.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.588+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fbb84097350 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.588+0000 7fbb8aa00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbb680762d0 0x7fbb68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:06:57.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.588+0000 7fbb8aa00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbb680762d0 0x7fbb68078790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c033000 tx=0x7fbb7c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:06:57.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.592+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbb8c0740f0 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.816+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb8c06a550 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.817+0000 7fbb83400640 1 -- 172.21.15.100:0/2904651555 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3881 (secure 0 0 0) 0x7fbb84060f10 con 0x7fbb8c15d6c0 2024-05-09T05:06:57.818 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:06:57.818 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1171724790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1171724790},{"type":"v1","addr":"172.21.15.100:6835","nonce":1171724790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/2092212467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2092212467},{"type":"v1","addr":"172.21.15.133:6834","nonce":2092212467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":4697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2567018009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2567018009},{"type":"v1","addr":"172.21.15.133:6835","nonce":2567018009}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":4768,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4256546803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4256546803},{"type":"v1","addr":"172.21.15.100:6837","nonce":4256546803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-05-09T05:06:57.819 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 32 2024-05-09T05:06:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbb680762d0 msgr2=0x7fbb68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbb680762d0 0x7fbb68078790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c033000 tx=0x7fbb7c02e000 comp rx=0 tx=0).stop 2024-05-09T05:06:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 msgr2=0x7fbb8c13d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:06:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 0x7fbb8c13d9b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c820 tx=0x7fbb8400cce0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 shutdown_connections 2024-05-09T05:06:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:6832/1219178136,v1:172.21.15.100:6833/1219178136] conn(0x7fbb680762d0 0x7fbb68078790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8c15d6c0 0x7fbb8c13d9b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb8c143710 0x7fbb8c13a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 --2- 172.21.15.100:0/2904651555 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb8c0ce330 0x7fbb8c146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:06:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 >> 172.21.15.100:0/2904651555 conn(0x7fbb8c06c7f0 msgr2=0x7fbb8c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:06:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 shutdown_connections 2024-05-09T05:06:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:06:57.820+0000 7fbb8be00640 1 -- 172.21.15.100:0/2904651555 wait complete. 2024-05-09T05:06:57.840 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-09T05:06:57.840 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-09T05:06:57.840 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-09T05:06:57.841 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:57.856 INFO:tasks.ceph.mds.a:Stopped 2024-05-09T05:06:57.856 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-09T05:06:57.856 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:57.922 INFO:tasks.ceph.mds.c:Stopped 2024-05-09T05:06:57.923 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-09T05:06:57.923 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:57.953 INFO:tasks.ceph.mds.b:Stopped 2024-05-09T05:06:57.953 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-09T05:06:57.953 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.013 INFO:tasks.ceph.mds.d:Stopped 2024-05-09T05:06:58.014 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-09T05:06:58.014 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-09T05:06:58.014 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.068 INFO:tasks.ceph.osd.0:Stopped 2024-05-09T05:06:58.068 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-09T05:06:58.068 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.140 INFO:tasks.ceph.osd.1:Stopped 2024-05-09T05:06:58.140 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-09T05:06:58.141 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.207 INFO:tasks.ceph.osd.2:Stopped 2024-05-09T05:06:58.207 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-09T05:06:58.207 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-05-09T05:06:58.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-05-09T05:06:58.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-09T05:06:58.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-09T05:06:58.276 INFO:tasks.ceph.osd.3:Stopped 2024-05-09T05:06:58.276 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-09T05:06:58.276 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.340 INFO:tasks.ceph.osd.4:Stopped 2024-05-09T05:06:58.340 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-09T05:06:58.341 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.425 INFO:tasks.ceph.osd.5:Stopped 2024-05-09T05:06:58.426 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-09T05:06:58.426 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.498 INFO:tasks.ceph.osd.6:Stopped 2024-05-09T05:06:58.499 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-09T05:06:58.499 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.567 INFO:tasks.ceph.osd.7:Stopped 2024-05-09T05:06:58.568 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-09T05:06:58.568 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-09T05:06:58.568 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:06:58.653 INFO:tasks.ceph.mgr.y:Stopped 2024-05-09T05:06:58.653 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-09T05:06:58.653 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:07:03.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-09T05:07:03.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-05-09T05:07:03.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-05-09T05:07:03.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-09T05:07:03.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-09T05:07:04.755 INFO:tasks.ceph.mgr.x:Stopped 2024-05-09T05:07:04.755 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-09T05:07:04.756 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-09T05:07:04.756 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:07:04.787 INFO:tasks.ceph.mon.a:Stopped 2024-05-09T05:07:04.787 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-09T05:07:04.787 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:07:04.817 INFO:tasks.ceph.mon.b:Stopped 2024-05-09T05:07:04.817 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-09T05:07:04.818 INFO:teuthology.orchestra.run:waiting for 300 2024-05-09T05:07:04.886 INFO:tasks.ceph.mon.c:Stopped 2024-05-09T05:07:04.887 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-09T05:07:04.887 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-09T05:07:04.990 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:07:04.990 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-09T05:07:05.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:07:05.258 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-09T05:07:05.438 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:07:05.438 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-09T05:07:05.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:07:05.573 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-09T05:07:05.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:07:05.734 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-09T05:07:05.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:07:05.959 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-09T05:07:06.090 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:07:06.091 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-09T05:07:06.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:07:06.227 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-09T05:07:06.376 INFO:tasks.ceph:Archiving mon data... 2024-05-09T05:07:06.378 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/data/mon.a.tgz 2024-05-09T05:07:06.378 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-05-09T05:07:06.435 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.nJ6PZkdN71 2024-05-09T05:07:06.435 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nJ6PZkdN71 2024-05-09T05:07:06.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.nJ6PZkdN71 2024-05-09T05:07:06.756 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.nJ6PZkdN71 is 353KB 2024-05-09T05:07:06.862 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.nJ6PZkdN71 2024-05-09T05:07:06.918 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/data/mon.b.tgz 2024-05-09T05:07:06.918 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-05-09T05:07:06.974 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.RcM2Mi4Clz 2024-05-09T05:07:06.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RcM2Mi4Clz 2024-05-09T05:07:07.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.RcM2Mi4Clz 2024-05-09T05:07:07.297 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.RcM2Mi4Clz is 466KB 2024-05-09T05:07:07.404 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.RcM2Mi4Clz 2024-05-09T05:07:07.459 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/data/mon.c.tgz 2024-05-09T05:07:07.460 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-05-09T05:07:07.513 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.sSOWgZbyBL 2024-05-09T05:07:07.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sSOWgZbyBL 2024-05-09T05:07:07.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.sSOWgZbyBL 2024-05-09T05:07:07.841 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.sSOWgZbyBL is 466KB 2024-05-09T05:07:07.949 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.sSOWgZbyBL 2024-05-09T05:07:08.005 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-09T05:07:08.005 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T05:07:08.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-09T05:07:08.154 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T05:07:08.211 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-09T05:07:08.212 INFO:tasks.ceph:Archiving crash dumps... 2024-05-09T05:07:08.213 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/remote/smithi100/crash 2024-05-09T05:07:08.214 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T05:07:08.301 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/remote/smithi133/crash 2024-05-09T05:07:08.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-09T05:07:08.389 INFO:tasks.ceph:Shutting down logrotate 2024-05-09T05:07:08.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:07:08.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-09T05:07:08.516 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T05:07:08.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-09T05:07:08.593 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-09T05:07:08.680 INFO:tasks.ceph:Compressing logs... 2024-05-09T05:07:08.681 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T05:07:08.688 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T05:07:08.767 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51705.log 2024-05-09T05:07:08.768 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2024-05-09T05:07:08.769 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T05:07:08.769 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48927.log 2024-05-09T05:07:08.770 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51705.log.gz 2024-05-09T05:07:08.772 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40528.log 2024-05-09T05:07:08.772 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2024-05-09T05:07:08.773 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45921.log 2024-05-09T05:07:08.773 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48927.log.gz 2024-05-09T05:07:08.773 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T05:07:08.774 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-05-09T05:07:08.774 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T05:07:08.774 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-09T05:07:08.774 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-05-09T05:07:08.778 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T05:07:08.778 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz/var/log/ceph/ceph-osd.7.log: 2024-05-09T05:07:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-09T05:07:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35228.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-09T05:07:08.778 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-05-09T05:07:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35028.log 2024-05-09T05:07:08.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47432.log 2024-05-09T05:07:08.780 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40528.log.gz 2024-05-09T05:07:08.780 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.45921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45921.log.gz 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51537.log 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47432.log.gz 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41564.log 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50116.log 2024-05-09T05:07:08.781 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51537.log.gz 2024-05-09T05:07:08.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2024-05-09T05:07:08.782 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41564.log.gz 2024-05-09T05:07:08.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2024-05-09T05:07:08.782 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50116.log.gz 2024-05-09T05:07:08.782 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48673.log 2024-05-09T05:07:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-09T05:07:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40863.log 87.5% 2024-05-09T05:07:08.786 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2024-05-09T05:07:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41277.log 2024-05-09T05:07:08.786 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.40863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40863.log.gz 2024-05-09T05:07:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34937.log 2024-05-09T05:07:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.3.41277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-09T05:07:08.787 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41277.log.gz 2024-05-09T05:07:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34937.log: gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-mon.c.log -- replaced with /var/log/ceph/ceph-client.admin.34937.log.gz 2024-05-09T05:07:08.787 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-05-09T05:07:08.789 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2024-05-09T05:07:08.789 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45925.log 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48673.log.gz 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51831.log 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.45925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45925.log.gz 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42882.log 2024-05-09T05:07:08.790 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51831.log.gz 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.42882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42882.log.gz 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45373.log 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40753.log 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51789.log 2024-05-09T05:07:08.791 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45373.log.gz 2024-05-09T05:07:08.793 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-09T05:07:08.793 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35108.log 2024-05-09T05:07:08.793 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.35108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34978.log 2024-05-09T05:07:08.793 INFO:teuthology.orchestra.run.smithi133.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-09T05:07:08.794 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35108.log.gz 2024-05-09T05:07:08.794 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40753.log.gz 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51789.log.gz 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51285.log 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41845.log 2024-05-09T05:07:08.797 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2024-05-09T05:07:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35211.log 2024-05-09T05:07:08.798 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51285.log.gz 2024-05-09T05:07:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40572.log 2024-05-09T05:07:08.798 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41845.log.gz 2024-05-09T05:07:08.798 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46003.log 2024-05-09T05:07:08.798 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35211.log.gz 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.34978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40882.log 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35188.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34978.log.gz 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35068.log 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.40882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40882.log.gz 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.35068.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35068.log.gz 2024-05-09T05:07:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-09T05:07:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-09T05:07:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-09T05:07:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41281.log 2024-05-09T05:07:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 2024-05-09T05:07:08.807 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40572.log.gz 2024-05-09T05:07:08.807 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46488.log 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46003.log.gz 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43655.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51747.log 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51579.log 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46488.log.gz 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45415.log 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51747.log.gz 2024-05-09T05:07:08.808 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51579.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51579.log.gz 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48839.log 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45415.log.gz 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51327.log 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48839.log: 85.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40442.log 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48839.log.gz 2024-05-09T05:07:08.809 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2024-05-09T05:07:08.810 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51327.log.gz 2024-05-09T05:07:08.810 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40442.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-09T05:07:08.810 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40442.log.gz 2024-05-09T05:07:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.3.41281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41281.log.gz 2024-05-09T05:07:08.813 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45240.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2024-05-09T05:07:08.813 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2024-05-09T05:07:08.813 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-05-09T05:07:08.813 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42901.log 2024-05-09T05:07:08.813 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-05-09T05:07:08.814 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47493.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-05-09T05:07:08.814 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49455.log 2024-05-09T05:07:08.814 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.42901.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.42901.log.gz 2024-05-09T05:07:08.814 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48120.log 2024-05-09T05:07:08.816 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49455.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49455.log.gz 2024-05-09T05:07:08.816 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2024-05-09T05:07:08.816 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41561.log 2024-05-09T05:07:08.816 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48120.log.gz 2024-05-09T05:07:08.816 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50423.log 2024-05-09T05:07:08.817 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-05-09T05:07:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-05-09T05:07:08.818 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41561.log.gz 2024-05-09T05:07:08.818 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-05-09T05:07:08.818 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50423.log.gz 2024-05-09T05:07:08.819 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43034.log 2024-05-09T05:07:08.820 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-05-09T05:07:08.820 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46212.log 2024-05-09T05:07:08.820 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-05-09T05:07:08.821 INFO:teuthology.orchestra.run.smithi133.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-09T05:07:08.822 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43034.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-09T05:07:08.822 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43034.log.gz 2024-05-09T05:07:08.822 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42181.log 2024-05-09T05:07:08.822 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46212.log.gz 2024-05-09T05:07:08.823 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2024-05-09T05:07:08.825 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42181.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42181.log.gz 2024-05-09T05:07:08.825 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-09T05:07:08.825 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50549.log 2024-05-09T05:07:08.826 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41228.log 2024-05-09T05:07:08.826 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2024-05-09T05:07:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50549.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50549.log.gz 2024-05-09T05:07:08.827 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50030.log 2024-05-09T05:07:08.828 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41228.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.41228.log.gz --verbose 2024-05-09T05:07:08.828 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.46322.log 2024-05-09T05:07:08.829 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49725.log 2024-05-09T05:07:08.829 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50030.log.gz 2024-05-09T05:07:08.830 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46322.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46322.log.gz 2024-05-09T05:07:08.831 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43342.log 2024-05-09T05:07:08.832 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44263.log 2024-05-09T05:07:08.832 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49725.log.gz 2024-05-09T05:07:08.832 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.2.43342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43342.log.gz 2024-05-09T05:07:08.833 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-05-09T05:07:08.834 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 2024-05-09T05:07:08.834 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44263.log.gz 2024-05-09T05:07:08.835 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51663.log 2024-05-09T05:07:08.835 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-05-09T05:07:08.836 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43697.log 2024-05-09T05:07:08.836 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2024-05-09T05:07:08.837 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41850.log 2024-05-09T05:07:08.837 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51663.log.gz 2024-05-09T05:07:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43697.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43697.log.gz 2024-05-09T05:07:08.838 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40795.log 2024-05-09T05:07:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41899.log 2024-05-09T05:07:08.840 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41850.log.gz 2024-05-09T05:07:08.840 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46733.log 2024-05-09T05:07:08.841 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40795.log.gz 2024-05-09T05:07:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41899.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41899.log.gz 2024-05-09T05:07:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47088.log 2024-05-09T05:07:08.842 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47290.log 2024-05-09T05:07:08.843 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.46733.log.gz 2024-05-09T05:07:08.844 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2024-05-09T05:07:08.844 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47088.log.gz 2024-05-09T05:07:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47290.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47290.log.gz 2024-05-09T05:07:08.845 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2024-05-09T05:07:08.846 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52057.log 2024-05-09T05:07:08.846 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-05-09T05:07:08.847 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44431.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-09T05:07:08.847 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2024-05-09T05:07:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52057.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52057.log.gz 2024-05-09T05:07:08.848 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41227.log 2024-05-09T05:07:08.849 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49643.log 2024-05-09T05:07:08.850 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47343.log 2024-05-09T05:07:08.850 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41227.log.gz 2024-05-09T05:07:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.49643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49643.log.gz 2024-05-09T05:07:08.851 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40484.log 2024-05-09T05:07:08.852 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2024-05-09T05:07:08.852 INFO:teuthology.orchestra.run.smithi100.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.47343.log.gz 2024-05-09T05:07:08.853 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47765.log 2024-05-09T05:07:08.853 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40484.log.gz 2024-05-09T05:07:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46113.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-09T05:07:08.855 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2024-05-09T05:07:08.855 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51159.log 2024-05-09T05:07:08.855 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47765.log.gz 2024-05-09T05:07:08.856 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44305.log 2024-05-09T05:07:08.857 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51159.log: gzip 87.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.51159.log.gz -- 2024-05-09T05:07:08.858 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.41214.log 2024-05-09T05:07:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44305.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44305.log.gz 2024-05-09T05:07:08.859 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40921.log 2024-05-09T05:07:08.860 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44491.log 2024-05-09T05:07:08.861 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41214.log.gz/var/log/ceph/ceph-client.admin.40921.log: 2024-05-09T05:07:08.861 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43781.log 2024-05-09T05:07:08.862 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40921.log.gz 2024-05-09T05:07:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44491.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44491.log.gz 2024-05-09T05:07:08.863 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-09T05:07:08.864 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43781.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-09T05:07:08.864 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43781.log.gz 2024-05-09T05:07:08.865 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-05-09T05:07:08.866 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50287.log 2024-05-09T05:07:08.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51495.log 2024-05-09T05:07:08.868 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-05-09T05:07:08.869 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41560.log 2024-05-09T05:07:08.869 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50287.log.gz 2024-05-09T05:07:08.871 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2024-05-09T05:07:08.871 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51495.log.gz 2024-05-09T05:07:08.872 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44137.log 2024-05-09T05:07:08.872 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41560.log.gz 2024-05-09T05:07:08.873 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51621.log 2024-05-09T05:07:08.873 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz 2024-05-09T05:07:08.875 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44137.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-09T05:07:08.875 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44137.log.gz 2024-05-09T05:07:08.875 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-09T05:07:08.876 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41047.log 2024-05-09T05:07:08.876 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51621.log.gz 2024-05-09T05:07:08.877 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41565.log 2024-05-09T05:07:08.879 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41047.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41047.log.gz 2024-05-09T05:07:08.879 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.41565.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45092.log 2024-05-09T05:07:08.880 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41565.log.gz 2024-05-09T05:07:08.882 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45092.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45092.log.gz 2024-05-09T05:07:08.883 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48288.log 2024-05-09T05:07:08.884 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2024-05-09T05:07:08.886 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48288.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48288.log.gz 2024-05-09T05:07:08.887 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41229.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-05-09T05:07:08.888 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-05-09T05:07:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42097.log 2024-05-09T05:07:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47933.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-05-09T05:07:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42097.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42097.log.gz 2024-05-09T05:07:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50759.log 2024-05-09T05:07:08.894 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-09T05:07:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-05-09T05:07:08.895 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50759.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50759.log.gz 2024-05-09T05:07:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2024-05-09T05:07:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44060.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-05-09T05:07:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50801.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2024-05-09T05:07:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-05-09T05:07:08.901 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2024-05-09T05:07:08.902 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44714.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-05-09T05:07:08.903 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48162.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2024-05-09T05:07:08.904 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2024-05-09T05:07:08.905 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-05-09T05:07:08.907 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45050.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2024-05-09T05:07:08.907 INFO:teuthology.orchestra.run.smithi100.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-09T05:07:08.908 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42223.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-05-09T05:07:08.908 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40400.log 2024-05-09T05:07:08.910 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52017.log 2024-05-09T05:07:08.911 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49221.log 2024-05-09T05:07:08.911 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40400.log.gz 2024-05-09T05:07:08.913 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45136.log 2024-05-09T05:07:08.913 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52017.log.gz 2024-05-09T05:07:08.914 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45327.log 2024-05-09T05:07:08.914 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49221.log.gz 2024-05-09T05:07:08.916 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45136.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45136.log.gz 2024-05-09T05:07:08.917 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-05-09T05:07:08.917 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45327.log.gz 2024-05-09T05:07:08.917 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-09T05:07:08.919 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2024-05-09T05:07:08.919 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-05-09T05:07:08.922 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.44840.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48883.log 2024-05-09T05:07:08.923 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2024-05-09T05:07:08.923 INFO:teuthology.orchestra.run.smithi100.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-09T05:07:08.924 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50633.log 2024-05-09T05:07:08.925 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2024-05-09T05:07:08.925 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48883.log.gz 2024-05-09T05:07:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50633.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50633.log.gz 2024-05-09T05:07:08.927 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49095.log 2024-05-09T05:07:08.928 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43338.log 2024-05-09T05:07:08.928 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2024-05-09T05:07:08.930 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5/var/log/ceph/ceph-client.admin.49095.log: --verbose -- /var/log/ceph/ceph-client.admin.34843.log 2024-05-09T05:07:08.931 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4%/var/log/ceph/ceph-client.2.43338.log: -- replaced with /var/log/ceph/ceph-client.admin.49095.log.gz 2024-05-09T05:07:08.931 INFO:teuthology.orchestra.run.smithi100.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43338.log.gz 2024-05-09T05:07:08.932 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47247.log 2024-05-09T05:07:08.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50927.log 2024-05-09T05:07:08.933 INFO:teuthology.orchestra.run.smithi100.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.34843.log.gz 2024-05-09T05:07:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47247.log.gz 2024-05-09T05:07:08.934 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40222.log 2024-05-09T05:07:08.936 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46690.log 2024-05-09T05:07:08.936 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50927.log.gz 2024-05-09T05:07:08.937 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2024-05-09T05:07:08.937 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40222.log.gz 2024-05-09T05:07:08.938 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46690.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46690.log.gz 2024-05-09T05:07:08.939 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2024-05-09T05:07:08.939 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51201.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2024-05-09T05:07:08.940 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-05-09T05:07:08.941 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51369.log 2024-05-09T05:07:08.942 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2024-05-09T05:07:08.942 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41807.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-05-09T05:07:08.944 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51369.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51369.log.gz 2024-05-09T05:07:08.944 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42349.log 2024-05-09T05:07:08.946 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41901.log 2024-05-09T05:07:08.947 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46584.log 2024-05-09T05:07:08.947 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42349.log.gz 2024-05-09T05:07:08.949 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41901.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41901.log.gz 2024-05-09T05:07:08.950 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2024-05-09T05:07:08.950 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46584.log.gz 2024-05-09T05:07:08.951 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51411.log 2024-05-09T05:07:08.953 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46849.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz 2024-05-09T05:07:08.953 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42529.log 2024-05-09T05:07:08.954 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48969.log 2024-05-09T05:07:08.954 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51411.log.gz 2024-05-09T05:07:08.956 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42529.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.48204.log 2024-05-09T05:07:08.956 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42529.log.gz 2024-05-09T05:07:08.957 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42307.log 2024-05-09T05:07:08.957 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48969.log.gz 2024-05-09T05:07:08.958 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43739.log 2024-05-09T05:07:08.959 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48204.log.gz 2024-05-09T05:07:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42307.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42307.log.gz 2024-05-09T05:07:08.960 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41562.log 2024-05-09T05:07:08.961 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43739.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43739.log.gz 2024-05-09T05:07:08.962 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-05-09T05:07:08.963 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43970.log 2024-05-09T05:07:08.963 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41562.log.gz 2024-05-09T05:07:08.964 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44534.log 2024-05-09T05:07:08.964 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 2024-05-09T05:07:08.966 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43970.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43970.log.gz 2024-05-09T05:07:08.967 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.44534.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45625.log 2024-05-09T05:07:08.967 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44534.log.gz 2024-05-09T05:07:08.968 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48372.log 2024-05-09T05:07:08.969 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-05-09T05:07:08.969 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45625.log.gz 2024-05-09T05:07:08.971 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48372.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48372.log.gz 2024-05-09T05:07:08.971 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44347.log 2024-05-09T05:07:08.972 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42265.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-05-09T05:07:08.973 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2024-05-09T05:07:08.974 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41222.log 2024-05-09T05:07:08.974 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44347.log.gz 2024-05-09T05:07:08.975 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48754.log 2024-05-09T05:07:08.975 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gz 2024-05-09T05:07:08.976 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47671.log 2024-05-09T05:07:08.977 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41222.log.gz 2024-05-09T05:07:08.978 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48754.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48754.log.gz 2024-05-09T05:07:08.978 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51957.log 2024-05-09T05:07:08.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47671.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47671.log.gz 2024-05-09T05:07:08.980 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51453.log 2024-05-09T05:07:08.981 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49053.log 2024-05-09T05:07:08.981 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51957.log.gz 2024-05-09T05:07:08.982 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41224.log 2024-05-09T05:07:08.982 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51453.log.gz 2024-05-09T05:07:08.984 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49053.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49053.log.gz 2024-05-09T05:07:08.984 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.50675.log 2024-05-09T05:07:08.985 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41224.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41224.log.gz 2024-05-09T05:07:08.985 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47546.log 2024-05-09T05:07:08.987 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2024-05-09T05:07:08.987 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50675.log.gz 2024-05-09T05:07:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47546.log: gzip -5 --verbose 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47546.log.gz 2024-05-09T05:07:08.989 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.49389.log 2024-05-09T05:07:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47141.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2024-05-09T05:07:08.990 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2024-05-09T05:07:08.992 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-05-09T05:07:08.992 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49389.log.gz 2024-05-09T05:07:08.992 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47807.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz 2024-05-09T05:07:08.993 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2024-05-09T05:07:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41900.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-05-09T05:07:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41542.log 2024-05-09T05:07:08.995 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48330.log 2024-05-09T05:07:08.996 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gz 2024-05-09T05:07:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41542.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41542.log.gz 2024-05-09T05:07:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5/var/log/ceph/ceph-client.admin.48330.log: --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2024-05-09T05:07:08.998 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48330.log.gz 2024-05-09T05:07:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49263.log 2024-05-09T05:07:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51243.log 2024-05-09T05:07:09.001 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2024-05-09T05:07:09.002 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49263.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49263.log.gz 2024-05-09T05:07:09.002 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50885.log 2024-05-09T05:07:09.003 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51243.log.gz 2024-05-09T05:07:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28815.log 2024-05-09T05:07:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45457.log 2024-05-09T05:07:09.005 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50885.log.gz 2024-05-09T05:07:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.28815.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28815.log.gz 2024-05-09T05:07:09.007 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42391.log 2024-05-09T05:07:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45457.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45457.log.gz 2024-05-09T05:07:09.009 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41898.log 2024-05-09T05:07:09.010 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2024-05-09T05:07:09.010 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42391.log.gz 2024-05-09T05:07:09.011 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41898.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41898.log.gz 2024-05-09T05:07:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44389.log 2024-05-09T05:07:09.013 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41226.log 2024-05-09T05:07:09.013 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2024-05-09T05:07:09.013 INFO:teuthology.orchestra.run.smithi133.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-09T05:07:09.014 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49137.log 2024-05-09T05:07:09.014 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44389.log.gz 2024-05-09T05:07:09.016 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35109.log 2024-05-09T05:07:09.016 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41226.log.gz 2024-05-09T05:07:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49137.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49137.log.gz 2024-05-09T05:07:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48498.log 2024-05-09T05:07:09.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35109.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35109.log.gz 2024-05-09T05:07:09.018 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50158.log 2024-05-09T05:07:09.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2024-05-09T05:07:09.020 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48498.log.gz 2024-05-09T05:07:09.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50158.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50158.log.gz 2024-05-09T05:07:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49347.log 2024-05-09T05:07:09.022 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43518.log: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-09T05:07:09.022 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2024-05-09T05:07:09.023 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-09T05:07:09.023 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2024-05-09T05:07:09.024 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50074.log 2024-05-09T05:07:09.025 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49347.log.gz 2024-05-09T05:07:09.025 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40318.log 2024-05-09T05:07:09.026 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2024-05-09T05:07:09.027 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50717.log 2024-05-09T05:07:09.027 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50074.log.gz 2024-05-09T05:07:09.028 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41550.log 2024-05-09T05:07:09.029 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40318.log.gz 2024-05-09T05:07:09.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41218.log 2024-05-09T05:07:09.030 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50717.log.gz 2024-05-09T05:07:09.030 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-09T05:07:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41005.log 2024-05-09T05:07:09.031 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-05-09T05:07:09.032 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-05-09T05:07:09.032 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41218.log.gz 2024-05-09T05:07:09.034 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-05-09T05:07:09.034 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41005.log.gz 2024-05-09T05:07:09.035 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43571.log 2024-05-09T05:07:09.035 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-05-09T05:07:09.036 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48246.log 2024-05-09T05:07:09.036 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-05-09T05:07:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40112.log 2024-05-09T05:07:09.038 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43571.log.gz 2024-05-09T05:07:09.039 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50381.log 2024-05-09T05:07:09.039 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48246.log.gz 2024-05-09T05:07:09.040 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40112.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.40112.log.gz /var/log/ceph/ceph-client.admin.49179.log 2024-05-09T05:07:09.040 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-05-09T05:07:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50381.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-09T05:07:09.041 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50381.log.gz 2024-05-09T05:07:09.043 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44576.log 2024-05-09T05:07:09.043 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49179.log.gz 2024-05-09T05:07:09.044 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52099.log 2024-05-09T05:07:09.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40879.log 2024-05-09T05:07:09.046 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44576.log.gz 2024-05-09T05:07:09.047 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-05-09T05:07:09.047 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52099.log.gz 2024-05-09T05:07:09.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2024-05-09T05:07:09.048 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40879.log.gz 2024-05-09T05:07:09.049 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-09T05:07:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2024-05-09T05:07:09.050 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2024-05-09T05:07:09.051 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2024-05-09T05:07:09.051 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2024-05-09T05:07:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-05-09T05:07:09.053 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-05-09T05:07:09.054 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-05-09T05:07:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m0.314s 2024-05-09T05:07:09.054 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m1.151s 2024-05-09T05:07:09.055 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.204s 2024-05-09T05:07:09.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45541.log 2024-05-09T05:07:09.055 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2024-05-09T05:07:09.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50507.log 2024-05-09T05:07:09.055 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2024-05-09T05:07:09.056 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46891.log 2024-05-09T05:07:09.057 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45541.log.gz 2024-05-09T05:07:09.058 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50507.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48456.log 2024-05-09T05:07:09.058 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50507.log.gz 2024-05-09T05:07:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46992.log 2024-05-09T05:07:09.059 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46891.log.gz 2024-05-09T05:07:09.060 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48456.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48456.log.gz 2024-05-09T05:07:09.061 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2024-05-09T05:07:09.061 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46992.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46992.log.gz 2024-05-09T05:07:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43475.log 2024-05-09T05:07:09.063 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.51873.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44798.log 2024-05-09T05:07:09.064 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2024-05-09T05:07:09.065 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48796.log 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43475.log.gz 2024-05-09T05:07:09.065 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-05-09T05:07:09.066 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44798.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2024-05-09T05:07:09.066 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44221.log 2024-05-09T05:07:09.067 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48796.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48796.log.gz 2024-05-09T05:07:09.068 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49011.log 2024-05-09T05:07:09.068 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2024-05-09T05:07:09.069 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44221.log.gz 2024-05-09T05:07:09.070 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40837.log 2024-05-09T05:07:09.070 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49011.log.gz 2024-05-09T05:07:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51915.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2024-05-09T05:07:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49811.log 2024-05-09T05:07:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49647.log 2024-05-09T05:07:09.073 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40837.log.gz 2024-05-09T05:07:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49964.log 2024-05-09T05:07:09.074 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49811.log.gz 2024-05-09T05:07:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.49647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49647.log.gz 2024-05-09T05:07:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46156.log 2024-05-09T05:07:09.077 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2024-05-09T05:07:09.077 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49964.log.gz 2024-05-09T05:07:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2024-05-09T05:07:09.078 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.46156.log.gz 2024-05-09T05:07:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2024-05-09T05:07:09.080 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2024-05-09T05:07:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46933.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2024-05-09T05:07:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2024-05-09T05:07:09.082 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50843.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2024-05-09T05:07:09.082 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-05-09T05:07:09.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44179.log 2024-05-09T05:07:09.084 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2024-05-09T05:07:09.085 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-05-09T05:07:09.086 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44179.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44179.log.gz 2024-05-09T05:07:09.127 INFO:teuthology.orchestra.run.smithi100.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-09T05:07:09.165 INFO:teuthology.orchestra.run.smithi100.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-09T05:07:09.167 INFO:teuthology.orchestra.run.smithi100.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-09T05:07:09.176 INFO:teuthology.orchestra.run.smithi100.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-09T05:07:09.229 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-09T05:07:09.233 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-05-09T05:07:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.496s 2024-05-09T05:07:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m1.592s 2024-05-09T05:07:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.793s 2024-05-09T05:07:09.234 INFO:tasks.ceph:Archiving logs... 2024-05-09T05:07:09.234 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/remote/smithi100/log 2024-05-09T05:07:09.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T05:07:09.661 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/remote/smithi133/log 2024-05-09T05:07:09.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T05:07:09.918 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T05:07:09.936 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T05:07:09.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T05:07:09.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T05:07:10.088 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T05:07:10.098 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T05:07:10.098 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:07:10.105 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:07:10.152 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:07:10.161 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:07:10.163 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:07:10.163 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-05-09T05:07:10.163 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +2904us[+2905us] +/- 45ms 2024-05-09T05:07:10.164 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -2136us[-2135us] +/- 52ms 2024-05-09T05:07:10.164 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -1931us[-1930us] +/- 71ms 2024-05-09T05:07:10.164 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:07:10.172 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:07:10.172 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-05-09T05:07:10.172 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +2929us[+2938us] +/- 45ms 2024-05-09T05:07:10.172 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 -2136us[-2136us] +/- 52ms 2024-05-09T05:07:10.172 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -1903us[-1903us] +/- 71ms 2024-05-09T05:07:10.172 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:07:10.173 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T05:07:10.184 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T05:07:10.185 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T05:07:10.201 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T05:07:10.401 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T05:07:10.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T05:07:10.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:07:10.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T05:07:10.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:07:10.778 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T05:07:10.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T05:07:10.868 INFO:teuthology.task.internal:Duration was 722.184656 seconds 2024-05-09T05:07:10.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T05:07:10.883 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T05:07:10.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T05:07:10.891 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T05:07:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T05:07:11.037 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T05:07:11.402 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T05:07:11.402 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:07:11.402 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T05:07:11.465 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-05-09T05:07:11.465 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T05:07:11.547 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T05:07:11.547 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T05:07:11.555 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T05:07:11.638 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T05:07:11.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T05:07:11.644 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T05:07:11.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T05:07:11.827 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T05:07:11.827 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T05:07:11.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T05:07:11.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T05:07:12.008 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T05:07:12.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T05:07:12.110 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-05-09T05:07:12.115 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-05-09T05:07:12.157 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T05:07:12.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:07:12.202 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T05:07:12.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:07:12.260 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T05:07:12.272 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T05:07:12.273 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/remote/smithi100 2024-05-09T05:07:12.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T05:07:12.370 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558/remote/smithi133 2024-05-09T05:07:12.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T05:07:12.462 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T05:07:12.463 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T05:07:12.470 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T05:07:12.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T05:07:12.537 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T05:07:12.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T05:07:12.548 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T05:07:12.548 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T05:07:12.554 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T05:07:12.604 INFO:teuthology.orchestra.run.smithi100.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 05:07 /home/ubuntu/cephtest 2024-05-09T05:07:12.611 INFO:teuthology.orchestra.run.smithi133.stdout: 393267 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 05:07 /home/ubuntu/cephtest 2024-05-09T05:07:12.614 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T05:07:12.625 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T05:07:12.648 INFO:teuthology.nuke:Checking targets against current locks 2024-05-09T05:07:12.672 DEBUG:teuthology.nuke:shortname: smithi100 2024-05-09T05:07:12.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T05:07:12.702 DEBUG:teuthology.nuke:shortname: smithi133 2024-05-09T05:07:12.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T05:07:12.708 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 04:46:15.997800', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2nY1XbaiUWzUKpB/U6uPV1zaVAfh3QdGJQo7nK2G0YKUxgW3fGw+4QYsbWAmIiN2oJC2oh5Vubfyp8aaWc3lM='} 2024-05-09T05:07:12.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-09_04:42:47-fs-wip-63259-3-testing-default-smithi/7699558', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 04:46:15.999276', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUOyRCRaWLvY5z92z4HylL0DafRMQSUmHxWbaLbHO2Errnle1q71l67ihC0RTwjECDnxxebQfpHI0P8tNh8VTU='} 2024-05-09T05:07:12.761 INFO:teuthology.orchestra.console.smithi100:Power off 2024-05-09T05:07:12.762 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-09T05:07:12.789 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-05-09T05:07:12.789 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:12.806 INFO:teuthology.orchestra.console.smithi133:Power off 2024-05-09T05:07:12.806 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-09T05:07:12.816 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-05-09T05:07:12.829 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-05-09T05:07:12.829 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:12.852 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-05-09T05:07:16.818 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:16.853 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:16.929 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-05-09T05:07:16.963 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-05-09T05:07:20.933 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:20.964 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:21.043 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-05-09T05:07:21.074 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-05-09T05:07:21.174 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-05-09T05:07:25.045 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T05:07:25.155 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-05-09T05:07:25.256 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-05-09T05:07:25.361 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/backtrace} duration: 722.184656381607 failure_reason: 'Test failure: test_backtrace_flush_on_deleted_data_pool (tasks.cephfs.test_backtrace.TestBacktrace)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a4e5438f226b4681b17493b679ec633b status: fail success: false 2024-05-09T05:07:25.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T05:07:25.449 INFO:teuthology.run:FAIL